Skip to content

feat: steerlb L7 load balancer MVP - #1

Merged
tomlin7 merged 4 commits into
mainfrom
feat/steerlb-mvp
Nov 4, 2026
Merged

tomlin7 merged 4 commits into
mainfrom
feat/steerlb-mvp

Conversation

@tomlin7

@tomlin7 tomlin7 commented Oct 9, 2026 •

Copy link
Copy Markdown
Member

What

L7 HTTP load balancer with P2C and peak-EWMA picking, active health checks, Envoy-style outlier ejection, retry budgets, circuit breaking, hot reload, and graceful drain.

Why

Portfolio project showcasing failure domain handling, retry storm mitigation, outlier ejection capping, and zero-downtime hot reloading.

How It Was Tested

  • Unit tests with race detector: Hop-by-hop stripping, XFF appending, budget math, EWMA decay/peak, P2C invariants, config validation.
  • Fuzz testing: \go test -fuzz=FuzzHeaders -fuzztime=30s\ (1,119,035 executions, 0 crashes, 0 hop-by-hop header leakages).
  • Property-based testing: \pgregory.net/rapid\ testing on Outlier Detector (100 sequences, ~5,000 steps) and Retry Budget (100 sequences, ~10,000 steps).
  • Reload & Drain tests: 20 SIGHUPs under continuous load with 0 client-visible errors; SIGTERM draining 5 in-flight requests with 0 dropped.
  • Faultbench matrix: End-to-end benchmark across 5 fault scenarios (S1–S5) under 3 policies (A, B, C).

Numbers

  • Proxy overhead: sub-50 µs on the hot path; 1,793.1 sustainable RPS at 100% success on co-located hardware.
  • Faultbench S1 (50% 503s): Round-Robin=92.55% success | Least-Request=92.81% | steerlb=100.00% success (p99: 47.81 ms).
  • Faultbench S2 (10x slower): Round-Robin p99=201.98 ms | steerlb p99=5.39 ms (traffic steered away).
  • Faultbench S5 (Retry storm): Upstream amplification capped at 1.24x by the retry budget.

Known Gaps

  • Single process (no distributed control plane / HA)
  • HTTP/1.1 only (HTTP/2 and gRPC passthrough are stretch goals)
  • Cleartext HTTP only (TLS termination expected at ingress edge)

@tomlin7
tomlin7 marked this pull request as ready for review October 10, 2026 10:29
@tomlin7
tomlin7 merged commit 074cedd into main Nov 4, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant