The two most popular self-hosted LLM proxies. Same job, very different architecture.
LiteLLM is the most popular open-source LLM proxy with 41.6k GitHub stars and YC backing. It supports 100+ providers and has the largest community in this space.
Stockyard is a single Go binary with embedded SQLite. It ships the proxy, observability, audit trail, and 150 tools in one process. No Postgres, no Redis, no Docker Compose.
Both are legitimate choices. The right one depends on your infrastructure preferences and what you already run.
| Feature | Stockyard | LiteLLM |
|---|---|---|
| Language | Go (compiled binary) | Python |
| Deployment | Single ~25MB binary | Docker: Postgres + Redis required |
| External deps | None (embedded SQLite) | Postgres (required) + Redis (required) |
| Min resources | Runs on anything | 4 CPU / 8GB RAM recommended |
| Open source | Proxy: Apache 2.0 / Platform: BSL 1.1 | MIT (41.6k stars) |
| Providers | 40+ | 100+ |
| Pricing | Free unlimited, paid from $0.99/mo per tool, or $29/mo Complete bundle | Free self-hosted, Enterprise contact sales |
| Cost tracking | ✓ Per-request | ✓ Per-request |
| Caching | ✓ Built-in | ✓ Via Redis |
| Rate limiting | ✓ Built-in | ✓ RPM/TPM limits |
| Failover | ✓ Built-in | ✓ Load balancing |
| Guardrails | ✓ 76 middleware modules | ✓ Via integrations |
| Observability | ✓ Built-in (Lookout) | Via Langfuse/Arize integration |
| Audit trail | ✓ Hash-chained | Logs (Enterprise) |
| Red-team testing | ✓ Feral | None |
| Supply chain | Compiled Go binary | PyPI (supply chain attack March 24, 2026) |
Data reflects publicly available documentation as of March 2026.
Zero infrastructure. You do not need Postgres, Redis, or Docker. Download one file, set an environment variable, and you have a working proxy with tracing.
Supply chain security. Stockyard is a compiled Go binary. In March 2026, LiteLLM had a PyPI supply chain attack where malicious versions (v1.82.7 and v1.82.8) stole credentials. A compiled binary eliminates that attack surface entirely.
Built-in observability. LiteLLM requires integrating with Langfuse or Arize for tracing. Stockyard includes Lookout, a full observability dashboard, in the same binary.
Cryptographic audit trail. Stockyard's Brand app creates a SHA-256 hash-chained ledger of every LLM request. LiteLLM has no equivalent.
If you need 100+ providers, LiteLLM wins. Stockyard supports 40+, which covers all major providers, but LiteLLM's coverage is broader for niche or regional providers.
If your team is Python-native and you already run Postgres, LiteLLM integrates more naturally into your stack. The ecosystem is also significantly larger (41.6k stars, extensive documentation, active Discord).
If you want a fully MIT-licensed solution with no BSL components, LiteLLM is the cleaner licensing story. Stockyard's proxy core is Apache 2.0, but the full platform is BSL 1.1.
LiteLLM has more providers and a bigger community. Stockyard has simpler deployment and more built-in features. If you already run Postgres, LiteLLM is a natural fit. If you want everything in one binary with zero dependencies, try Stockyard.