A source-linked abstract prepared once when this article was collected.
NEWS ABSTRACT10/22/2026 · one shared analysis
Respan, a YC W24 company, describes an open-source Rust AI gateway built around a small core where providers, protocols, modalities, and features such as fallbacks, smart routing, and PII redaction are plugins. The company says its prior LiteLLM-based wrapper grew past 100,000 lines and that a routine upgrade caused connection errors requiring a rollback. Plugins are compiled Rust crates rather than interpreted or dynamically loaded, a choice the authors justify by plugins needing database access. The project is described as pre-alpha, with the company monetizing a hosted platform. Discussion commenters raised usage and token-accounting inconsistencies across providers and plugin isolation tradeoffs.
Why it matters
Gateway design choices around plugin boundaries, isolation, and cross-provider usage accounting affect cost attribution and reliability for teams routing LLM traffic.
Read with care
Source claims not independently checked; the project is self-described as pre-alpha and the thread contains unanswered questions about token accounting.
ai gatewayrustopen sourcepluginsllm infrastructure
Discussion
Comments are reviewed before publication. Discuss the evidence, not the person.
No published comments yet.
Reader discussion opens with accounts. You can read the original source and published comments now.