Getting a demo to answer a question takes an afternoon. Getting a feature to answer ten thousand of them a day, at a cost you planned for, when a provider is having a bad hour, is the actual job.
That second part is what I do all day.
#Where this comes from
I co-founded and build LLM Gateway, an open-source AI gateway: one OpenAI-compatible API in front of many model providers, with routing, fallback, caching, usage analytics and billing. I work across the gateway API, the account and billing backend, the customer dashboard, the docs, the chat playground and the provider portal, in TypeScript, Next.js, Hono, PostgreSQL and Redis.
Around it I have shipped:
- DevPass, flat-rate model access for coding tools, with subscription management, usage dashboards and pay-as-you-go overflow.
- Airside, a self-service portal where model providers onboard themselves: domain verification, capability checks, pricing approvals, routing controls and traffic analytics.
- DevPass Code, an open-source terminal coding agent with browser authentication and unified model access.
@llmgateway/ai-sdk-provider, so teams on the Vercel AI SDK can adopt it in one line.
I also led the SOC 2 Type II program for it, which shapes how I think about keys, access and data on every client build.
#What you typically hire me for
- Adding a chat, search or agent feature to an existing product without rewriting the product.
- Building an MCP server so assistants can use your product safely.
- Replacing a tangle of per-provider SDK calls with one routed, observable interface.
- Bringing an AI bill under control with caching, model selection and per-customer limits.
- Designing usage-based billing for an AI feature, so pricing follows cost.
- A hard look at an AI roadmap before you commit two quarters to it.
If you are about to build on top of a model, or already have and it is starting to hurt, send me the details.