portfolio Anshul Bisen
ask my work

AI Gateway

OpenAI-compatible API gateway wrapping CLI AI subscriptions

Wraps Claude Code Max and OpenAI Codex Pro CLI subscriptions into a unified, OpenAI-compatible REST API. Other applications consume AI through a standard /v1/chat/completions interface without per-token API costs. Includes a web chat UI, context engineering with sliding-window strategies, SSE streaming, conversation history, and full observability via Prometheus and OpenTelemetry.

Highlights

  • OpenAI-compatible /v1/chat/completions endpoint
  • Context engineering with sliding-window and system-prompt strategies
  • SSE streaming pipeline from CLI stdout
  • Web chat UI with model selection and conversation management
  • Prometheus metrics, pino logging, and OpenTelemetry tracing