One gateway for every model.
Add a detection and routing layer in front of your models. Business code stays untouched, and there is only one configuration file.
The online demo needs no installation — try it directly in the browser.
Docker / K8s deployment · YAML hot reload · multi-model routing
Three-layer security architecture
Configuration, detection and routing each stay in their own place.Configuration, detection and routing each stay in their own place.
YAML configuration
YAML configuration
Gateway cluster
Gateway cluster
Model backends
Model backends
Intelligent multi-model routing
Pick a model from a header or a field. Zero changes to business code.Pick a model from a header or a field. Zero changes to business code.
Request arrives → parse X-Model-ID → look up the YAML routing table → land on the target model. The table supports weighting and failover, and changes need no restart.
# Enterprise multi-model gateway configuration
models:
- id: deepseek-v3
endpoint: http://internal.deepseek:8000/v1
type: private
- id: gpt-4
endpoint: https://api.openai.com/v1
type: public
api_key: ${OPENAI_API_KEY}
routing:
strategy: weighted
fallback: deepseek-v3Pick a deployment by scale
From a single machine to a cluster, with one configuration file.From a single machine to a cluster, with one configuration file.
Docker Compose
Bring up the full gateway with one command. Good for PoC and small teams.
docker-compose upKubernetes Helm
One-command Helm deployment, autoscaling, shared prototype library across instances.
helm install kanheCloud native
Managed runtime, scale on demand, fits ECS / EKS.
cloud deploymentThree everyday operations
Launch, scale, audit — each has a definite action.Launch, scale, audit — each has a definite action.
From PoC to full coverage
Incremental deployment, with an acceptance point at every step.Incremental deployment, with an acceptance point at every step.
Single model, Docker deployment
3+ models and routing working
K8s cluster and failover
Lower false positives, accumulate rules
Covers four roles — security, operations, development and compliance — each seeing only their own view.
Start with one model
One demo is enough to see where it blocks and what it lets through.