LLMs

One URL, one format, every provider. Change the model field and nothing else.

Status: 🟢 Live, running on the gateway today

OpenAI

Anthropic

Google

Ollama (local open weights)

Multi provider failover

All models

Model aliasProviderUpstream modelGuardrails
OpenAIsupport-gptOpenAIgpt-5.6-terra6 policies
Anthropicsupport-claudeAnthropicclaude-opus-55 policies
Googlesupport-geminiGooglegemini-3.8-flash5 policies
Ollamasupport-ossOllama (local open weights)llama3.2:3b5 policies
Anthropicsupport-sonnetAnthropicclaude-sonnet-55 policies
Anthropicsupport-haikuAnthropicclaude-haiku-5-55 policies
OpenAIsupport-gpt-miniOpenAIgpt-5.4-mini6 policies
Googlesupport-gemini-proGooglegemini-3.1-pro-preview5 policies
Ollamasupport-qwenOllama (local open weights)qwen3.8:27b5 policies
Ollamasupport-gemmaOllama (local open weights)gemma4:latest5 policies
OpenAI Anthropic Googlesupport-autoMulti provider failovergpt-5.6-terra then claude-opus-5 then gemini-3.8-flash6 policies
OpenAIsupport-faqOpenAIgpt-5.4-nano3 policies

Call any model

curl http://localhost:8010/llm/chat/completions \
  -H "apikey: $KONGNET_API_KEY" -H "Content-Type: application/json" \
  -d '{"model": "support-gpt", "messages": [{"role": "user", "content": "Why is my wifi slow?"}]}'

The gateway URL is the demo data plane. See the LLM Gateway API for the full reference.