Support: vLLM (self hosted)

Alias support-vllm on the KongNet LLM gateway.

vLLM (self hosted)

Status: ๐ŸŸก Showcase: configured on the gateway and listed in Catalog, not connected to the provider

Aliassupport-vllm
ProvidervLLM (self hosted)
Upstream modelmeta-llama/Llama-3.3-70B-Instruct
EndpointPOST /llm/chat/completions

Policies on this model

  • None, this model is not connected

This model is listed to show the provider range. Calls to it fail at the gateway, and nothing is sent to the provider.

Back to all LLMs