You can now deploy LiteLLM server on Vercel, giving developers LLM access with an OpenAI-compatible gateway connecting to any supported provider, including Vercel AI Gateway.

from litellm.proxy import proxy_server
app = proxy_server.app

To route a single model through Vercel AI Gateway, use the below configuration in litellm_config.yaml:

  - model_name: gpt-5.4-gateway
    litellm_params:
      model: vercel_ai_gateway/openai/gpt-5.4
      api_key: os.environ/VERCEL_AI_GATEWAY_API_KEY

Deploy LiteLLM on Vercel or learn more on our documentation