Vercel AI Gateway
Access Vercel AI Gateway's model discovery, inference, generation, and usage APIs through a unified AI model gateway.
22 actionsAPI key
What your bot can do in Vercel AI Gateway
Looks up
- Count Message TokensEstimate input tokens for Anthropic-format messages, system content, and tools before sending a model request through Vercel AI Gateway.
- Get Credit BalanceReturn the connected team's remaining AI Gateway credit balance and lifetime credit usage in USD.
- Get GenerationLook up cost, token usage, provider routing, latency, and finish details for one completed Vercel AI Gateway generation.
- Get ModelReturn detailed capabilities, modalities, limits, tags, and pricing for one exact Gateway model ID.
- Get Model EndpointsCompare provider endpoints serving one Vercel AI Gateway model, including limits, pricing, caching, availability, throughput, and latency.
- Get Spend ReportQuery aggregated Vercel AI Gateway spend and token usage.
- List Model CatalogList AI Gateway model-to-provider routes and capability tags, with bounded local filtering by model text, provider, or tag.
- List TypeSafe ModelsList evaluation models available through AI Gateway's TypeSafe-compatible API, including each accepted model name, description, and…
- Search ModelsSearch the AI Gateway model catalog by text, model type, and tags, returning capability and pricing metadata for matching models.
Takes action
- Compact ResponseCompact a long OpenAI Responses conversation into replayable context through Vercel AI Gateway.
- Create Anthropic MessageCreate one non-streaming Anthropic Messages-compatible result through Vercel AI Gateway, with multimodal content, tools, extended…
- Create Chat CompletionCreate one non-streaming OpenAI Chat Completions-compatible result through Vercel AI Gateway, with multimodal messages, tools, structured…
- Create EmbeddingsGenerate OpenAI-compatible vector embeddings through Vercel AI Gateway for text or token inputs, with optional dimensions and routing…
- Edit ImagesCreate edited images from up to 16 HTTPS or base64 data-URL source images and a text instruction.
- Evaluate StateEvaluate one shared state against one or more typed choice, score, or boolean questions using an AI Gateway evaluation model.
- Evaluate with TypeSafe APIEvaluate one shared state through AI Gateway's TypeSafe-compatible System One API.
- Generate ImagesGenerate one or more images from a text prompt through an image-only Vercel AI Gateway model.
- Generate ResponseGenerate one non-streaming OpenAI Responses-compatible result through AI Gateway, with optional instructions, tools, structured output,…
- Generate SpeechGenerate spoken audio from text through a Vercel AI Gateway speech model.
Show 3 more
- Rerank Object DocumentsRank structured object documents by relevance through the Cohere v1 route, using selected rank fields and optionally returning each source…
- Rerank Text DocumentsRerank string documents through the current Cohere v2 compatibility endpoint.
- Transcribe AudioTranscribe base64-encoded recorded audio through a Vercel AI Gateway transcription model.
