LLM API
LLM API provides a unified inference API for text, embeddings, images, audio, video, files, and batch workloads across multiple AI providers.
12 actionsAPI key
What your bot can do in LLM API
Looks up
- Count Anthropic Message TokensCount input tokens for an Anthropic-compatible message request without generating a model response.
- Discover ModelsReturn one model's full live capabilities by ID, or browse a compact, bounded view of the live model catalog using local capability filters.
- Get Account and CreditsReturn the connected user, project, organization, purchased and bonus credit balances, funding mode, and balance gating in one…
- List or Get BatchesReturn one asynchronous batch and its latest lifecycle, token, and cost status by ID, or one provider-default page of project batches when…
- List or Get FilesReturn metadata for one project file by ID, or one provider-default page of project file metadata when no file ID is supplied.
Takes action
- Cancel BatchRequest best-effort cancellation of an in-progress batch.
- Create Anthropic MessageGenerate one complete, non-streaming Anthropic-compatible message with flexible content blocks, system prompts, and tool use.
- Create Chat CompletionGenerate a complete, non-streaming OpenAI-compatible chat response from role-based messages, optionally using tools, multimodal content,…
- Create EmbeddingsCreate vector embeddings for one text or a batch of texts with a selected embedding model.
- Create ResponseGenerate one complete, non-streaming OpenAI Responses-compatible result from text or structured input, preserving reasoning and tool items.
- Delete FilePermanently delete a caller-owned or explicitly authorized project file.
- Submit BatchCreate an asynchronous batch from an existing purpose=batch file ID, or upload a JSONL input file with purpose=batch and create the batch…
