Use familiar chat and embedding endpoints.
The gateway supports OpenAI-compatible chat completions, text embeddings, and model listing. Set the base URL, key, and an available model ID. Compatibility covers these endpoints; model capabilities and supported parameters vary.
- + Standard endpoints: POST /v1/chat/completions, POST /v1/embeddings, and GET /v1/models
- + Tool calling — tools, tool_choice, and streamed tool calls work with OpenAI SDKs and agent frameworks
- + Text embeddings for search and retrieval — 256, 512, or 1024 dimensions, float or base64
- + Streaming responses with stream: true
- + Familiar error formats your retry logic already understands