How do I connect FriendliAI with OpenAI-compatible clients?

FriendliAI exposes an OpenAI-compatible Chat Completions API. Point the client's base URL at Model API (https://api.friendli.ai/serverless/v1) or your Dedicated endpoint (https://api.friendli.ai/dedicated/v1), and use your Friendli API Key as the API key. That covers OpenAI SDKs, LiteLLM and similar tools.

We also support an /v1/responses API and Anthropic-compatible /v1/messages API. For more details, check our API References.

• OpenAI Compatibility

• API References

  • Model API Chat Completions API Reference

  • Model API Responses API Reference

  • Model API Messages API Reference

• Integration Guides

  • OpenAI SDK Integration Guide

  • Vercel AI SDK Integration Guide

  • LiteLLM SDK Integration Guide