B
BerriAI-litellm
✓ verified, sync 2026-08-20BerriAI-litellm revolutionizes the interaction with large language models (LLMs) by providing a Python SDK and Proxy Server, designed to seamlessly integrate with over 100 LLM APIs….
What it does.
BerriAI-litellm revolutionizes the interaction with large language models (LLMs) by providing a Python SDK and Proxy Server, designed to seamlessly integrate with over 100 LLM APIs in the OpenAI format. This innovative tool is tailored for developers and enterprises seeking to streamline the process of calling diverse LLM APIs such as Bedrock, Azure, OpenAI, VertexAI, and more. By simplifying the integration and management of multiple LLMs, BerriAI-litellm addresses the complexities associated with managing and translating calls between different AI platforms.
Features
- Comprehensive LLM Integration: Supports over 100 LLM APIs, allowing users to access a wide range of models from providers like HuggingFace, Cohere, and Anthropic.
- Consistent Output Format: Ensures uniform output by adhering to the OpenAI format, simplifying the integration process across different models.
- Retry and Fallback Logic: Provides robust mechanisms for retrying and fallback across multiple deployments, enhancing reliability and performance.
- Budget and Rate Limiting: Allows users to set budgets and rate limits per project, API key, or model, offering precise control over resource usage.
Pricing history.
No approved price events on record
This listing's pricing hasn't changed since indexing, or a change is still in review. Zero events is a real answer, not missing data.
More chatbots tools.
GPT for Google Sheets™ Docs™ and Slides™ - Chrome Extension GPT for Google Sheets™ Docs™ and Slides™ is an AI assistant designed for the Google Worksp Auto WhatsApp Translator - AI Online Translator - Chrome Extension Auto WhatsApp Translator is a plugin designed for WhatsApp Web that provides automatic, re Nomi.ai "Nomi.ai" is an AI tool that aims to provide users with a personalized and adaptive AI com