LiteLLM is an open-source library that simplifies LLM completion and embedding calls. It provides a convenient and easy-to-use interface for calling different LLM models.
To use LiteLLM, you need to import the 'litellm' library and set the necessary environment variables for the LLM API keys (e.g., OPENAI_API_KEY and COHERE_API_KEY). Once the environment variables are set, you can create a Python function and make LLM completion calls using LiteLLM. LiteLLM allows you to compare different LLM models by providing a demo playground where you can write Python code and see the outputs.
Here is the LiteLLM Discord: https://discord.com/invite/wuPM9dRgDw. For more Discord message, please click here(/discord/wupm9drgdw).
LiteLLM Github Link: https://github.com/BerriAI/litellm