python3-astra-assistants-2.2.12-1.lbn36.noarch

astra-assistants Astra Assistants is a drop in replacement for OpenAI's assistant API that supports the full Assistants v2 API (including streaming and vector_stores). This python library wraps the OpenAI SDK with additional capabilities and provides syntactic sugar for passing credentials for third party LLMs. How to use Install astra_assistants using your python package manager of choice: poetry add astra_assistants

import and patch your client: from openai import OpenAI from astra_assistants import patch

client = patch(OpenAI())

Server The astra-assistants server code is now open source (Apache2)! Check it out here https:/github.com/datastax/astra-assistants-api Authentication Provide api keys for third party LLMs via environment variables. We support LLM completions through litellm and support litellm environmental variables and models. Rename the .env.bkp to .env and fill in the appropriate values for the LLMs you want to use.