AI Workers and Prompts¶
This is where we manage the LLMs that run our prompts. We use Instructor and LiteLLM to
(i) provide a coherent API across vendors; and (ii) to hide configuration and API Keys and
credentials from aidoc user(s).
This is where we manage the LLMs that run our prompts. We use Instructor and LiteLLM to
(i) provide a coherent API across vendors; and (ii) to hide configuration and API Keys and
credentials from aidoc user(s).