Using OpenAI compatibility API with custom Client

Created on 29 December 2024, 23 days ago

AnythingLLM provides an OpenAI compatibility API. The ai_openai_provider not fully supports external URLs. We tried to patch for use external Hosts but the result for /models given from anythingLLM was not compatible with OpenAI Client.

Proposal: Use OpenAI API with custom client as first step.

🌱 Plan
Status

Active

Component

Miscellaneous

Created by

🇩🇪Germany jan kellermann

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

Production build 0.71.5 2024