I was looking into adding OpenSearch as a vector database provider and I found this issue by chance. I was wondering if it wouldn't be better to put this functionality in its own provider module? I started a project just for that before I found this issue by chance.
marcus_johansson → Thank you for the feedback. After going back and forth on the problem I created https://www.drupal.org/project/ai_provider_vllm → instead. Because thats what we actually needed. Support for vLLM.
marcus_johansson →
sounds good! I would like to start on this new provider module. What name would you suggest ai_provider_openai_compatible? Do you have some tips for what parts need to be altered to make it general?
jjchinquist → credited maximilianmikus → .