Support open source vector engines other than Pincone

This was the plan initially, Pinecone was just an easy starting point. I tried my hand at creating "VectorClient" plugin and plugin manager - the thought being that if someone implemented a plugin, it would become an option on the configuration page with its own configuration form. I had trouble deriving a common interface for that though since the vector services all work a bit differently.

You can view that work here:

https://git.drupalcode.org/project/openai/-/tree/1.0.x/modules/openai_em...

I haven't ever really made a custom plugin and plugin manager before in this sense, so hopefully someone can shed some light there.

I just took a two-week training on chatting with your documents and we started out using Pinecone, but then switched to Chroma, which is open source. I'm looking to contribute to this module and I think this may be a good issue for me to tackle.

https://www.drupal.org/project/search_api_ai →

I am thinking that this effort is better suited to https://www.drupal.org/project/search_api_ai → so a pluggable plugin could make use of several backends, get embedded and indexed. You may want to start there, building a plugin for that.

📌 Make the embeddings pluggable (so alternatives to OpenAI can be used) Active

I wasn't aware of this module - I will take a look and see if I can help out there.