AI Search and OpenAI Assistants API

Problem/Motivation

Setting up Search API and embeddings can be difficult and scary for someone who hasn't done before and there are lots of little ways things can do wrong. We created this module: https://www.drupal.org/project/openai_assistants → that uses the OpenAI Assistants API that sorts of threading, vector storage, streaming, embeddings all itself and is both ridiculously use to use from an API point of view and in playground and gives great results.

However, its all in one. It's "Server" and "Embeddings" so its a little weird from a Search API point of view.

Proposed resolution

I think we should support OpenAI assistants module some how with AI Search.

Also
I wonder if it would be worth having an external module called "Simple OpenAI Assistants" that is like a recipe that sets everything up for you and indexes only the files on content or something. Or indexes all content OOB or something so people can get going without having to set up servers etc.

Remaining tasks

API changes

Data model changes