[Meta] Bring AI Search, Assistants and Chatbot out of Experimental

Combine lexical + Vector search in one query (qdrant does this) (Note: BM25 is not the same as solr, etc). This is for when we provide context to an LLM, not just the boost with with AI functionality

Can you detail this one a bit more? Sorry I'm so used to the drupal terminology I don't know what this means in a practical sense. Also can't see anything in Qdrant docs that shows how its different from filtering in Milvus for example, so would be good to get pointed in direction there.

I think we also need to get someone who uses e.g. Mandarin or Japanese for example to work on 🐛 Broken Byte-Pair Encoding (BPE) Active in the embedding strategies.

Is Seogow working on the Qdrant side of things still? Might make it more clear

I have also been working on ✨ Improve the Search API admin UI for adding/editing fields Active which needs review. It should significantly improve the user interface for adding fields.

That UI for Search API is soooooo much nicer!!!

I'm happy it got in yeah!

So the situation I'd like with AI Search + Chatbot is that I search for something and it does the traditional search, where it searches for the words as is and then also the semantic search and then automatically combines them.

I think its probably the case that your "Boost With AI" but providing it as Context to a chatbot would solve this. So its probably just taking what you've already done and making it so the LLM can use it as context, not just a view can use it.

duplicate comment

Yeah the processor is in search api, not views, so executing search API can use the boost. And maybe boost is the wrong word as (at least with database) you can get results that traditional search failed to find - so it combines as you say (haven't thoroughly tested solr, might need tweaking).

As long as you are executing search api in a chatbot with that processor enabled you'll get what you're asking already.

Looking at the issue queue, I updated issue summary with what I think would be good to get sorted.