Add ChatbackendInterface

Created on 10 December 2024, 4 months ago

Problem/Motivation

Currently the AI Assistant API is coupled with the AI Chatbot, but we should be able to decouple this by adding an ChatbackendInterface that normalizes the request/response methods and make it possible for any backend to hook in and use the Chatbot.

That way anyone wanting for instance to do naive RAG can do that, without the whole overhead of Assistants or anyone wanting to interact directly with one specific agent.

Proposed resolution

Add an interface (perhaps plugin for discoverability).
Figure out the actual input and outputs needed for request/response.

Remaining tasks

User interface changes

API changes

Data model changes

🌱 Plan
Status

Active

Version

1.0

Component

Other Submodules

Created by

🇩🇪Germany marcus_johansson

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

  • Issue created by @marcus_johansson
  • 🇧🇬Bulgaria valthebald Sofia

    Bumping the target version

  • 🇬🇧United Kingdom MrDaleSmith

    I'm not quite getting from the description and a review of the codebase exactly what changes you're suggesting here: is the chatbackendInterface intended as a potential drop in replacement for the AiAssistantRunner that sits on the block forms? As far as I can see the chatbots are just forms wrapped around the ai_assistant_api's functions so it isn't immediately obvious which bit you think might be possible to make more flexible.

Production build 0.71.5 2024