Basics of Threading and Improvements to Assistants

Created on 23 August 2024, 4 months ago
Updated 27 August 2024, 4 months ago

Problem/Motivation

In alpha6 the Chatbot with assistants doesn't support threading and history even though it looks like it should. We should improve this for Alpha7.

Proposed resolution

  • Handle Threading /History with the assistants api.
  • Can we make it so you can choose threading if its stored in the session vs stored on the server? (Even if we don't implement Server, can call it "Todo"), also choose no threading.
  • For alpha7, history vs threading is the same thing. As we are not storing the history. So everything will go into a single long thread that dies when the session is over. In the future if we store history, we can have multiple threads of "Chats" you can pick from like in chat.openai.com.
  • Context system - How do we know how much context we send to subsequent prompts?
  • Choose different options for how much history there is (Just cut off after a certain tokens, summarise, RAG (use the simplest for Alpha 7)
  • Add - Flag - Handles JSON well - Allow providers to mention if a specific model handles JSON well. Modules can provide warnings as a model too small and ineffective to handle JSON is asked to do a task.

Remaining tasks

User interface changes

API changes

Data model changes

📌 Task
Status

Active

Version

1.0

Component

AI Search

Created by

🇬🇧United Kingdom yautja_cetanu

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

Production build 0.71.5 2024