Open LLMs support

Created on 23 June 2023, over 1 year ago

Problem/Motivation

Proposed resolution

There is a nice library https://github.com/bentoml/OpenLLM.
OpenLLM which has Flexible APIs and supports a wide range of State-of-the-art open LLMs (including StarCoder).
This library can provide API to use, and Drupal would use this API.

Remaining tasks

User interface changes

API changes

Data model changes

📌 Task
Status

Active

Component

Code

Created by

🇱🇹Lithuania mindaugasd

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

Production build 0.71.5 2024