Add provider and model feature flags for filtering

Created on 20 August 2024, 8 months ago
Updated 6 September 2024, 7 months ago

Problem/Motivation

Currently the providers might have different featuresets. On example is streamed output for instance.

Also the models might have different feature sets, like certain models can take an image as input, others not.

We need a system where you can flag providers and models and where you can check if a provider has a feature and query or filter models based on features.

Steps to reproduce

Proposed resolution

Add two enum, one for provider capabilities and one for model capabilities.
Make it possible to assign the provider capabilities to a provider.
Make it possible to check if a provider has some specific capability.
Make it possible to filter the getModels on a model capability.

Remaining tasks

User interface changes

API changes

Data model changes

Feature request
Status

Fixed

Version

1.0

Component

AI Core module

Created by

🇩🇪Germany marcus_johansson

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

Production build 0.71.5 2024