Add flexible client

Created on 17 October 2024, about 1 month ago

Problem/Motivation

Since Azure is made for enterprise, the update cycle of model might be different then on normal OpenAI where they stay around for longer and they also might have calls that are not available in public OpenAI like extension chat completions in OpenAI 2023-06-01-preview.

We should aim to build a simple client that has abstraction layers for how it handles query, post data, method, standard authentications like bearer token, basic auth etc and have one method for json to start with.

Later add streaming, asynchronous etc.

The actual validation of the decoded array has to be in the providers logic and error handling.

It should mimic the needed methods of the https://github.com/openai-php/client, but not follow their contract.

If this is flexible enough we should move that service later to core since Mistral provider also needs this.

Steps to reproduce

Proposed resolution

See description

Remaining tasks

User interface changes

API changes

Data model changes

Feature request
Status

Active

Version

1.0

Component

Code

Created by

🇩🇪Germany marcus_johansson

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

Production build 0.71.5 2024