Normalize Structured responses

Created on 10 December 2024, 12 days ago

Problem/Motivation

We have an initial version of function calling, we should perhaps also build structured responses while we are at it since they share a lot of features - a function call in the end is just another way of getting JSON back.

For more reading:
https://ollama.com/blog/structured-outputs
https://platform.openai.com/docs/guides/structured-outputs
https://docs.anthropic.com/en/docs/test-and-evaluate/strengthen-guardrai...
https://docs.fireworks.ai/structured-responses/structured-response-forma...

Proposed resolution

Add a normalization layer for this.
Add a validation layer for this.
See how much it can work as function calling

Remaining tasks

User interface changes

API changes

Data model changes

Feature request
Status

Active

Version

1.0

Component

AI Core module

Created by

🇩🇪Germany marcus_johansson

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

Production build 0.71.5 2024