Create a Prompt Logger

Can be tested in DEV.

Thanks for adding this feature, it will be really useful to help understand what goes on behind the scene, like which prompt and parameters are being sent (role, max. tokens, and so on).

This feature will probably help answer questions like the one I posed recently?:

Bonus question: Does anyone have any experience with getting fairly fast and short answers (max. 500 characters) from HuggingFace, but getting longer processing time and thereby answers, after upgrading to a paying account?

HuggingFace answers after only 5 seconds with a short reply, whereas OpenAI, which I used previously, spent up to 30 seconds, returning very elaborate replies with up to 4000 character ...

From #3454202-4: Enable token support for AI Interpolator Rule Huggingface Text Generation → .

Probably should log:

- Response time
- Tokens
- moderation response
(Maybe Tokens / minute)

As you'll want to do tests and then model how long/ expensive something will be when it scales up

Highlighting this comment to still fix reposnse time.

Work still pending

We are doing some issue management housekeeping and adding/removing components.

We are removing the "Code" component and want people to categorize issues with the best module/submodule component.

Moving this issue to "...to be triaged" as this has stalled.

See 📌 Update AI module project components Active for more details.

Response time is in other issue.