Too many requests

Created on 24 January 2025, 6 days ago

Problem/Motivation

I've completed the setup and I keep getting "Too Many Requests" for each request. The initial step was to try to add auto translation with an OpenAI integration, but even when I try the Chat interface provided by AI, I keep getting the same error.

In the meantime I've tried with 2 separate accounts, one free and one paid (because I thought I was because of the quota), but no solution.

Steps to reproduce

Install module
Configure with OpenAI API key
Setup the defaults for the modules
Try to translate with OpenAI
Try with a paid account API key
Try the chat interface
See the same errors returning

Proposed resolution

Get it to work?

Remaining tasks

None.

User interface changes

None.

API changes

None.

Data model changes

None.

💬 Support request
Status

Active

Version

1.0

Component

Code

Created by

🇧🇪Belgium blacksnipe

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

  • Issue created by @blacksnipe
  • 🇩🇪Germany marcus_johansson

    I think we need better error handling here and have to add warnings to the status page when an account does not fill the requirements of most 3rd party module. Only sparse usage of gpt-3.5 is allowed more or less.

    As for support request - Could you verify that you have added $5 to the account - that is the limit to reach tier1. If you have this, could you verify under https://platform.openai.com/settings/organization/limits that you are tier 1.

    Tier 1 should in general be enough, to handle most rate limits for any website where only administrators/editors has access to the features and use them. For end-user facing solutions you have to have a higher tier.

    More about tiers here: https://platform.openai.com/docs/guides/rate-limits/usage-tiers?context=...

    If you are on Tier 1, please let us know and we have to look into what is not correct.

  • 🇧🇪Belgium blacksnipe

    Hi Marcus

    The paid account did solve the Too Many Requests issue once it's above Tier 1.
    Thanks for pointing this out. Maybe there should be a documentation available somewhere explaining this, or I might have looked over it? :-)

    The chat now works, but now I'm still stuck when trying to translate.
    I keep getting a "The Prompt is unsafe: The prompt was flagged by the moderation model." error when translating. Might be related, but maybe something for auto_translation? Any ideas?

  • 🇩🇪Germany marcus_johansson

    Just to answer your question - we have OpenAI moderation endpoint running on every request by default. You can turn this off by configuration, but its really highly recommended that you do not.

    If you get enough strikes of calls against the LLM that are flagged as suspicous, they might ban your account.

    So the error you saw, was because the article flagged something in the content as harmful, see: https://platform.openai.com/docs/guides/moderation

    If you want to try to figure out what it is there is a submodule called AI API Explorer you can enable, where you can go to the moderation explorer and paste in your article and you will get a verbose result with what type of harmful category flagged it.

    I added this issue: Improve checks for tier 1 accounts Active

    Could this issue be closed as answered?

  • 🇧🇪Belgium blacksnipe

    Thanks for the explanation.
    This can be closed for me.

Production build 0.71.5 2024