Max tokens too low, no where to configure?

Created on 26 January 2025, 4 days ago

I usually need 4096 max tokens for my agents, I see the other modules have that higher limit. This is a very important setting but I don't see it configurable anywhere?

Feature request
Status

Active

Version

1.0

Component

Code

Created by

🇺🇸United States drupalninja99

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

  • Issue created by @drupalninja99
  • 🇮🇳India vinayakmk47

    When the AI module is installed and Anthropic is configured as the provider, the Max Tokens setting can be adjusted directly in the admin interface. Navigate to the following URL to access this setting:

    URL: admin/config/ai/explorers/chat_generator

    On this page, under the Provider Configuration section (as shown in the screenshot), you will find the Max Tokens input field. This field allows you to specify the desired maximum token limit for chat completions. For example, you can input 4096 to accommodate your requirements.

    This ensures flexibility and control over the token limit for your specific use case without requiring any code-level changes.

Production build 0.71.5 2024