Calculate prompt token count

Created on 12 April 2024, 5 months ago
Updated 29 May 2024, 4 months ago

Problem/Motivation

It would be useful to know prompt token count, as well as, this feature is needed for other features: Add maximum prompt length configuration and exception Active

Steps to reproduce

Proposed resolution

Remaining tasks

  1. [done] Create utility functions with basic calculation (calculate average value with basic math)
  2. [done] Display message with token count when user clicks "Display output" button
  3. Do parent issue Add maximum prompt length configuration and exception Active
  4. At some point later, replace basic calculation with accurate calculation

User interface changes

API changes

Data model changes

Feature request
Status

Fixed

Version

1.0

Component

Code

Created by

🇱🇹Lithuania mindaugasd

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

Production build 0.71.5 2024