Performance Issue: Slow Summarization of Long Fields

Created on 14 August 2024, about 1 month ago
Updated 16 August 2024, about 1 month ago

Problem/Motivation

When processing fields with large amounts of content (e.g., over 2000 tokens), the summarization process is significantly slowed down, even when utilizing high-performance Language Models (LLMs).

Steps to reproduce

  1. Perform a search on nodes where body fields exceed 2000 tokens (e.g., large tables).
  2. Observe the time taken for the summarization process.

Proposed resolution

The preferred solution is to utilize pre-summarized fields if available. If not, the module should provide an option to batch-process summarizations, improving performance for large fields.

🐛 Bug report
Status

Fixed

Version

1.0

Component

Code

Created by

🇬🇧United Kingdom seogow

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Merge Requests

Comments & Activities

Production build 0.71.5 2024