- Issue created by @CoffeyMachine
- 🇺🇸United States CoffeyMachine
coffeymachine → changed the visibility of the branch 3520606-minimum-overlap-error-105 to hidden.
- Merge request !569Reduce the chunk minimum overlap for contextual content chunks → (Open) created by Unnamed author
- 🇬🇧United Kingdom scott_euser
Thanks for the work on this! Added a comment on the MR. Needs a retest, but then sounds okay to me. Thanks!
- 🇮🇳India JatinGupta40
Thanks @scott_euser for the suggestion! I also believe that suggestion #7 is a better approach — Scaling the contextual overlap proportionally ensures that even when titles are long, the chunking process remains stable and within bounds.
In addition, I’ve added a safeguard:
$contextual_min_overlap = max(1, intval($this->chunkMinOverlap * $max_contextual_content));
Updating the MR.