Unintended consequence here: Views using the "Display a specified number of items" pager and a more link no longer display the more link now that this patch has been committed. The more link does show if you switch to another pager, but not this one. Commenting out the lines added to core/modules/views/src/Plugin/views/pager/Some.php makes the more link display properly again.
I think to address the original issue, the total-rows number was correct as that's the total number or rows before any pager is used. To get the total number of shown results you should use something like [view:items_per_page] instead.
To clarify, this patch gets applied to 1.5 instead of upgrading to 1.6 for Drupal 8.
Here's a re-roll of #32 for Drupal 9.5.2. and Entity Embed 8.x-1.3.
What patch did you apply rossidrup?