Only users with "Administer entityqueue" should be show (configure) item.

That operation is the general Edit operation provided by \Drupal\Core\Entity\EntityListBuilder::getDefaultOperations(), which checks if the user has access to update the entity. There must be something else going on there, maybe some custom code from your project?

This is also part of https://www.drupal.org/project/entityqueue/issues/3396136 ✨ Fixes to permissions Active and the case is explained there.

Steps to reproduce

1. Don't give a certain role the permission "Administer entityqueue".
2. Give that role the permission to "manipulate" a queue
3. Users with that role will see the "Configure" action for that queue, however, they can't access the corresponding page to configure it. They shouldn't see the "Configure" operation.