Only users with "Administer entityqueue" should be show (configure) item.

That operation is the general Edit operation provided by \Drupal\Core\Entity\EntityListBuilder::getDefaultOperations(), which checks if the user has access to update the entity. There must be something else going on there, maybe some custom code from your project?