Opening the edit form from an entity reference field throws an error for some entity types

This happens for some entity types, like user or taxonomy term, that don't have the 'edit' operation defined.

Example use case:
If you set up a entity reference field to select user entities and create an entity browser, you also will get an edit button to edit the selected user.

If you click on the edit button, you will get this error:

Drupal\Component\Plugin\Exception\InvalidPluginDefinitionException: The "user" entity type did not specify a "edit" form class. in Drupal\Core\Entity\EntityTypeManager->getFormObject() (Zeile 184 in web/core/lib/Drupal/Core/Entity/EntityTypeManager.php).

The form for user is called "default" and not "edit". I guess the code in the controller is mainly made for nodes.