Password field is required

This module does nothing with the password field -- except it makes it invisible for some users that only log in through SAML.

If you add "authenticated user" (or one of your other roles) in SAML configuration value "Roles allowed to use Drupal login also when ...", then this module does literally nothing with the user/profile form.

I think you're looking at the wrong module.

Found it. The module userprotect → was causing this behaviour only on image fields, go figure.

All fine here. Closing.