Can't uninstall

There must be some steps missing from your steps to reproduce. Adding, then removing, the module via Composer—without ever installing it—should not cause any issue in Drupal. If it is installed and an encryption profile is created, you will need to remove the encryption profile and uninstall the module before removing the package as a Composer dependency.

I've the same issue but in a different context.

After few weeks on other tickets I'm working again on an encrypt mission that was working great.
Checking out the branch about the encrypt ticket, when I'm drush cim it's enabling again all the encrypt modules, every commands respond great but the website always shows me :

Drupal\Component\Plugin\Exception\PluginNotFoundException: The "encryption_profile" entity type does not exist. in Drupal\Core\Entity\EntityTypeManager->getDefinition() (line 139 of core/lib/Drupal/Core/Entity/EntityTypeManager.php).
Drupal\content_translation\ContentTranslationManager->isSupported('encryption_profile') (Line: 94)
Drupal\content_translation\ContentTranslationManager->isEnabled('encryption_profile', 'encryption_profile') (Line: 470)
content_translation_entity_extra_field_info()
call_user_func_array(Object, Array) (Line: 426)
Drupal\Core\Extension\ModuleHandler->Drupal\Core\Extension\{closure}(Object, 'content_translation') (Line: 405)
Drupal\Core\Extension\ModuleHandler->invokeAllWith('entity_extra_field_info', Object) (Line: 433)
Drupal\Core\Extension\ModuleHandler->invokeAll('entity_extra_field_info') (Line: 660)
Drupal\Core\Entity\EntityFieldManager->getExtraFields('site_setting_entity', 'ino_ss_homepage') (Line: 160)

If I drush pmu encrypt it's OK but I can't enable it and make the website don't crash on this erreur.

cli-drupal:/app$ drush edel encryption_profile
 [success] No matching entities found.

It's certainly a tiny thing I forget to manage but I suppose the contrib should not crash all the website because of that.

I would really like to help solve this, but I need more information to do so.

You are right @rlhawk

I installed and created a profile and a key (I did it several weeks ago).

Then I deleted the key and the profile but can't delete this module.

What else do you need?