Anonymous user cannot upload private file

Anonymous users are not able to upload files when the upload destination is set to "private files". This problem does not occur with the basic Drupal core file field, only when file_entity is enabled.

I ran into this problem when creating a job application form where anonymous users should submit their CV. After choosing a file, the file is automatically uploaded and gets a file id. Immediately the file field's ReferenceAccess constraint (\Drupal\Core\Entity\Plugin\Validation\Constraint\ReferenceAccessConstraint) kicks in and throws a validation error: You do not have access to the referenced entity (file: 1). The user is not able to submit the form.

Proposed solution: I'm not sure if this is doable, but ideally the ReferenceAccessConstraint would check if the file entity was created by the anonymous user (session) who is creating the reference, and allow the reference to be created.