Using Replace in an entity browser does not replace the file.

I have a Media field using an entity browser, and have enabled Replace field on the Media entity. When I edit an existing file on a node, replacing the file works fine. However, if I enable and use the Replace button in the form settings for the field, and then upload a new file with the same name, it increments the resulting file name. Only by using Edit and going to the media entity edit page can I replace the file properly. For now, we'll just disable the Replace button, but having it there implies that this should work.