During the vocab create process there is a checkbox toggle "Create new revision". This by default is off. If I leave it to off and create the vocab I expect to not see revision fields on taxonomy term, however, I do.
Create a vocab
Leave revisions off
Create a new term for vocab
Confirm revision fields are present
Make it so revision fields are not present on the {term}/add form or make it a form display that I can remove.
Remove revision field from {term}/add
They key word here is "by default". The only thing this setting does is whether or not the new revision checkbox is enabled by default.
I agree that there are use case to not see them, but that would be a new feature, there might be issues for that, or you can do a bit of form alter.