Admin only

Based on what you are describing, you are looking for the field permissions → module. With that you can set field level permissions to edit or view.
Otherwise, you can achieve the same with a form alter hook and an entity view alter hook.

Oh, great idea. Thanks!