Per Widget Level Access

Problem/Motivation

I have multiple voting widgets on an entity, and want different roles to be able to use different collections of them. This is for a contest that will have official judges who will rate the content in multiple categories, but also allow other users to pick favorites. The non-judges should not be allowed to vote in the judge-designated categories, and the judges should not be able to use the general user widget(s). (I'm still gathering requirements; they may not be able to see how the judges are voting until the contest is over ever.)

Steps to reproduce

Add multiple widgets to an entity type. The permissions page only shows a single permission for voting on that entity type rather than widget_id on the entity type.

Proposed resolution

If this is doable within the current system, please advise on how to access this feature.
If it's not currently possible, this is a feature I'd like to see added certainly, but advice on how to tackle this with custom code would be welcomed.