Hide fieldsets if filters don't exist

Problem/Motivation

Can the fieldset be hidden when its child-exposed filters are non-existent? While using BEF, there's a checkbox per exposed filter to "hide the filter if no options are present", which works for hiding empty exposed filters. However, the parent fieldset group remains visible even when the filters are gone. Anyway to hide the fieldset as well? Would it be more appropriate to make this issue a feature request?