Show all terms in exposed filters when using pager

I have a table view with exposed filters and the results spread over several pages. On the first page my exposed filters only list the terms that are attached to nodes that are actually listed on the first page. Is there a way to create a view where my filters show all options on all pages? (I can only think of hackish solutions like loading a fake node with all possible terms attached and hiding it in the theme...)