How this module works.

Problem/Motivation

I just installed this module but I am lost even I red readme file already.

1.Create content type
2.Add Reference field (to Taxonomy for example)
3.Enable referenced entity permission
4.Grant access to View

and now what?

5.I went to user and added reference field to same taxonomy
6.Now user has reference to Album and also Node has reference to Album taxonomy
6.I expected that user can see that node. It can, however everyone can, even he has different album selected in taxonomy.

Can anyone provide any user case how to use this module correctly?