Hide Edit button if the entity reference field is empty

I am allowing users to use entityconnect to create new nodes. I am using entity reference to reference nodes and views to limit the reference to the user's own authored nodes. If a user has yet to create a node, the entity reference field is empty, however the entityconnect module still shows an edit button. Then clicking on the edit button results in a "page not found". It would be great to only show an edit button if there is something available in the entity reference field.

I think this would be a welcomed feature/fix to this module. Thoughts?