view page 404 error when language prefix in path

I feel this issue has to been solved already but just can't find it. Lots of flavours of i18n and paths issues posted but not quite mine is discussed:

I have a page view with path set to site/foo/%/% where % are arguments for the foo view.

When I select a different language with the language switcher whilst in the view page, the path changes to site/es/foo/%/% (when selecting Spanish) and then a "Page Not Found" (404) page appears.

I only want the said path to give the same view page as when the site default language is set (with no prefix).

Can this be done without playing with aliases or path modules?

Thank you