With caching enabled, templates are not found

/admin/config/development/settings -> Do not cache markup enabled, the custom templates work as expected.
/admin/config/development/settings -> Do not cache markup disabled, the custom templates are not used.

clearing the cache under /admin/config/development/performance OR drush cr does not restore the templates.
Only /admin/config/development/settings -> Do not cache markup enabled seems to work.