On the module page it's stated we can create collections of config entities but it seems we actually can't?! Is this a buf?
I tried with Drupal 10.3.1 and collection 3.0.0
Active
3.0
Documentation