Submit handler gets trumped by competing handlers on the submit button

I've got a field on the user which also uses an inline entity form, prior to the simple pass form alter firing the inline entity form alter puts submit handlers onto $form['actions']['submit']['#submit'] which means that the submit handler which simple pass adds to $form['#submit'] doesn't fire.