Moving (switching) terms into OG vocabularies

I'm not having any luck moving terms from one vocabulary into an OG vocab. Not sure what the barrier is, my terms have the same fields in both vocabs and i don't see any other reason for a constraint. Perhaps the content needs to be already assigned to the OG. I'll give that a shot and report back.