Batch sandbox not preserved between batch iterations

Problem/Motivation

I try to pass information between batch iterations but $context['sandbox'] is always empty.

Steps to reproduce

Create batch class
Add a key value to $context['sandbox']
debug the context array