Layout builder block title shows when field is empty

Problem/Motivation

I configured a view field formatter in layout builder, and can see the title when the field is empty.

The hide empty views option is enabled. I also tried using a block view display and checking the hide if empty option.