Can this module add an icon in the prefix of block title?

Yes, but not automatically. You would need to have a field where the user could add the icon information like a font awesome css class. Then you would need to apply that into the block either via a php plugin class or by using a twig template https://www.drupal.org/docs/8/modules/block-style-plugins/twig-templates → .