This plugin, along with proper WooCommerce settings, will display empty categories on the main shop page and category archives. Additional insructions and extension tutorials Github Project