Bees not filling cells and wintering (Northeast US)

If it isn’t full of bees or honey, you can just take it off. Store it in a cool dark place over winter. If you only have one brood box, your bees are probably going to be short of food over winter. I would assess the amount of honey in the frames and consider feeding syrup now and candy or dry sugar later in the season. Next season I would build them up to 2 brood boxes before you add the Flow super.