Hi Busso,
I have tasted turpentine honey and “Yes”, it is not very nice. There is a bitter after-taste and a chemical flavour to it. I would not recommend putting your super on till after it has finished flowering. I have a couple of hives in turpentine country in western Sydney and am being very careful not to harvest, have marked the frames and will leave them to the bees.