Yeah, as the others have said, that is not great for your plant.
Freezing can damage cells and that with the water sitting inside the flower as it melts is a match made in heaven for budrot.
Normally I'd try to wait for it to be ripe and rather lose a bit than harvest early, but this is one of the few times I'd rather chop asap.