Harvest early to prevent this from happening, even if you don't eat them, you can give to others or better preserve it, most fruits are seasonal and we may need them when they are out of season.