Agreed. If you haven't been taste testing before/at bottling time, just keep in mind, warm, flat, non-conditioned beer doesn't taste like the final result.
That said, you will notice any really bad off tastes pre-bottling.
Of course some of that clears up. Example, I just thiefed some from my Belgian single. It smells like satan's chamber pot. Man the sulphur that WLP500 is putting out. The sample tasted off too, probably from the extra H2S being produced.
Sulphur will fade though. Just by this morning the aroma has dropped to what I would describe as noticable, but not overpowering levels of sulphur. I'd half bet it'll have completely dissipated in another week or two.
An IPA and a Steambeer both had an odd strong fruit taste to them, possibly Aceldelhyde (but didn't quite taste like it from absolutely everything I have read up on it). With the Steambeer that "off", but not entirely unpleasant flavor dimished to not being able to be noticed after about 3 1/2wks. My IPA seems to be on target for the same (though it is only 2 1/2wks post bottling at this point).