Well originally I was only gong to do the zest, but decided what the hell and threw it all in there. I ate a piece of the pith to see how bitter it was and found it to have very little flavor at all. (Can't say the same about oranges though). In the future though, I'll put fruit in the secondary, not the primary. The lemons caused some of the krausen to cling to them and not break up and fermentation stalled for a bit, but I got it going again.
I snuck a taste the other day and I have to say it was pretty nice. A kinda sharp, sour taste (which to be fair is what I was after - ever have lemon ice as a kid?) but with some malt to balance it out. Very subtle hop taste, you have to look for it. I think when it's cold & carbed it'll make a nice lawnmower beer. Maybe next time some Amarillo hops might be in order.
The only disappointment I had about it, was that the honey flavor was not apparent. That really surprises me since I used a pint in a 3 gal. batch(!).