Personally, I always use a secondary. I've gone primary only in the past - but unlike Chad, I felt the beer was not cleaner. Though, I didn't think to use a filter on the syphon (nice trick!) which sounds like it works.
I remember reading somewhere that letting the beer sit on the yeast...