Wow, talk about an old thread getting dusted off. I started this 4-1/2 years ago. And let's see, my beard has cycled, on and off, four times since then. I am finally past the issue of whether people notice or not.
I've found what works for me, let my hair get very long (for me), then buzz it...