I suggest you look at the bottom of the forum main page to see who is on, and when. Evenings (EST) nearly every night you'll find around 10 or more people on voice chat, throughout the weekends and late evenings for the Aussies.
If you come in and see no one there, then leave - of course you'll assume no one is in their consistently, but it just isn't so. Using your thinking, no one ever would be and I talk to about half a dozen members a day, every day in Ventrilo. I hope you try more often.