I can definitely attest to the social effects; there's a lot that doesn't come through in a text-only medium and knowing the source personally means less guessing. Although too much camaraderie on a Q&A site is not always a good thing (see Programmers.SE)... not that I'm suggesting it'd come to that here.
Like hobodave, I'd like to see more than 2 or 3 people even for an informal meetup; don't take that personally, but this ain't my first rodeo and speaking from the experience of several dozen meetups on other forums, they can get awkward without a crowd unless the people are extremely well-acquainted (which is hard to do on this type of site).
That said, if we can pull together at least 4 or 5, I'd certainly be interested.