The recently rumored voice calling option is already live on all of my Gmail accounts, not sure if everyone else is seeing it, or if users with existing Google Voice accounts got it added automatically. At any rate, voice calling works fairly well. Though in my tests people on the other end complained of frequent static even though I could hear them just fine.
All my out going calls showed up as coming from my Google Voice number, so I’m making the assumption that you’ll need to have a Google Voice account for this to work.