I have been using Google Voice with Skype for a little while now, but I have been having quality problems. There is a 1 to 2 second delay between the time a say something and the person on the other line hears it. I thought maybe it was the Linux, PulseAudio, Skype combination, but I have since found the same thing happens when I use my home phone or my cell phone.
I found that I am not the only one who has the problem:
As “Papa Bear” suggested, I sent feedback on my problem with this link. I am trying to raise awarness of the problem now, but I am not sure what else I can do other than quit using it for the time being. If anyone has any ideas for extra information, please let me know!