This seems to have been an issue with my video card. I noticed the temp was high when doing nothing (79c) so I changed to a single display instead of dual and the temp dropped to around 50c in a few minutes. I haven't had this issue since-not even when playing games. Gtx 570 by the way. Maybe it's on it's way out.