One problem, as Ambers notes:
Romney’s problem is similar to Obama’s: he doesn’t play well with downscale voters. He comes off as the manager who fired them, or who cut their wages—the "Richie Rich" know-it-all. Obama’s demerits with these voters are different, but a general election race between the two would leave a large number of those voters up for grabs.
The Dish 