Josh Barro spells it out:
Conservatives so often get unfairly pounded on race because, so often, conservatives get fairly pounded on race. And this is the Right’s own fault, because conservatives are not serious about draining the swamp. … My challenge to conservatives who feel they get a bum rap on race is this. Stand up for yourself and your colleagues when you feel that a criticism is unfair. At the same time, criticize other conservatives who say racist things, cynically tolerate racism in the Republican base, or deny the mere existence of racial issues in America today. The conservative movement desperately needs self-policing on racial issues, if it ever hopes to have credibility on them.