I think the muddying consists of the fact that conflating physical traits with cultural identity means that any criticism of the given culture can be and is frequently labeled as racism.