Nah, son you always wanted to say it and are looking for an excuse. White people have "asserted themselves" for centuries and waved nigger around like a stick to keep black people down. Now that you aren't holding the stick, you get antsy and worried that you might not be able to stay in control.
I think you're partially right, but also are erring a bit on the side of condescension.
It's like this: distinct parts of West/North Europe culture has long been obsessed with complete lack of censorship and free speech. See: Charlie Hebdo, tons of Comedians, South Park, the 1st Amendment.
That definitely comes from a place of power and privilege, no doubt. However, it's not solely for the purpose of keeping people down, though it has done so and people will try to use it for that purpose as well.
The African American community has long had to censor themselves, and it all relates to the system of power and oppression. The idea that white people would then have issue with this, I can see why you would jump to the conclusion that you have.
But you need to understand that the use of any/all words and concepts is something that a lot of people take very dear to heart. It's not fear of losing the ability to oppress, but rather losing what they view as freedom of expression. Yes, that is certainly a loss of power that they are fearing, but not a loss of power to oppress.
The type of people I'm talking about probably/maybe have a token black friend or two, and probably go out of their way to smile and be nice to black people, to show them how NOT racist they are, but in the end makes them still racist, but at least they're trying and their heart is in the right place. You know what I'm talking about.
First time I've put this concept into words, so I'll include a picture of what I'm talking about because it's what I've viewed in my head the whole time I've been writing this. The actual numbers are meaningless, as I don't know enough to attribute scores, but the concept is what I'm trying to get across.