What music did Chuck Berry and Little Richard (an odd choice) grow up on? Probably gospel. And what did gospel originate from, white religious church music. Does rock & roll sound like African music? Is there ONE African music, one "black" music? Music is a language that develops as culture changes and it pulls from everyone and everything.
Yes, 1950s/60s whites made WAY more money and got WAY more credit than blacks. I would have felt the same as Quincy Jones at the time. We see it today with the irritation with Caitlan Clark in basketball.
But this is the same across all cultures. It isn't about black or white, it's about majority/minority.
People either want to listen to your music, or they don't. People either want to watch you play basketball or they don't.
In junior high school (1973-1976) I was in the steel drum band. It was run by a black woman. She made me question the Beatles. Would they be remembered in 20 years (she thought not). I loved her. She made me question everything. She never argued they were bad. Just question.
People who are really into music (or basketball) know the score. There is none. You either like it or you don't. It's a personal thing. Judgements of a social kind are for those who don't really love it. QJ was just economically and reputationally bitter. Again, don't blame him! And we can't take an interview he did one day as representing him. As you point out, he worked with everyone, black or white or double white ;)