There's a simpler solution: it's where you're riding.
Yes, a little bit of brake dust, but mostly road grime. Cars don't get it as much because they're not riding towards the center of the lane. Most of that grime is kicked up from the "grease strip" in the road.

Perfectly normal.