Hey fellow accordion busker! I find my busking income has diminished vastly with age, despite my skill rising. Everyone wants to toss a coin at the 10 year old playing decent accordion. Not so much the 30 year old playing good accordion.
Not to say that this is your issue, but I find it helps if I dress up a lot.
I have nice, embroidered pearl snaps, custom cowboy boots, fancy hats, and a couple nice vests.
That is to say, it's pretty easy for folks to confuse me with panhandlers. I have no problem with folks panhandling, but my tips are way better if I look like a performer.