If you find its like 12v or less, this could be the problem. Over 12.1v and the bike usually tries to crank, but 12 or less and you may get nothing at all....and the lower the voltage the more likely you'll get nothing from the starter at all.
The start buttons do get dirty too. They are pretty easy to clean. When you take the switch assembly off the perch, and remove the screws on teh back to gain access to the switches, there will be a small circlip for the start button switch. Remove it carefully and dont lose teh small spring inside. You should be able to clean the contacts with rubbing alcohol and a q-tip. I've seen them get totally caked with grime and prevent contact. It's a 10 minute thing to check if that's the culprit.