Where is the best place to buy just a few fairing bolts and the rubber things that go on the other side? On eBay the sellers are selling entire kits.
Fasteners and fixings shop if you've got one close. Handy for all kinds of things. Alternatively refine your web search using m5 well nuts/ rawlnuts. You're as well buying a pack of 10 or 20 in stainless as they get used eventualily. When you put them on if you dab a bit of red silicone grease on the thread they're more likely to continue to undo without seizing and spinning the nut in the rubber housing. The red grease won't degrade the rubber.
I use a place in Huddersfield called Danlet, particularly after I was ripped off by a dealer once for two bolts for £20 plus p&p. I could have bought them from Danlet for 78p!!!