Kids (well, some of them) have rhythm at a very young age.
For example, here's Aidan - age 12 months - bum dancing at a wedding to rhythm of provided by Mary Beth using two plastic cups on a banquet table. Hey, make music with whatever you've got.
So, get out two wooden spoons (or anything unbreakable). Hand one to your kid and use the other one yourself. Two metal spoons each to whack together also sound great. So do pan lids for that matter, and they have handy little handles. Here are Karen and Steve - in Grandpa Roly's favorite photo from 1983 - having a good old time.