I think it's OK if your drum has stuff on it (glitter, milk, lighter fluid) so when you hit it, it looks cool. But the only reason the stick should leave your hands is if you whip it into the crowd or it breaks. This is not marching band, folks! It's rock & roll.
For those old heads, this is similar to my disdain for "changing your sweaty shirt" during the encore break.