I don't think "suspect" but dependent upon the type of loofa you have, I may think metrosexual, OCD behavior, or what type of skin disorder do you have?
("Loofa" makes me think of the big, yellow sponges that came out in the 70s - with talk of Old Spice - now I'm thinking of Soap-On-A-Rope!)
It's hard to find other options and I think most people know that stores seem to only offer the bright pink, squishy things on a rope.
Either way, you handled it fine. (The less you say, the better.
(I do vote cleanliness and color are a factor...Wait until you try body scrubs!)