I couldn't agree more with TheDirector217 regarding Lucious Jackson. Fever In, Fever Out is a big favorite of mine as well. Luscious Jackson in November 1996 was the very first show I ever saw at the 9:30 Club. Saw them a couple times, and they always put on a good, fun show.
Put me down for Elastica and first-album Veruca Salt, too.
And, as long as we're getting nostalgic for '90s female-fronted bands, I'd like to nominate Belly. Star is one of my all-time favorite albums, and King wasn't bad either. Tanya Donnelly has put out a bunch of solo albums, but none of them rock like Belly.