I think the point Rhett is missing is that while punk may have only directly influenced a few people, most of those people were musicians and artists. As a result, the influence on music that has come since , including mainstream rock, has been enormous.
Of course, if that doesn't matter to you, then no, punk doesn't matter. It's not like it changed the course of world history, but it changed the course of music -- and presumably if you're on this board, that matters to you?
And I will say that contemporary "punk" doesn't matter at all. At this point it's just repackaged nostalgia.