Crosses the Line Twice:Their very early barely-even-released album "Baby Sex" features a (fake) picture of a woman fellating a baby on the cover, which considered artistically rude at the time, would now legally qualify as child pornography. Also, the titular song is a story of a daughter on father rimjob. The album's more or less disowned by the band, though this probably had more to do with them not being satisfied with the music than being offensive.
Fan Dumb: Yes, they have this, especially when it comes to the lead singer's true identity.
Growing the Beard:Their early unofficial releases are more or less disowned by the band themselves and range somewhere between "awful noise" and "good" with even hardcore fans. They've gotten SIGNIFICANTLY better.
They Panned It, Now They Suck: Wormwood. The "They Panned It" bit was subverted; The album dealt in the more disturbing tales of the Good Book, but was not meant as an insult. The "Now They Suck" bit was exaggerated; The tour was... chaotic, to say the least, courtesy of many a pissed-off crowd member. It Got Worse when the tour started playing in Europe.
It's Popular, Now It Sucks: In the early years, this was the band's opinion on themselves. They weren't all that happy when Duck Stab attracted a fandom.