The band was formed in New Hope, PA by Freeman and his high school friend Mickey Melchiondo– a.k.a. Dean Ween– and went on to self-release several cassettes before signing to Twin/Tone Records and releasing their first album, GodWeenSatan: The Oneness in 1989. The band would eventually sign to Elektra Records and achieve some commercial success with their single "Push th' Little Daisies" from 1992's Pure Guava. Over the course of their 25+ year career, the band released 11 studio albums, 6 live records, and a slew of EPs and singles.
Freeman released his solo debut, Marvelous Clouds, last year. The album featured Freeman covering songs by poet and songwriter Rod McKuen.