As it turns out, Armisen took a trip to Washington DC this past spring to record that song for a 7-inch, as well as a b-side called "Kick It Down and Kick It Around." He recently told Paper Mag that the latter track was inspired by Black Flag's "Gimme Gimme Gimme." Despite the all-star cast of the sketch, he plays all instruments on both tracks, which were recorded by Brendan Canty of Fugazi.
You can currently purchase the Fist Fight! 7-inch from Drag City, or if you aren't familiar with the Saturday Night Live sketch that spawned the recording, you can view that here.
Though Armisen is best known these days for both Saturday Night Live and his sketch show Portlandia with Sleater-Kinney's Carrie Brownstein , he was a member of Trenchmouth and also drummed on Les Savy Fav's Let's Stay Friends.