Music website You Ain't No Picasso has rounded up fifty plus different covers as performed by the non–Canadian, Athens, GA based Of Montreal. Included are both live and studio recordings, featuring songs by Led Zeppelin, Creation, Prince, David Bowie, Sugarhill Gang, Buzzcocks, The Misfits, Gnarls Barkley and more.

You can find a link to that page here.