Formed in the winter of 2003 at Carleton College, the band has released four albums. First came the self-released Tapes 'n Tapes EP in 2004, followed by the full-length release, The Loon, on Ibid Records in 2005. The band signed to XL Recordings and re-released The Loon on July 25, 2006. In October 2007 the band announced finishing recording of their second album, titled Walk It Off. Walk It Off was recorded by producer David Fridmann in his Tarbox Road Studio in Cassadaga, New York. The album was released April 8, 2008. The band's most recent album, Outside, was released on January 11, 2011.