Backstage before the show, Jimmy, Mariah Carey, and The Roots grabbed some instruments you’d find in an elementary school classroom and stopped by the Late Night “Music Room” to sing Mariah’s holiday classic, “All I Want For Christmas Is You.”

Pretty freakin’ cool. Enjoy.