"Hell On Church Street" was recorded in November 2020 at Blackbird Studio in Nashville, during a time of great uncertainty, and was intended both as its own work of art and as a gift to Rice, who passed away at Christmas. The Punch Brothers said of Tony Rice and "Church Street Blues," "No record (or musician) has had a greater influence on us, and we felt compelled to cover the album in its entirety, aiming to interact with it in the same spirit of respect-driven adventure that Tony brought to each of the pre-existing songs."

"Hell On Church Street" follows 2018's critically acclaimed and Grammy-winning album "All Ashore," which featured nine of the band's contained original songs written by the band. The Boston Globe said of "All Ashore," "The Punch Brothers have created a deeply meaningful and downright magnificent album that takes the world as it is, but doesn't use that not use it as an excuse to give up."

AllMusic rating: