In the first episode of season 2, Chris O'Dowd suggests turning the Morpho machine off and on again. This is a reference to his catchphrase in the British sitcom, The IT Crowd.
The book on which the show is based contains numerous references to the music of John Prine. The title is just one of those references.
Puffins are a theme that come up repeatedly between Chris O'Dowd and Gabrielle Dennis's characters throughout the series. Chris O'Dowd served as the narrator on the Netflix series "Puffin Rock" a children's show about the adventures of Oona the puffin and her little brother.
Chris 'O Dowd and wife Dawn Porter did a sketch for comic relief in England to John Prine's 'In Spite of Ourselves' which contains the lyrics, 'against all odds, honey we're the big door prize: