Much of our understanding of cellular information processing, especially at the level of genes, has relied on assumptions of thermodynamic equilibrium. However, there is now increasing experimental evidence that gene regulation may be operating away from equilibrium. I will discuss some of the surprising consequences of both regimes and the challenges that confront us in developing a conceptual landscape for non-equilibrium information processing.