The lowest metallicity stars that still exist today probably carry the imprint of very few supernova. As such, they represent our best observational approach to understand the First Stars. In this talk I will review the early (chemical) evolution of the Milky Way system from both modeling and observational perspectives. In particular, I will present results of the Pristine survey, a Franco-Canadian photometric survey of the Milky Way halo designed to efficiently decompose the metallicity structures of the Milky Way halo. I will show how we can use this great discriminatory power to hunt for the very rare extremely metal-poor stars (bearers of the chemical imprint of the first stars), to weed out contaminants around metal-poor dwarf galaxies, and to search for stellar structures in the halo.