A sweeping analysis of European and Asian genomes over the last 40,000 years reveals when and how some genetic exchange occurred between Homo sapiens and our closest cousins, Homo neanderthalensis. It also shows how the Neanderthals’ genetic footprint depended on later exchanges between members of our own species.