The Ensemble of Memories of that Time Past