In this case Xarxes IS the One Who Watches. We know he wrote the Oghma Infinium, which explicitly only contains what he learned from Mora but that's as far as their connection goes. As Scribe of the Divines and a servant of Auri-el, he uses his own observation to record the lineages of the Altmer.