You love exploration, and a bit of roleplay. As do I.
Those addons will kill immersion.
My advice is: Explore and quest an entire zone without those addons.
When you finish the whole zone, you can activate those addons, and find your missing books and skyshards that way.