Wouldn't it be hard to keep up to the people who are constantly dueling it out in some corner of Cyrodiil? Is there even enough action in some of the smaller campaigns to keep up to a regular dueler?
The first step is forbid the 3 alliances guilds, second, forbid the whisp between alliances and finally make the RvR more interesting with real objectives like PvP ranks, PvP rank armors/weapons and special rewards for killing players and attacking/defending keeps and resources.
Generally the people dueling care less about the leader boards as they have gotten what they want out of pvp and are just buying time till the next big thing. With the current fps issue, no one really wants to be in the huge siege battle anyways.