A solution could be maybe to put a limit on CP. Every 6 months that limit goes up, but you also give a minimum of CP to all players.
Example:
Season 1: limit 250 CP
Season 2: limit 500 CP. New base CP for everyone: 125
Seasin 3: limit 750 CP. New base CP for everyone: 375.
Season 4: limit 1000 CP. New base CP for everyone : 625.
This way you keep a nice difference between those who work for their CP and those who doesn't. But at the same time you give them a minimum amount to be able to have some balance. And those who really have top CP will still be ahead from those who doesn't,but won't be totally unfair.
Baradur Morker - Level 50 Bosmer Nightblade Le-Duck - Level 50 Dark Elf Dragonknight Boom-Stormer - Level 50 High Elf Sorcerer Nemeliom the Great - Level 50 Redguard Warden Crazy Little Maggie - Level 50 High Elf Templar