I think that if you had significantly more aggressive scaling of the bonuses as you added additional pieces then the current low starting values would be okay.
But the bonuses at the highest levels would have to be BIG because there's a ton of opportunity cost to using a single 12-piece set when compared to more traditional set divisions.