So yeah I'm thinking of using clever alchemist with 4 armor pieces and 1 weapon on my second bar, if I use the potion on my second bar and swap to my first bar (losing the 5 piece bonus) will the 600 spell damage bonus remain for the 15 seconds or does it go away?