Addition: I can get some of them to stay on Adventurer eventually, but some will not switch off master, even after a relog. It doesn't seem to be correlated to whether that character is subclassed.
A friend on discord says that changing the difficulty 1 level at a time, then doing something else for awhile, then change it again seems to work. It is working for me..