I am quite honestly surprised that they didn't implement a stupid simple system which makes any scroll that is outside of a keep/temple have a "no player currently touch" reset timer, which puts it back into the last keep/whatever it was stored in...I mean it would be so simple to implement and yet it would stop problems like this...and to clear up what I mean if you don't understand me.
Scroll in keep/whatever > no timer
Scroll being carried by a player > no timer
Scroll not in keep/being player carried > timer ticks
Timer hits 0 > Scroll teleports back to keep/whatever it was stored at last.