ZOS PLEASE FIX THIS.
I have seen this happen twice now. If you die to a non pvp death while interacting with a scroll you will return to your shrine with the scroll. This happened once in the water where slaughter fish kill the player interacting with the scroll and it has happened again where the player interacting with the scroll died to what I believe was NPC at the temple. I am less sure of the second occurrence but I am certain it has to do with being dead and interacting with the scroll.
Please investigate this and hotfix it.