Maintenance for the week of December 22:
• NA megaservers for maintenance – December 22, 4:00AM EST (9:00 UTC) - 8:00AM EST (13:00 UTC)
• EU megaservers for maintenance – December 22, 4:00AM EST (9:00 UTC) - 8:00AM EST (13:00 UTC)
Basically, justice system does not "refresh" your status and considers you a Werewolf, even if you are in human form with no bounty. Even if you un-slot WW ulti it will still keep happening.
The only way to fix that is to change zone or re-log (logoff & login back).