Maintenance for the week of January 5:
• PC/Mac: No maintenance – January 5
• NA megaservers for maintenance – January 7, 4:00AM EST (9:00 UTC) - 10:00AM EST (15:00 UTC)
• EU megaservers for maintenance – January 7, 4:00AM EST (9:00 UTC) - 10:00AM EST (15:00 UTC)
Basically, justice system does not "refresh" your status and considers you a Werewolf, even if you are in human form with no bounty. Even if you un-slot WW ulti it will still keep happening.
The only way to fix that is to change zone or re-log (logoff & login back).