It is 100% a performance issue, not a bug.
Similar to how you now need to endure load screens whenever you move too much in zones, this is nothing more than a performance issue. If ZOS ever solves the terrible performance, this'll solve itself immediately.
This weapon swap problem existed since Thieves Guild. Dark Brotherhood simply compounded the issue.
Makes me sad cause ZOS won't fix it