Given you max out at level 4 you get at most 5 skillups (IIRC) on your weapon so this is hardly a serious problem, annoying as it may be. Also, the Atronarchs drop weapons a lot and I've often got a second sword or a dagger to get some dual-wield goodness before leaving the place.