I think if you kill them quick enough they can't spawn, but the trick there is killing them quickly.
People believe what they either want to be true or what they are afraid is true! Wizard's first rule
Passion rules reason Wizard's third rule
Mind what people Do, not what they say, for actions betray a lie. Wizard's fifth rule
Willfully turning aside from the truth is treason to one's self Wizard's tenth rule
They are - the nest is the quest objective - the deal seems to be you have to kill them to get the nest to become useable. If you move too far from the nest when fighting them the entire thing (wasps and nest) despawns.
Otherwise I'd just be avoiding the things entirely!