I am lvl 16 and have health 4/stamina 10 or something close to that. I am a duel wielding nord of ebonheart alliance. Should i just keep pumping all stats into stamina?
Yes, for the most part. If you need some in health to feel comfortable while leveling thats fine, but the more in stam the better for doing DPS. It will also help to keep your armor and weapons close to your current level.
It entirely depends on how your survivability is. If you can stay alive well enough as is, keep pumping your stamina. If not, you may want to put some points into health (or at least get something that will allow you to stay alive). At level 16 however, I wouldn't worry about it too much, as right now your build is likely a lot different from what it will be nearer endgame, and by that time you'll be respeccing a bit. Just put points where you feel they should go (as long as you don't spend many - or any, really - in magicka, considering your build), for now.
You may put all attributes on any character into their fighting resource. There’s not really a lot of reason to try to adjust those as you level. In most cases, end game characters keep them all in their fighting resource. Sometimes tanks use some health.
But an attribute point is basically 115 of that resource. A piece of vet gear offers your choice of ~900 of any resource. So you can fine tune your resources via gear a lot easier than playing with attributes.