Why avoid? Maybe it's part of the experience. Lets you appreciate a good company even more.

(That said my first employer was a bit.. twisted. Small, workaholic family, hands on. Lots of pressure. Probably drove some into depression or burn out. Learnt a ton though, and maybe made me a bit more thick-skinned)