The phyto-estrogens in soy are mostly in the oil, all cheap vegetable oil is 60%+ soya oil. Almost all dressings, mayo, snacks, fast foods etc are cooked in or made with soy oil.
Soy bean oil has been shown to have as much estrogen in it as 5 birth control pills comparatively, I wish I had the journal article on hand.
Soy protein isolates aren't bad at all; it had no effect on Rhesus monkeys who were fed nothing but soy protein.
If you want to avoid environmental hormone induced cancers cut soy from your diet; except soy protein isolate.