Yes, not only is it possible, it's friggin easy.
When I got to the Act 1 Boss, I had the following active skills
Winter's Grasp? (Aoe frost)
Bulwark of Dawn (Damage modifer taken)
Hunters Swarm (3 minions)
Feeders Swarm (3 minions)
Livor Mortis (Mostly plus health and increase threat)
At this point most of my points were in Toughness (Near 200pts, I had started building wisdom at this point, they're about even now), I had A LOT of HP buddy, but it didn't matter, the boss almost never hit me due to the golem holding aggro THE ENTIRE FIGHT. (Golem never died either.)
I put the golem on the boss and hit the active skill again (The golem will roar, I think it's an AOE aggro move, but I have no idea). Started moving around the boss and keeping my Bulwark up on him as much as I could, since it did most of my actual damage from me. Freezing whenever I needed it. When he's away from you, do some auto attacking to get the rage gone and repeat. It works for all 3 phases.
I also cleared the Act 2 boss with the same build, same minions and same strategy, though, if you haven't been there, you'll see why being smart is more important than your minions during that fight.
I also created a b-line between the starting passives and the "summoning tree" where I systematically picked them ALL up.