I've had 3 caves in act three only where the goal was to kill enemies in the area.

Not enough enemies in the cave to clear quest.

Triple checked walk through caves. All corners, hallways, and dead ends.

Each failed cave had a chest or buff shrine where I had to clear the monsters before looting/buff.