To be fair, joseph had no clue what he was doing and the pillar men were nothing like the later antagonists