A wedge is listed as one of the 6 "simple machines". So, they used them and they are effective. Levers and wedges, and good rope set-up.
You can also pull a stone a short distance, by placing a limb between two anchored parallel ropes and start twisting. Just don't let it slip.