From what I have learned, there probably never were any cave-men as we envisage it, but surely the early migrants to Europe used ledges as shelter when needed.
However, in Medieval times people in the Dordogne and Verzere valleys did use caves as protection from the Vikings.
Well, the farmers and other peasants lived and worked in the river valleys, but the important people built towns in high ledges.
Here's my pics of one: