I think they did that in castles, because it’s generally pretty hard to build castles. If the enemy is inside the walls you are practically done anyway.