I'm just not diggin' any "thousands of feet high" story. Masonry and mud by itself ain't gonna support itself laterally for very high without crushing. Then they have to engineer for sway from wind,etc.

There probably was a Tower of Babel, but it's gotten better every time it was retold.