Yep, part of it in both dimensions, length and depth, because having left over more was considered unbearable. Even leaving that small part was an uphill battle.
Here the fact that the border system consisted of nine different sections and the actual wall was just one part of it (the final one in westward direction and the first eastwards) is obscured.