The place is holy; God is there. Later it is said that God speaks face to face with Moses (Numbers 12:8). The relationship between God and Moses is confidential, but at the same time Moses has to keep distance; he has to fear the Lord (see Exodus 3:2).
5 Then he said, “Do not come near; take your sandals off your feet, for the place on which you are standing is holy ground.”