You need to control a City Wall to build the City Gate.
Trader and Diplomats can still enter your city.