Burkina Faso, Mali, Guinea and Sudan have also been suspended since the coups in those countries.
Africa has experienced seven coups since August 2020, before the one on Wednesday in Gabon. Others are Niger, Sudan, Burkina Faso, Mali, Guinea, and Chad.
The ministry said maintaining normal diplomatic ties with the West African country would become more difficult.
The ministry said that it was “constantly assessing the security and operating conditions of our embassy.”
UN secretary general Antonio Guterres has condemned the ongoing coup attempt as a means to resolve the post-electoral crisis in Gabon.
The accord allows Mali and Burkina Faso to provide military assistance to Niger in case of attack against the putschists.
The police in Burkina Faso killed 40 Islamist fighters, the army said.
A specific date for an intervention was not released.
The coup has plunged the region into a political crisis.
Mr Svenja announced during a visit to West Africa, calling for the immediate release of ousted President Bazoum Mohamed.
