Mr Emdin-Umeh said that getting a planning permit before starting construction was mandatory in Lagos.
Speaking with journalists, Mr Olumide said the state government was enforcing zero tolerance to illegal developments.
Oyingbo building collapse claimed the life of an 80-year-old woman and displaced seven families on Thursday.
“My mandate is to remove anything that is dilapidated, that is harmful to the people that even owns it,” he said.
On Sunday, traders in the market alleged that the Lagos government did not give any prior notice before commencing the demolition.
The Lagos government says it has apprehended two site supervisors and another person for breaching its physical planning permit law.
Residents of the building had already evacuated the building when they noticed the signs two hours before the collapse.
Aside from defaulting on his approval, the developer was said to have used inferior materials in the construction.
According to the general manager, the defective buildings have been marked for removal in a bid to end the era of building collapses.