Ibrahim Traore cited Lt Col Damiba’s inability to deal with an Islamist insurgency as the reason.
He also announced that borders were closed indefinitely and all political activities were suspended.
Lt Col Damiba’s junta overthrew an elected government in January, citing a failure to halt Islamist attacks.
But his administration has also not been able to quell the jihadist violence. On Monday, 11 soldiers were killed when they were escorting a convoy of civilian vehicles in the north of the country.
Earlier on Friday, Lt Col Damiba urged the population to remain calm after heavy gunfire was heard in parts of the capital.
Who is Lt-Col Damiba?
“Faced with the deteriorating situation, we tried several times to get Damiba to refocus the transition on the security question,” said the statement signed by Traore.
A curfew from 21:00 to 05:00 was also announced.
Lt Col Damiba’s whereabouts are not known.
The United States said it was “deeply concerned” by events in Burkina Faso and encouraged its citizens to limit movements in the country.
The Economic Community of West African States (ECOWAS) condemned the move, stating it “reaffirms its unreserved opposition to any taking or maintaining of the power by unconstitutional means”.
Before dawn, shots and explosions were heard in the capital, Ouagadougou, some of them coming from near the presidential palace and main military barracks.
After sunrise, the normally bustling city was largely deserted, with soldiers on the streets blocking some roads and guarding key strategic points.
State television had stopped broadcasting and more gunfire was heard later in the day.
Lt Col Damiba said there was a “confused situation” created by “mood swings” among some soldiers as rumours of a coup intensified.
In January, Lt Col Damiba ousted President Roch Kaboré, saying that he had failed to deal with growing militant Islamist violence.
“We have more than what it takes to win this war,” the junta chief said when he was sworn in as president in February.
But many citizens do not feel any safer and there have been protests in different parts of the country this week.
On Friday afternoon, some protesters took to the capital’s streets calling for the removal of Lt Col Damiba.
The Islamist insurgency broke out in Burkina Faso in 2015, leaving thousands dead and forcing an estimated two million people from their homes.