Abdi Mohamed who has a girlfriend and a son, is now in a critical condition in hospital after two officers hit him in the chest and stomach on Saturday evening.
Mohamed, of Salt Lake City in Utah, was arguing with a man while holding a broomstick when he was allegedly fired on by police after being given "one chance" to drop his "weapon".
Protesters took to the streets and an investigation into police conduct launched.
Jackie Biskupski, the city's mayor, said in a statement she had had a "serious conversation" with police chief Mike Brown on whether attempts at de-escalating the situation had been made by officers before they decided to shoot Mr Mohamed.
"While the shooting is still under investigation, there is no doubt what happened is a tragedy for all involved, and for our entire city," she said.
Mohammed moved to the States from Kenya 10 years ago, according to the New York Daily News.
An investigation into the conduct of the two policemen who shot Mr Mohamed are now under way, with footage from cameras on the officers' chests being used. Independent UK reported.
They are both on leave as the investigation by the Unified Police Department is carried out. Their findings will be turned over to the District Attorney's office.
Police shot more than 1,000 people in the US in 2015. Black people were twice as likely to be shot by police than white people in any given incident, according to The Guardian.
RELATED: 19-yr-old student is 24th ‘unarmed black man’ shot dead by US police in 2015 – Washington Post