Barr, who did not provide a reason as to why Berman was being replaced, said that Jay Clayton, the current chairman of the Securities and Exchange Commission (SEC) would be nominated for the position. Craig Carpenito, currently the United States Attorney for the District of New Jersey, will fill Berman's role in an acting capacity effective July 3.
The replacement is likely to spark further claims from Democrats in Washington that the president is seeking to politicize the Justice Department and remove figures who are either critical of him or investigating people in his orbit.
Berman's office has prosecuted several Trump associates, including Cohen, who was imprisoned for campaign finance violations and lying to Congress. Berman recused himself from directly overseeing Cohen's case for reasons that were never made clear.
Federal prosecutors in Berman's office are also reportedly investigating if Giuliani, who is known to have a number of associates abroad, failed to register with the government as a foreign agent.
Beyond Cohen and Giuliani, Berman's office also subpoenaed Trump's inaugural committee over an investigation into potential illegal contributions from foreigners and charged former Rep. Chris Collins (R-N.Y.), a Trump ally, with insider trading.
Berman was appointed to his role in January 2018 to replace former U.S. Attorney Preet Bharara, who was ousted for defying Trump's request for him to purge the office of Obama appointees.