The IMF is multilateral and it's owned by all the 190 plus countries associated to it. Irrespective of the headquarters been located in Washington, D.C., USA. that doesn't mean it's a a U.S. organization.
One reasons why people don't like the IMF is because of the strict conditions they attach to the, it later don't favor the country that was giving the support. But you cant blame the IMF, they don't force these countries to be debtors, the country go into debt willingly. The IMF step into the scene for the sake of the global economy but they can be controversial because of their social and political impact.
The IMF is not a US organization, but they are the largest financial contributors to the organization, so it is no surprise that the organization is headquartered in the United States or is heavily influenced by that country.
But I agree with you that we should not blame the IMF because they do not force any country to borrow money from them and become a debtor. All those countries come and borrow voluntarily, and there is nothing wrong with those countries needing to comply with the rules and conditions set by the IMF.
Just like when we lend someone money, even if it is just a small amount, we place requirements on the borrower to ensure that they can repay us. Why are we criticizing what the IMF is doing when they are also doing what a lending institution is supposed to do?