Who is we?

If you mean white people, arguably the Asians have been far more dominant in empire building.

And "worse" is a matter of perspective.