The biggest drawback to eliminating the Electoral College is that it would destroy the Union.
The good news is that Chris94 is right that it will never happen. The only reason the Dems are talking about it is because they know that eliminating the EC would allow all future elections to be determined by urban populations. Elections would swing in winning the urban vote, and candidates would ignore flyover country.