According to current estimates, there are almost that many illegals in the country. Less, actually, but around that many. And many are seasonal/temporary workers who go back when the work is scarce or out of season, which is why a wall would be likely to keep them in.
I have never seen anyone say that many come in per year. Not sure what sources you use here, but you may well be reading them very wrong.