Ideally you’re absolutely correct but conferences (including Smart’s) won’t have any of that.
What would be closest to fairness is a16 team playoff (if ND always has to play 4 postseason games for NC everyone should)…that simply takes the top 16 teams after strength of schedule is factored in (however decided and agreed).