Examples, FSU coming to South Bend in November/December is a disadvantage for FSU, but ND going down to FSU in November/December wouldn't be a disadvantage for ND.
Switch that to ND going to FSU in August and that's going to be a disadvantage for ND, but it won't bother FSU coming to South Bend in August.
No team from anywhere is going to be hindered by the temperature of going to SoCal for a December/January bowl game.