Chester Arthur made it grandiose to host kings. Teddy Roosevelt made it plainer (but added a dining room full of his trophy kills). Coolidge added the West Wing (which was later torn down and replaced). Truman gutted the entire thing in a manner which would drive Democrats insane if Trump were to do it (the pictures are amazing), but a Democrat did it, so it was probably ok. Kennedy made it more posh from T.Roosevelt/Truman's choices, but still often understated. Trump bringing it back towards Chester Arthur's vision to host world leaders.
(The video starts with all the predecessors to the current White House...basically any house in which the president lived. Then it moves on to the final White House, rambling through various renovations, additions, tear downs, etc. It was posted a year ago, so it doesn't address the current changes, but it certainly helps to put them into context.)