We grew up in north Jersey but I left 36 years ago and really havent spent significant time in NYC since. My Dad commuted into Manhattan every day, worked for the old AT&T and was one of the original occupants (ie AT&T) of the WTC. Back in the '70's it was a somewhat dangerous place to be, but I understand it has improved.
We are staying just east of Grand Central Terminal....