There was, of course, nothing downtown about Harold Brown, unless the Bronx High School of Science and Columbia University count. Brown picked up three degrees from Columbia, including a Ph.D. in physics at age 21. Later on, he served as Secretary of the Air Force and president of the California Institute of Technology before taking…