Butch tells Capt. Webb he found Caesar on a roof on 10th Avenue, which is on the west side of Manhattan. However from shots from the roof, the Manhattan Bridge is visible, which spans the East River from Lower Manhattan to Brooklyn. The bridge is too close for the rooftop to be on 10th Avenue.
When Butch goes to Norma's apartment, the music comes on the radio as soon as he touches it - and even before the "click" of the power/volume knob is heard. Radios of the time used vacuum tubes that needed to warm up for a few seconds before sound would come on.