I believe Ken is talking about the trackage in Hudson Place on the north side of the terminal.
And if you go one block north on River St. to Newark St. The east end of the street leading to the ferry slips was converted into a small park. When being worked on they dug up the trolley rail and cobble stones. They then put everything back in place, "Historic Preservation", looks great put a closer look by a trained railbuff will reveal that the trolley rail was laid backwards, railhead is in and flangeway is out.
The area does look nice. I think this was the original terminal location for the line to Passaic and Paterson.