While we are speculating and dreaming, here is some more foam, involving 2 semi-obscure branches connections.
Suppose Conrail dropped off cars for DRRR, Raritan Central, and any other operators in the mid NJ area at Stiles St Yard, using the NEC to get there from Oak Island (sort of the equal of CR using the NEC now to get to Metuchen, but much shorter distance on the NEC, and maybe staying on the same track and not having to foul all the Amtrak tracks twice, perhaps currently crossing all the way over and then back again, although I really don't know how they do it.)
Then, there is a "back door" from Stiles St Yard to the Chemical coast (heading compass south, timetable west) on the Chemical Coast (is the Chemical Coast officially called Garden State Secondary?) So DRRR, Raritan Central, etc, could perhaps pick up and drop off their cars there at Stiles St yard using this back door to the Chemical Coast.
Second, there is an unused (not sure if officially OOS) connection from the Chemical Coast just north of Perth Amboy over a short stretch of the old LV Perth Amboy branch (the original LV freight main in NJ) into an active rail-served business park, connected to what at one time was called Heller Biz park or similar. The larger complex of tracks has a modern name I can't recall. I think Raritan Central serves it. From there you can get to the Metuchen branch and Metuchen yard, etc, w/o going on Amtrak. (I think that is how cars get to RC now, coming the other way on that branch. So that takes care of ME-2, Raritan Central etc.
Regarding DRRR, if (and a big if) they had rights to get from Browns Yard over the Raritan River Bridge to the Chemical Coast (which would involve 2-3 miles over NJT, probably requiring PTC, admittedly), then they can get to/from Stiles St yard for interchange with CR as well.
So these freight short lines could interchange w/ CR at Stiles St Yard on the NEC, w/o going on the Amtrak NEC or NJT (except for DRRR on the Raritan River bridge). They would need rights on the Chemical Coast, etc, which is CR.
OK, I'll put on my flak jacket and you can start shooting me down
JS