Yup, there are a few different ways if you so please.
On the old layout I used cinders mixed with small dark grey ballast and some real dirt. For the real dirt, go dig up some in the yard, clean it out removing rocks and then let it set in a sealed coolwhip container, about a week to two later go to the dollar store and get a flat cookie sheet, spread the dirt on the cookie sheet and bake it in the oven for about 30 minutes (til it stinks "best to do in summer months so the better half won't ride your case :D ). Then I take it out and let it cool, then put it into containers to store for a few more weeks.
Finally, I sift it and add it to the mix of yard ground cover.
Sorry to say I don't have a picture of what the yard looked like, but it was very realistic! I got the idea from a friend who is now passed, but it works well, for a minimul effort.
Some use just mainline ballast, others use various cinders, some just straight dirt. One of the railyards I worked out of for a few years was nothing but a mud pit when it rained, since the yard hadn't had ballast dumped in decades.
If you do use the real dirt method, take the time to dry the dirt and sift it well. Nothing like having real life insects roaming the pike!