Couple buckets of gravel ought to do the trick for a simple temp fix - if you do oyster shell, get it precrushed a little - think it's easier on the feet and tires.
If it's bothering your tires then it's time to get new tires. You can take the sharp edge by running it through a concrete mixer for an hour or two.