Agree with another poster Shoprite in Jersey City is on the light rail line. If you get yourself one of those fold up carts, easy shopping via light rail.
If you have a car, I personally drive to Bayonne as the Stop and Shop is next to a Costco and a Walmart so everything is right there. It's about a 10-15min drive.

Welcome to the area!