This is very common the first few weeks of starting out.

If the soreness is extremely painful, then just do your light cardio/stretching instead of your workout until the soreness goes away, or do your workouts focusing on body parts that are not sore!

Massage, Epsom salt baths, and ice baths have been shown to help reduce muscle soreness and speed recovery, so you can get back into the groove as soon as possible!