It's important to keep your tummy tight not just when exercising but all day.
Draw your belly button towards your spine. Keep your abdominals in but still breath!
Here's another exercise to add to your core routine
The Bridge -
Lie on the ground on your back with knees bent and feet on the ground.
Squeeze a rolled up towel between your knees.
Lift your hips upwards until your torso is a straight plank, pause
Squeeze your glutes on the way up
Maintain a firm hold of the towel by squeezing your knees tightly together
Activate your core to maintain the inverted plank, slowly lower and repeat 10 times
Do core exercises on non consective days - 3 to 4 times per week. Include ab and back exercises each time.