Yeah I would discuss with your mw before swimming again. Walking with bub is always a good way of getting exercise in in those first few weeks and then slowly building up from there as you feel up to it.
Also get your mw to check your abs post partum as they can seperate and you need to take care with what exercises you do until they come back together.
All the best! We must be due aboput the same time