I had a sudden realization.

The Doctor can speak baby without the TARDIS translating and the TARDIS can’t translate baby. You know what other language the TARDIS won’t translate? Gallifreyan. Because it’s already in Gallifreyan. What if babies speak Gallifreyan?