Why do baby mammals drink milk before they can eat anything else?

A newborn puppy, kitten or human baby cannot eat a proper meal. No steak, no salad, not even a mashed banana at first. For weeks or months one single food is all it gets, and somehow that is enough to build a whole fast-growing body: milk. Why is milk the one food every baby mammal starts life on?