Yes, you can definitely just feed them food and not go crazy on the cows milk. I did so much research and talking to health professionals when my LO wouldn't take cows milk. Most information I came across actually recommended getting calcium from food rather than milk as they are getting other nutrition at the same time so it is actually more beneficial than a drink of milk. Some LOs who drink loads of milk are filling themselves up when they should be eating more food, a couple of my friends had this issue. Calcium does not have to be from milk - it is the calcium which is important not the cows milk (unless you are a calf!)
Also, my boy did start drinking milk at around 16 months and now as a pre schooler he loves it! The way he started drinking it was when I gave him a straw to suck up the milk from his cereal. So random but for some reason he loved it then gradually started to drink milk. So try not to stress about it. I know it seems strange when everyone else's LOS are taking loads of bottles but they really don't need it as long as they are getting calcium elsewhere.