Well yes, but whatever milk/water you serve in it right afterwards will still taste and smell of burnt plastic. I take it as something inevitable because no one's going to be giving a glass milk bottle to an infant.
Maybe I should dump every single child plastic drink/dinnerware for 18/10 stainless steel.