I find this mystifying. I have numerous memories from being a toddler. Among friends' children, some have more fully-formed personalities than others. My favorite one has an excellent memory (like she remembers where things are in our house even though she only visits every 2 or 3 months) and also highly developed preferences on clothing (colors, acceptable combinations of what to wear etc.).
