As an American English speaker, I have never come across context where a handful means about five. Handful has meant a relatively small amount, with the actual quantity always depending on the context of the item being discussed.
The parent says "about five" because you have to choose to say "a handful" over "a few" or "several" or "a dozen or so" or just "many." Five is the sweet spot where none of those other terms apply.