On: Show HN: AI Voice Toy I worked on is in stores, media code on GitHub

[qazxcvbnmlp]

What's the round trip latency on this? ask question -> response. Do you parse the question word by word and feed into llm or wait for the whole question before feeling into llm?