Hacker News new | past | comments | ask | show | jobs | submit login

> At first pass it gave some weird answer.

The default sampling parameters are really not that hot for cases where there is nearly a unique correct answer-- bad luck will force to to ask wrong.

From that prompt I (a human) don't know if I should expect something like "Albert Einstein" or the straight answer, so higher temperature sampling can risk kicking it down a silly path.




I put the same prompt into the question-answering preset and it immediately answered

A: Justin Bieber.

So that suggests that the prompt and temperature (etc.) are relevant to getting the kind of behavior you want. But it didn't seem to have any trouble getting this right the first time with the appropriate preset.


Does it still work if you fuzz some of the facts? Eg teenager instead of 13, skip Canadian, etc?


> Q: This person is a singer, songwriter, and actor discovered as a teenager by talent manager Scooter Braun. Who is this person?

> A: Justin Bieber is a singer, songwriter, and actor discovered as a teenager by talent manager Scooter Braun.

or

> Q: What famous singer was discovered as a teenager by talent manager Scooter Braun?

> A: Justin Bieber was discovered as a teenager by talent manager Scooter Braun.

It's really good when in the factual question answering mode.

> Q: What famous singer was discovered as a teenager by talent manager Scooter Braun?

> A: Justin Bieber was discovered as a teenager by talent manager Scooter Braun.

> Q: What country is he from?

> A: He is from Canada.

> Q: Who's the prime minister of that country?

> A: Justin Trudeau is the prime minister of Canada.

> Q: Who was his father?

> A: Pierre Trudeau was his father.

> Q: Why was Pierre Trudeau famous?

> A: Pierre Trudeau was famous because he was the prime minister of Canada.

> Q: When did he take office?

> A: He took office in 1968.

> Q: What was the year before that?

> A: The year before that was 1967.

> Q: What was the summer of that year known as?

> A: The summer of that year was known as the "Summer of Love".


Whoa! Thanks for checking that out! Seems like a new contender for jeopardy lol




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: