Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
tape_measure
1 day ago
|
parent
|
context
|
favorite
| on:
GPT-5 leaked system prompt?
WORDS IN CAPS are different tokens than lowercase, so maybe the lowercase tokens tie into more trained parts of the manifold.
maxbond
1 day ago
[–]
That's a super interesting hypothesis. From an information theory perspective, rarer tokens are more informative. Maybe this results in the caps lock tokens being weighted higher by the attention mechanism.
reply
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: