Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
mzs
on May 25, 2023
|
parent
|
context
|
favorite
| on:
4-Bit Quantization and QLoRA
I wonder if some sort of logarithmic with pedestal encoding could be used, that way you could have better precision around where you expect most of your values to be yet have a large range as well. Bonus, multiplies are just adds.
toxik
on May 25, 2023
[–]
And adds are super imprecise :-)
Consider applying for YC's Spring batch! Applications are open till Feb 11.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: