Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
Fine-tune and deploy open LLMs as containers using AIKit - Part 1
(
huggingface.co
)
19 points
by
sozercan
3 months ago
|
hide
|
past
|
favorite
|
1 comment
waldrews
3 months ago
[–]
Hooray for containerized models, but a game changing feature for such containers could be K-V/prefix caching.
Previous discussion:
https://news.ycombinator.com/item?id=40034972#40036309
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
Previous discussion: https://news.ycombinator.com/item?id=40034972#40036309