This has been my go-to for all of my local LLM interaction: it easy to get going, manages all of the models easily. Nice clean API for projects. Updated regularly; works across Windows, Mac, Linux. It's a wrapper around LlamaCpp, but it's a damned good one.
Same here, however minimal. I've also installed openwebui so the instance has a local web interface, and then use tailscale to access my at home LAN when put and about on the cellphone. (Goes16 weather data, ollama, a speed cam setup, and esphome temp sensors around the home / property).
It's been pretty flawless, and honestly pretty darn useful here and there. The big guns go faster and do more, but I'd prefer not having every interaction logged etc.
6core 8th gen i7 I think, with a 1050ti. Old stuff. And it's quick enough on the smaller 7/8b models for sure.
It does if the copy is "more than transitory". Software in RAM is a full copy and remains there as long as the program runs, so that can be an unlicensed copy per MAI v Peak (but if you had a license to the original, there's an explicit legal carveout for RAM copies). It would depend on how far the data is buffered and how long it is cached.
Yes, our bet with Instant is that browsers have become so powerful, that we can run many computations locally, and don't need to wait for the server all the time.
Valve's efforts on playing Microsoft only games started ~10 years ago with Proton (which is more like an umbrella project for ~15 software components like Wine and DXVK). Today, proton is surprisingly good. Their bet paid off, and allowed them to make SteamDeck. Most if not all new games play fine out of the box, with 0 tinkering. Older games sometimes have issues.
Actually -otomy isn't even -otomy... it's -tomy. For example Craniotomy. Cranio-tomy.
cranio = κρανίο (skull)
tomy = τομή (cut)
And -tomy is just a cut, not cut a hole. To cut a hole you'd have to remove a part. Most of the cuts are straight lines and then the skin just opens up like a hole because of stretching.
Then, -ostomy is -stomy. Nephrostomy. Nephro-stomy.
Nephro = Νεφρό (Kidney)
Stomy = Στόμιο (something that has the shape of a mouth)
Finding equivalent idioms in different languages is one of the most fun things to do with LLMs.
One of the tricky parts, if you plan to actually use the idioms, is that they very greatly between different regions that use the same language. Particularly tricky with Spanish, considering so many countries on so many different continents use it. I haven't found LLMs to be good at knowing what regions use any given expression.
But we use a country name in the sentence: "That seems Spanish to me" (Das kommt mir spanisch vor) although that would 'translate' to "That seems fishy to me"
Greek physician from a family of Greek physicians confirms this. :)
Let me just add, that in the Western Medicine many words from anatomy come from Latin and many words from physiology/pathology come from Greek. Of course the Greeks themselves have their own words for anatomy as well.
I didn’t realise so many of these medical terms were Greek rather than Latin. Interesting!
Are these terms still used as-is in modern Greek? Much like how translating names of French dishes removes some of the air of sophistication, I feel like being told one is to receive a ‘skull cut’ sounds somewhat more scary than the (to an English speaker) academic-sounding ‘craniotomy’.
Amusingly, the word anatomy (“dissection”) is from Greek via Latin, from the very same root that we’re discussing here.
Other English terms from the Greek root for “cut”: tomography (imaging through a lot of cross-sections); entomology (study of in-sects, critters with sect-ions in their bodies); dichotomy (division into two possibilities); atom (that which cannot be divided).
“Up” or “thoroughly”, apparently? Same prefix as in analysis, anaphora, anamorphism. Ancient Greek had a sprawling system of prefixes that one can’t really pick up by osmosis, it seems.
(Complaints about noun morphology sound a bit hypocritical from a native speaker of Russian, I know, but it is what it is.)
reply