On-premise LLMs are also getting better and likely won’t stop; as costs go up with the technical improvements, I would imagine cost saving methods to also improve
There are just so many compelling reasons to be on-prem instead of dependent on a 3rd party hoovering up all your data and prompts and selling you overpriced tokens (which eventually they MUST be, because these companies have to make a profit at some point).
If the only counterbalance is "well the api is cheaper than buying my own hardware"...
That's a short term problem. Hardware costs are going to drop over time, and capabilities are going to continue improving. It's already pretty insane how good of a model I can run on two old RTX-3090s locally.
Is it as good as modern claude? No. Is it as good as claude was 18 months ago? Yes.
Give it a decade to see companies really push into the "diminishing returns" of scaling and new models... combined with new hardware built with these workloads in mind... and I think on-prem is the pretty clear winner.
These big players don’t have as big of a moat as they like to advertise, but as long as VC wants to subsidize my agents, I’ll keep paying for the $20 plan until they inevitably cut it off
Considering the original title is just the name of the railway, and I do not think “within budget” is editorializing, I think the commenter is being overly pedantic
I opened the article expecting to see news about the budget and how they stayed within it, since that SEEMS like the biggest surprising news in a project like this. How is that overly pedantic?
I understand your expectation. That said, I think it's ok to add detail in commentary when the article doesn't mention it explicitly. So continuing to go upon the point that the article didn't mention the budget makes you seem as pedantic.
Claude has been aggressively advertising on Facebook, Instagram, and Reddit, and the ads have been much more general use than just the code benefits. They’re definitely no ChatGPT, but they’re not an unknown player.
You're only seeing those ads because the ad algorithm knows you. My family aren't getting Claude ads. They wouldn't know the first thing about it even if it were explained to them.
Such a kind British museum offering to maintain these artifacts to the point of denying return to the origin countries when requested. Clearly this is for the preservation of our past and the benefit of humanity.
Absent any proof that the objects were truly stolen, I don't feel any need to return something to someone in some country who suddenly finds an interest in getting something back. What does ownership mean to you?
Let's say you come to my country and buy a souvenir. Can I decide, hundreds of years later, that you must be forced to give it back?
And why do borders matter? The argument seems to be that housing an object on one side of an arbitrary political line is morally superior to putting it on display on the other side of some invisible line. Somehow someone born to the right parents is a morally superior curator compared to someone born into the wrong parents.
I used the phrase recently when my coworker asked me what metrics I use to guide my code decisions, and he gave me the options of sonarqube issues, test coverage (which I found to be configured to exclude huge feature directories of this legacy app), or efficiency metrics. All this after 6 major prod bugs were introduced over 6 months.
My response was that I code by vibe, and really I meant that I was improving the nightmare of working in our backend code while trying to learn the business logic, restructuring our backend code structure, hardening our unit tests, and adding swagger documentation. While doing so, I uncovered tons of bugs.
All in all, “vibe coding” to me is similar to “smelly code”, where the intuition depends on the implementor, but with the latter, “bad” coders can be silent and aren’t forced to make change smells. Good coders, however, prove their intuition skills when identifying and fixing code smells, even though today we have automated tools to tell us why our code smells feel or look bad
reply