Hacker Newsnew | past | comments | ask | show | jobs | submit | patall's commentslogin

Maybe a naive question: given that they see better performance with more passes but the effect hits a limit after a few passes, would performance increase if they used different models per pass, i.e leanstral, kimi, qwen and leanstral again instead of 4x leanstral?

This is called a "LLM alloy", you can even do it in agentic, where you simply swap the model on each llm invocation.

It does actually significantly boost performance. There was an article on here about it recently, I'll see if I can find it.

Edit: https://news.ycombinator.com/item?id=44630724

They found the more different the models were (the less overlap in correctly solved problems), the more it boosted the score.


That sounds quite interesting. Makes me wonder if sooner or later they will have to train multiple independent models that cover those different niches. But maybe we will see that sooner or later. Thanks for the link.

One would think that LoRAs being so successful in StableDiffusion, that more people would be focused on constructing framework based LoRas; but the economics of all this probably preclude trying to go niche in any direction and just keep building the do-all models.

The SD ecosystem in large part was grassroots and focused on nsfw. I think current LLM companies would have a hard time getting that to happen due to their safety stuff.

Fine-tuning does exist on the major model providers, and presumably already uses LoRA. (Not sure though.)

We saw last year that it's remarkably easy to bypass safety filters by fine-tuning GPT, even when the fine-tuning seems innocuous. e.g. the paper about security research finetuning (getting the model to add vulnerabilities) producing misaligned outputs in other areas. It seems like it flipped some kind of global evil neuron. (Maybe they can freeze that one during finetuning? haha)

Found it: Emergent Misalignment

https://news.ycombinator.com/item?id=43176553

https://news.ycombinator.com/item?id=44554865


Mixture of Mixtures of Experts ;)

Probably just didn't really buy the house. Many houses are part of an association (BRF). When you buy one, you practically only buy the right to live in the house plus a share of the entire association. The fee that she paid was towards that association for things like maintainance, managment, trash-fees, internet, parking, likely heating and water, and possibly interest on the associations loan. It's just a different structure that many countries have for flats in a building, in this case applied to single family houses.

Here in Australia, I’ve seen what we call “strata title” applied to “single family homes” before (American terminology, we’d say “detached houses”) - it is uncommon, much more common with apartment buildings or townhouses/villas/semidetached (you share walls and maybe the roof with your neighbours, but there is no one above or below you)-but not completely unheard of

Would be cool if it could also de-knit to modify clothing or reuse later. I.e if there is a hole: automatically deknit, splice in a replacement and fix it. Or if your belly growth: deknit and make that section slightly wider.

And can you use finer yarn as well, like lace? The reason a sweater is knit like it is, is because of the tradeoff between knitting time and material needed. But if labor becomes free, you should be able to knit much bigger yet more delicate stuff.

Edit: ah, deknitting is called frogging


I never understand those calculations. You can buy houses in Berlin from around 350k. Maybe not in that area you are looking but still. With something like 600 to 800 sqm ground, house around 100 sqm, quiet neighborhood, 10 min walking to S-Bahn (i.e my grandmothers neighbors house that was sold a few month ago). Probably add 100k for renovation. But with 3.5k of savings a month (from 6.5k easily possible), you have paid it of in ~10 years.

Close to S-Bahn but then more than 1h commute?

I understand that everything and everyone in Berlin is a 1hr commute.

Are you being serious or saracstic?

Is what Berliners always say, isnt it?

IDK, I don't live in Berlin, that's why I asked.

Ideally, you have 300% renewable energy available and then modulate actual production based on demand.

Renewable is cheap, but not that cheap.

Also, solar production and heating needs are anticyclical.

Also, the European grid is big (the biggest!), but not so big it can deal with seasons and weather patterns. Yet. Or ever.

The idea was that gas would fill in the gaps, until energy storage at scale becomes a thing (no, it is still nowhere near scale, only gas reserves can fill that role right now). Germany is investing heavily in hydrogen to fill this gap, but barring fundamental breakthroughs, I think it's a pipe dream. A 90% (roughly) total efficiency loss means 1000% oveprovisioning of generation capacity. That's expensive, even when cheap.


That does not seem to be a long term problem. Wind and solar can be down regulated with ease (and within fractions of a second), a negative prices only happen because producers got a flat-fee per kWh which is pretty much phase-out now. The problem is rather that Germany (plus Luxembourg) is still a single price zone, i.e when wind is blowing in Hamburg, the per-kWh price in Passau is also nill. While this is nice for Bavaria (the main culprit, as usual), there is an enormous cost for this in the form of re-dispatch fees as long as the grid is not strengthened a lot.

The main culprit as usual? They have been financing the whole gaga show for years.

What gaga show? Bavarian industry is being subsidized via cheap electricity from the north, who in turn is paying higher prices than they would otherwise.

Bavaria has been subsidizing the north for decades and yet you think you can betitle us? This is not just about electricity. We are talking about billions of EUR in transfers. The money is flowing one direction only. So called “solidarity” is a hard ask given this arrogance.

The money is flowing in one direction only now, but what the "Stammtisch" likes to forget is that Bavaria has benefited from transfers until as recently as 1992, and from 1950 to 1986 (36 years!) the money also flowed in only one direction - but the opposite one, from other states to Bavaria. (https://de.wikipedia.org/wiki/L%C3%A4nderfinanzausgleich#Fin...)

You are accusing me of belittling "you", after you wrote "gaga show".

That's ironic. And no, money is not flowing in one direction only. As I already wrote, Bavarian industry is effectively massively subsidized by the north investing massively in renewable energy production and overpaying for their own energy because demand is driven by the south (who is fighting tooth and nails against building their own wind turbines for ideological reasons).

Greetings from Hessen (another Geberland, just like Bavarian, but without the Bavarian exceptionalism, which most of Germany just sees as arrogance)!


Dont listen to Söder, he ate too many sausages which makes him spout nonsense constantly.

Söder merely repeated what Bavarians have been thinking and saying since when he still hadn't left Franken.

I realise my post was unnecessary inflammatory and I'm sorry for that. Enough Internet for today.


I do not think that is really the case. What actually happens is that smaller phones are often worse, i.e less battery life, worse processor, worse camera. Because there is less space in the device (and manufacturers think that people will buy a slightly thicker phone) and the screen doesn't use that much energy, the battery has to be smaller impacting performance. And users do not accept that. So unless someone discovers that you can make a full feature, big battery phone by increasing depth and weight of the small device, it wont happen / be popular. But once one company makes one, other will probably follow. Which again reduces revenue per producer...


EU regulation on that should come into force in Feb 2027.


You sure? I only heard of laws about repairability, not swappable batteries. You can already replace the battery of any phone, the only question is if it'll take you 1 minute (Fairphone) or several hours (every other vendor I'm aware of). The legislation might make it take maybe 1 hour instead of 2, and requires (iirc) that you can obtain legit replacement parts for a few years, but that's about it


Seeing how Motorola is trying to bypass the regulation for software updates, I don't have any hopes. https://www.androidauthority.com/motorola-eu-software-update...


That regulation doesn't apply to mobile devices at this point afaik.


I have no idea how one would crash an ETF but I do wonder if someone could manipulate an index. I.e by somehow suggesting a larger fraction of free floating stock so that the index weights the stock higher than its actual share. That should create increased demand for that particular stock (fund companies buy it more) and thus raise its value over what the market would assign normally.


> Who is gonna chip in tens of billions of dollars to fund "that, but European, and 15 years from now"?

Dieter Schwarz might. At least he has the money and is trying 'something' with stackit. But he probably won't see the result in 15 years.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: