Has anyone tried to rewrite some popular open source project with IA? I imagine modern LLMs can be very effective at license-washing/plagiarizing dependencies, it could be an interesting new benchmark too
Not me personally, but a GitHub user wrote a replacement for Go's regexp library that was "up to 3-3000x+ faster than stdlib": https://github.com/coregx/coregex ... at first I was impressed, so started testing it and reporting bugs, but as soon as I ran my own benchmarks, it all fell apart (https://github.com/coregx/coregex/issues/29). After some mostly-bot updates, that issue was closed. But someone else opened a very similar one recently (https://github.com/coregx/coregex/issues/79) -- same deal, "actually, it's slower than the stdlib in my tests". Basically AI slop with poor tests, poor benchmarks, and way oversold. How he's positioning these projects is the problematic bit, I reckon, not the use of AI.
Same user did a similar thing by creating an AWK interpreter written in Go using LLMs: https://github.com/kolkov/uawk -- as the creator of (I think?) the only AWK interpreter written in Go (https://github.com/benhoyt/goawk), I was curious. It turns out that if there's only one item in the training data (GoAWK), AI likes to copy and paste freely from the original. But again, it's poorly tested and poorly benchmarked.
I just don't see how one can get quality like this, without being realistic about code review, testing, and benchmarking.
Gaaaah, words. Yes thank you ! Coz in another thread I was mentioning both.
The above post -which I can no longer edit- compares The Black Parade / TBP (a mod for Thief I / The Dark Project / TDP) to The Dark Mod (TDM, a mod for the doom3 engine). Phew :D
As for the original question of comparing TBP to TDP: I’m personally not fond of Thief I and prefer Thief II, as it focuses on what works: stealth! Thief I is wildly creative, but also full of muddy combat with unconvincing monsters & zombies, and annoying maps / missions. So, to me, TBP (which is pleasingly weird and avoids TDP gameplay pitfalls) kinda beats its parent game TDP at its own game.
There might be a plugin based on freeverb, which is also a good sounding one. I ohave it as a logue unit, so can't recommend one immediately. At least I know greybox based on actual device comparison, as he owns one and has been doing this for 5 years sans AI.
Given that Big Tech is training AI on copyrighted material downloaded from shadow library torrents it's safe to assume that they don't care about licenses at all.
Plus the US government is pro Big Tech and they will protect them at all cost.
it strikes me as a dangerous time to try going to court over this as politics are currently aligned to fight back with new laws overriding court interpretations, at least in the US. God knows what's happening in China; afaik, it's a free-for-all outside requirements to avoid "sensitive topics". Between US and China, you have nearly all of the "top 100" LLMs.
Indeed. I never understood, let alone bought into, the NFT hype, but I think VR is a good reference point for AI:
There was a real, genuine product in the Oculus Rift. It did something that was an incremental improvement over the previous state of the art which enabled new consumer experiences for low cost.
The Metaverse was laughable, and VR got glued to a lot of things where it added zero value, or worse negative value, for example my attempts to watch pre-recorded 3D video gave me nausea because the camera can only rotate, not displace, with my head movements.
Compare and contrast with AI:
LLMs and Diffusion models are also real, genuine products, that are incremental improvement over the previous state of the art which enabled new consumer experiences for low cost.
A lot of the attempts to integrate these AI have been laughable, and have added zero-to-negative value.
I didn't mean it as VR being useless - I'm sure it can be useful for some applications or fun for gaming - my point was that you shouldn't fear getting left behind just for not having an Apple Vision Pro app or a land in the Metaverse :)
Another way to see this: Hammers can be useful, the Internet can be useful, but this doesn't mean that as a hammer manufacturer you should make your next hammer an IoT product ASAP or you will be left behind.
Just wanted to note that even after the bad publicity that companies like Meta (ugly avatars, unusable bland virtual spaces) or Apple (overpriced device with no software or content) have given to VR, some people tend to regard it as dead even though there is quite a vibrant user and creator community doing some incredible things (even just what people do with VRChat is amazing!). And there are even companies that seem to get it (Valve).
reply