programming languages shouldn't have such primitives, because they're not primitive. Otherwise, people programming different stuff all the time, would need other primitives, and you'd have unmaintainable languages full of bugs.
the reason this works is the same as why HN is a good news source (with its limitations). No sponsored likes, just as people pay to submit obituaries. High range of topics, even if HN is narrower. So, it tells more about your usual search engine than about obituaries. For instance, that's why I prefer duckduckgo to google.
related advice: go to your local library and look at books in fields you don't know anything about. Find the most unusual book cover and title (compared to the others in the same section). That's usually something you want to read.
there's an additional difficulty. Who told the man to build a road? This is the main stuff that LLMs or any other technology currently seem to lack, the "why", a reason to do stuff a certain way and not another.
Yes, but it's more than that. As I've written before, LLMs (and all AI) lack intentionality. They do not possess concepts. They only possess, at best, conventional physical elements of signs whose meaning, and in fact identity as signs, are entirely subjective and observer relative, belonging only to the human user who interprets these signs. It's a bit like a book: the streaks of pigmentation on cellulose have no intrinsic meaning apart from being streaks of pigmentation on cellulose. They possess none of the conceptual content we associate with books. All of the meaning comes from the reader who must first treat these marks on paper as signs, and then interpret these signs accordingly. That's what the meaning of "reading" entails: the interpretation of symbols, which is to say, the assignment of meanings to symbols.
Formal languages are the same, and all physical machines typically contain are some kind of physical state that can be changed in ways established by convention that align with interpretation. LLMs, from a computational perspective, are just a particular application. They do not introduce a new phenomenon into the world.
So in that sense, of course LLMs cannot build theories strictly speaking, but they can perhaps rearrange symbols in a manner consistent with their training that might aid human users.
To make it more explicit: can LLMs/AI be powerful practically? Sure. But practicality is not identity. And even if an LLM can produce desired effects, the aim of theory in its strictest sense is understanding on the part of the person practicing it. Even if LLMs could understand and practice theory, unless they were used to aid us in our understanding of the world, who cares? I want to understand reality!
I get your point and I agree to a certain extent. However, it's arguable that everyone shares the same aim, that is, to understand reality. Some want to go down a road, no matter how it got built, or, some think, or better don't think, no matter where it leads. In that world, an artificial entity that can 1) create an aim and 2) build enough understanding to execute and 3) execute could be valuable. Right now we're at the 3) in the specific context of byte arrays. Now, an artificial system that could also understand, i.e. possess some kind of structure of concepts, and from there also produce the "need" to create something, that would be a huge leap forward. Forward toward what? I don't know.
Interesting story which I didn't know. However, the author perspective is a bit flawed:
But the world did get more peaceful. There was no World War III, and countries at least had to pay lip service to these universal values of peace and human rights.
The world didn't really get more peaceful. Some nations which used to wage wars between themselves did not anymore after World War II (excluding "incidents" like Belgrade bombing). This doesn't diminish the rest of the article at all, if anything calls for more rules and diplomacy preventing war.
global nuclear annihilation did more to prevent WW3 than a Convention that most militaries do their best to tiptoe around (or just ignore where they can)
Europe used to be at constant war with each other. Only France and the UK has some nukes. Now the EU is one of the most peaceful and prosperous places in the world. That is built on rules and trade.
that is incorrect. Europe has had armed conflict since the second world war. Maybe not well advertised, but they happened nonetheless. I share your perspective though, that rules and trade should be continued in order to be even better.
