What an incredible comment, thanks kragen! Good sources for anyone wanting to right realistic alternative history stories. Although I can't help but think that most people, ancient or otherwise, would me most interested in applications. The foundations, like atomic theory, or chemistry, require...something else. Curiosity? A culture that lauds discovery and motivates scientists at least in part with vanity? Greed? A desire for more, to conquer ones enemies? Science is very good at making better weaponry and more indirectly, for reducing scarcity for all, making larger populations, and so larger armies.
Me, I'm more interested in building alternate futures than writing stories about alternate histories. It's just more difficult!
If you want to understand what cultural or political factors have prevented innovation, maybe a good place to start is the cultures that are currently failing at innovation. I mean, on an absolute scale, that's all of them, but some are failing harder than others: the PRC is failing harder than Taiwan, the US is failing harder than the PRC, Brazil is failing harder than the US, Nigeria is failing harder than Brazil, and Malawi is failing harder than Nigeria. Maybe an especially good place to start would be the stories of people who have succeeded at innovation despite finding themselves in the most unfavorable conditions, like William Kamkwamba's application of windmills in Malawi. He wrote a book about it: The Boy Who Harnessed the Wind.
Any STEM graduate school research program in the US or Europe is full of people who are advancing foundational knowledge, but moved there from cultures that are doing very poorly at advancing foundational knowledge. It might be worthwhile to talk to them.
Of course, the situation 100, 1000, or 10'000 years ago was not the same as the situation in Malawi today. On one hand, the people who invented fossil-fueled mass production, movable type, and gunpowder 1000 years ago in China didn't have to compete economically against cheaper and technically superior imports from the modern US, the way Malawians do today; on the other, they couldn't import knowledge and tools from the US, and they didn't know that the things they were attempting were even possible.
Regarding your [Taiwan, US, PRC, Brazil, Nigeria, Malawi] innovation ranking, I don't feel like I have a good sense of it, TBH. I'm not saying you're wrong, but I'd be curious to know on what basis you make the judgement. Is it just in reference to TSMC?
I guess I'm interested in the historical conditions because now it's commonly held that "innovation is good" but it was not always so! The ancient Egyptians had an incredible stable empire that lasted thousands of years, and yet they did not innovate. Other cultures like the Romans seemed to innovate, but then stopped. Same with the Chinese (or rather they innovated but did not apply innovations like gunpowder to, well, guns). The Roman motivation was modern, I guess, in that it got them more. Maybe they would have kept going if not for collapse? Then came the Dark Ages, and then the Enlightenment, in which all the good stuff started to happen! You had all these smart people asking great questions and doing experiments, talking to each other and advancing human knowledge, faster than ever before. Why did that happen? The innovation you're talking about is a difference in degree, not kind; the shift I'm talking about seems more like a phase change. Why did Descartes start caring about geometry after Euclid had, apparently, ended the subject? Why did Laviosier question the alchemist views on substances? Why did Newton and Leibniz spend so long dwelling in a strange and alien world of self-consistent imagination? (And all this in addition to the artists, philosophers, explorers, and inventors!)
No, TSMC is equally scarce in the US and PRC, and also equally absent from Brazil, Nigeria, and Malawi, so it's not just in reference to TSMC, though they are indeed one indicator.
The Romans seemed to innovate because they were conquering the Greeks and adopting their innovations. When they had no more Greeks to conquer, the innovations ended.
The Chinese did innovate by applying gunpowder to guns; that's why they've had guns since the 12th century, while the oldest European guns are from the 14th century, evidently copied from the Islamic world, who probably copied them from the Mongols, who probably copied them from the Chinese.
I think there's a pretty continuous stream of major innovations since the beginning of the Iron Age, though it's true that often one or another culture has become a backwater and stopped innovating, like Europe during the Dark Ages, or arguably Yuan China. I think the difference between currently existing cultures is more phase-change-like, in the sense that intellectually ambitious Brazilians and Nigerians tend to move to the US or Europe.
To take the particular example of Descartes' geometry, following Euclid you had Archimedes, Apollonios of Perga, Pappos, Zhang Heng, Liu Hui, Aryatabha, Bhaskara, Zu Chongzhi, Brahmagupta, al-Mahani, ibn Qurra, al-Khwarizmi, Shen Kuo, al-Haytham, Khayyam, Yang Hui, Pacioli, al-Tusi, Tartaglia, and Viète, among numerous others; Descartes could draw on all of their work, much of which had been translated into Latin, and other parts of which had influenced later writers whose work had been translated into Latin. Bombelli invented complex numbers a century before Descartes!
And we could make similar lists about chemistry or algebra.
The explanation to me seems straightforward: the Roman Empire conquered the civilized parts of Europe, the Middle East, and North Africa, and it was evidently not a hostile environment for innovation in general and geometry in particular. Consequently the only Roman name in my long list above is Pappos. The Roman yoke was then supplanted by the heavier yoke of the early Christian Church, which actively sought out and destroyed knowledge; to them we owe not only the Dark Ages but also the loss of the knowledge of Egyptian hieroglyphics, the burning of the Nestorian and Arian texts, the desecration of the Archimedes Palimpsest, centuries of persecution of the Jews, and the suppression of heliocentrism, as well as the burning of the Mayan codices and the khipu, losses whose magnitude will remain forever impossible to calculate.
Though the book-burning of the Christians evidently goes back to Paul, such anti-intellectual movements are not unique to Christianity: Qin Shi Huang, the Nazis, Pol Pot, the Boxers, Comstock, and Boko Haram provide counterexamples. The Christian atrocities are greater in magnitude only because the Christian Church ruled so much of the world for such a long time.
So why did the Dark Ages end so soon, given that the Roman Catholic Church still plays a strong and sometimes dominant role today, 1000 years later? Perhaps the creation of the Roman Catholic Church in the East-West Schism is one important cause (breaking in half the Church that had remained undivided since its genocide against the Nestorians and Arians), but it's an enormously debated question. Maybe Petrarch, the guy who first called the Dark Aages "dark", played a big role in ending them. Or maybe the tyrannical nature of Christian rule had weakened its victims until they could no longer suppress learning and innovation — nor resist conquest by more highly developed cultures, as in al-Andalus, the Seljuk Empire, and eventually even Constantinople itself. Or maybe the Crusades that followed increased contact between the Christian world, divided between decadent Byzantium and fanatical Europe, and the literate world. Or maybe it was the Medieval Warm Period. Or the Plague.
It's difficult to say in part because we know so little about the Dark Ages. What horrifying abomination enslaved the minds of Europe so terribly, despite the Greek legacy of great intellectual achievement? What were the contours of day-to-day life? How did people think about law, war, dispute resolution, rulers, legitimacy, slavery, heresy, workmanship, innovation, religion, and learning? We know that both cenobite monasteries and Jewish communities survived in Europe throughout this time as enclaves of learning, but the texts they wrote during the Dark Ages are mostly copies of earlier texts; they do not give us much insight into these questions. So what was the cause of this stagnation and backsliding? Historians disagree.
A different way to look at the question is that perhaps the stagnation and backsliding of the Dark Ages is not the part that calls for an explanation; perhaps progress and innovation is the exception and collapse, or at least bare subsistence, is the rule. In this conservative view, societies that can sustain geometers, mechanical inventors, and chemists are fragile and delicate things; such intellectual progress requires a rare social climate (though proponents disagree on the exact preconditions) and can easily be snuffed out. And certainly in history it is easy to find not only examples of such snuffing but also peoples who have remained relatively undeveloped for many centuries without ever developing.
I would LOVE any thoughts you had on Civboot.org, it sounds like you have a good high level of what roadmap and the general technologies thag would need to be put in place to make it possible.
I'll take a look! The git repo is a little heavyweight, but it looks like my cellphone connection can handle it. I've spent US$6 on cellphone credit for the last 2 months, and that's about to run out, so I'm getting 60 KiB per second now. It'd sure be nice to have a version of the repo that doesn't include dozens of megabytes of digital audio!
I feel like maybe the stated goal, "be able to create a technology stack which can self-replicate with 500 motivated students in 8 years, starting with a US-equivalent 8th grade education," is going to be hard to measure progress against, because every test run takes 8 years. Worse, it takes 500 motivated students with only a US-equivalent 8th-grade education! A much more ambitious goal would be easier to measure progress against.
A thing I'm not totally clear on is whether this is an unbootstrapping effort like Primitive Technology and bootstrappable.org, where your 500 motivated 12-year-olds are marooned on a desert island with only the shirts on their backs and the Ark of the Covenant, and have the primary objective of building a jumbo jet from found materials within 8 years, or a bootstrapping effort like Debian reproducible builds.
To take an extreme example, if you had a 3-D printer with a "reproduce self" button that needs only rocks, clay, wood, dirt, sand, ore, etc., to print out a new identical 3-D printer, even a single 12-year-old could operate it, even if not very motivated. Would such a "seed factory" qualify as a Civboot? (Properly documented, of course, and with enough additional UI that you could use it to make other things.) What if there's no feasible way to build it by hand from rocks and clay etc. if you don't already have one (or the entirety of civilization)? A Drexlerian nanotech assembler would be such a device, for example.
You like Forth. I'm still not convinced about Forth. In the abstract it seems like it should be about as good or bad as C: the base language facilities are slightly more primitive, but Forth permits arbitrary compile-time computation, an advantage C doesn't have. In practice Forth doesn't seem to pay off as a language; I think it's better understood as an operating system for embedded work, with the Forth language taking the role of Tcl or Bash or editor keyboard macros: it's a scriptable user interface, IDE, and "debugger", in the sense that you can inspect the contents of memory.
But maybe I just don't have enough experience with Forth yet, and if I just keep practicing, it will become easier and more appealing than C. I've at least gotten over the initial hump of trying to keep all my data on the stack all the time instead of using VARIABLEs (or VALUEs). But I still find writing things in Forth a lot more bug-prone than writing them even in C, much less in something like Python, which gives probably a 2-4 times speedup over C in programming time. And I still find Forth code a lot harder to read than C or assembly.
(You might be interested in StoneKnifeForth.)
I agree that electronics are probably pretty important, because control is one of the crucial aspects of such a cyclic fabrication system, and one that can dramatically simplify its other aspects. Electronics are an extremely appealing way to do control because electrons are so light, so, at any fixed power level, you can move electrons about 100 times faster than entire atoms. So although there are a huge number of ways to do computation (relays, fluidics, hydraulics, pneumatics, Drexler's rod logic, Merkle's buckling-spring logic, DNA epigenetics, etc.) electronics have a really huge power advantage. (Solid-state electronics especially, though there do exist gigahertz-capable vacuum tubes.)
I see electronics fabrication as primarily a question of material processing capabilities: purification, measurement, etching, vacuum pumping, ion bombardment, air filtering for clean benches or clean rooms, stuff like that. Patterning is of course necessary, but the hard part of patterning, at least the way we do it now, is making good photoresists.
It would, but I don't see it as feasible. Also, I have a thing about incentives, and if the goal is to make it automated then it's probably not going to be understandable. Whereas if the goal is to make it understandable then there is going to be pressure to make it simpler. Simpler technology is also going to have some difficulty with fully automated replication (although, who knows! It may be an important step to that vision too).
500 students and eight years is, I hope, a high end. My true hope is more like 30 and 4 years. Also, the Civboot can be broken down into tasks and built of commodity hardware until replaced, with different groups working on different aspects. If one group can build precision engineering, another group can use equivalent commodity precision engineering to make lenses, ... chemistry, manufacturing, etc can then be bundled together to build a computer chip, that would be a great early success. A full sci-fi school can only happen once all the components are proven and properly documented. In the interim, students can use and learn from built components. Even if this never happens in full, I'm convinced it's pieces would be highly valuable.
Edit: also, I can email you the relevant text if you prefer. Most of the size is my podcast and images, which should probably be moved to a separate repo and linked.
Also, I somehow hadn't seen the second half of your comments (was helping a toddler fall back to sleep).
I am a fan of what forth can do, but I find the language lacking. With a tiny bit of total code (i.e. 2-3 thousand lines) I've already made a "better" language: github com/civboot/fngi. Definitely WIP, but I'm already writing "code" in it.
As for what I'm looking for... anything really. So far the project has mostly been just me, so anything you wanted to contribute would be great. What I thought you would be specifically good at from you comment is outlining the technologies needed to get to precision engineering and semiconductor fabrication, which btw would probably be cold temperature (<300C) thin film lithography on glass or similar. These could include:
Creation of vacuums
Methods of manufacturing: lathes, CNC, molds, etc and how they have to be changed to do ultra precision manufacturing.
Manufacturing and purification of chemicals
Manufacturing and testing of optics (for patterning and precision engineering)
Precision measurements, including telescopes, oscilloscopes, scales, etc
I mean, the sky is the limit. Just understanding the problems and how it is both solved now as well as the history of solving it will be extremely valuable for simplification to the Civboot requirements.