ERCOT sends out Emergency Response Service (ERS) notifications to QSEs (Qualified Service Entities) during these periods via a WS-Notification. The hedge fund predicts that during these events they can make several tens of thousands of dollars a minute with the diesel generators that they have deployed across the state. I think they believe that they can because they're having me write the code to start the units based on ERS notifications.
Given the efficiency of the Bloom boxes  it seems like you could print money with them if you could get a fast start version.
Like JWZ, this has become a favorite of mine to share.
That, however, is taking nostalgia far beyond any sense of probity. It definitely ain't what it used to be.
I have little doubt that all of jwz.org text rendering will be fully analogue-simulated once the monstrosity that is the supermajority of the installed base of web browsers supports such folly.
And yes, I'm familiar with the xanalogtv screensaver. Among my faves.
I bought it because it simply existing brings me joy. It has the best you-haven't-paid-yet nagware implementation ever conceived by man. I never even triggered it (I bought it instantly) and it gives me joy that it exists.
That said, his recent "SOMA Nature Walk" series would appeal to people into big engineering.
The entire generator, including its concrete foundation, ripped itself out of the ground.
There was also the one about an electrician working on a generator who blasted himself with 66kV (low impedance). Massive burns, but he lived.
He used to work for a company called James Hardie, that made asbestos cement sheeting. Part of the process involved baking the sheets in a huge autoclave, like the one pictured here  (note the size of the man). An autoclave is an oven, filled with high pressure steam.
One day the door blew off the autoclave. The door disappeared, and the autoclave itself acted as a rocket, about the size of a shuttle solid fuel booster. It sheared off the bolts holding it to its foundation, rocketed though the back wall of the factory and ended up in a body of water about a mile away.
I was in a gas-fired power plant when the call came in to spin up the plant turbine to meet demand. So as the turbine is spinning up, the guy misses the sync (which involves throwing a breaker when a certain light is almost extinguished; think incandescent) only to make it on the second try. At that point, the turbine goes into "follow" mode where the turbine speed is regulated to keep phase with the rest of the grid. Everything is going swimmingly until some surge causes a sudden increase in turbine speed followed by a sharp decrease. That's when the fun begins. The turbine can't spin down fast enough, which causes a phase differential, which causes a breaker to take a turbine big as a house to suddenly and violently be removed from the grid. This would normally cause an over-rev that would rip said turbine up from floor and into the air were it not for a bank of resistors that are outside that can produce a load for all that energy. When all that energy gets dumped into a bank of resistors in a switch yard on a hot summer day, you can smell it.
Electricity is no joke. Respect it.
The resultant current surge generated enough force and torque to physically lift the turbogenerator off of the deck before the breaker tripped. The amazing thing is that somehow the steam piping didn't rupture in the process.
Next year the aptly-named "sync check" modification was installed to prevent shutting the circuit breaker unless the two buses had approximately equal phase.
From what I can remember, the tolerance was about +/-5% and within that range, the generators would lock to each other. If one generator was putting out AC power that was ahead of the other, the current would cause the generator to behave like a motor and speed up until it matched. The other 350 degrees of the phase dial were much more dangerous ... explosions, physical damage, etc.
The actual EE-ish problem with black starts is that darn control systems class the EEs have to sit thru full of bode stability plots and stuff.
The problem is that power plants and the innards are kind of like highly tuned race car engines. The peak of technological performance at 1000 horsepower out, but at idle they get kinda squirrelly and don't really know what to do so as not to oscillate and/or stall and/or blow themselves up. For the signal/telecom EE types, black start is kind of like having a very high power finicky high gain amplifier with no decent termination and no real input and not much control, the odds of that dude deciding to oscillate are unfortunately high. Another way to put it is "the grid" is more or less predictable constant impedance you can smoothly and predictably match to, but connected to nothing during a black start or initial power up is very much like keying a high power radio transmitter when not connected to an antenna or dummy load, its going to be pretty impressive no matter if it blows up or not.
Theres some interesting impedance issues. An alternator is kinda like a constant current source, for a given field winding current it'll squirt out a much higher current from the main windings. And inductors don't like to change their current flow. And the only limit to the voltage is arc over and/or the internal resistance of the winding (well.. AC is much more complicated, but..) So overexcite the field winding on a connected gen and the voltage across town goes up a hundredth of a volt who cares. Overexcite a unconnected / black start gen and it could just arc over and explode or blow transformers and just F the place all up in general. Dump an extra megawatt-hour of energy in the general direction of Chicago and Chicago doesn't sniffle, dump it into one little piece of switchgear in the yard all by itself because its disconnected / blackstarting and the arc blows it to pieces.
Another issue not at his relatively boring gas turbine plant is stuff like differential thermal expansion. You have to heat and cool boilers and steam turbos slowly or else differential expansion can rip them apart. Supposedly if you leak even a little steam on a stationary turbine it'll expand one side enough while leaving the other side unexpanded and cold that when you slam the valve open its an open guess if you'll destroy the bearings from vibration or smash the blades into the outside of the turbine. So you keep them spinning, even if its really slow like 10 RPM, all the time, forever, unless you've got a crane on site to replace. And boilers blow up if you heat them too quickly, same problem with parts at different temps.
Gas turbos are tougher than steam turbos for a variety of reasons one being they're so dang hot and so much outside air (full of bugs and stuff) flows thru them that they can't build to the tolerances that a steam turbo can use, so they don't even try, so powering one up isn't as exciting as you'd think. Oh its loud, but not as exciting as spinning up a steamie.
Another fun feature is black starting is pretty hard on your whole backup system. Idling the diesel for 15 minutes a week is not quite as exciting as slamming it open full throttle for 12 hours while you heat up the main boiler or whatever. So if you're going to blow up your UPS / diesel / whatever its going to happen at black start time.
There's a general engineering rule that its a heck of a lot easier to design something that constantly does the same thing than something that varies, maybe randomly.
Part of the key to serving electrical demand is having a balanced mix of generation to serve your load. Some units are better running flat out, some are better for brief periods at peak demand, and some are good at quickly taking up the slack if another unit fails. Different power markets exist within the same geographical footprint to ensure that all these types of needs (and more) are met. (24 hours a day, 7 days a week, and into the foreseeable future.)
I was serving in the engineering department on a USN aircraft carrier (non-nuclear) when a cascading casualty led to all boilers going off line. The ship had an emergency diesel generator aligned to automatically power up, but it failed to start due to a previously-unknown problem. So an 80,000 ton warship with 5,000 people on board slowly drifted to a stop, completely dark except for emergency 60's-era-battle lanterns that were already starting to dim.
No steam = no electricity (the normal ship's generators were steam-powered) and no electricity = no steam (because the start-up feedwater pumps and air blowers for the boilers were electric).
One of the other two EDGs was already down with a casualty which left a single diesel generator that had to be started with compressed air stored in two huge bottles--so basically had two chances to get the ship moving again. (No electricity = no air compressors to refill the bottles.) After a few hours of double- and triple-checking the alignment of the diesels, electrical systems, and boilers (the original steam plant casualty had to be diagnosed) using flashlights in temperatures well into the triple digits (no electricity = no air condi...you get the idea) we successfully started the one remaining diesel which provided AC to the boilers to start up.
By far the scariest day I ever had in the navy. Only saving grace was that we weren't flying planes at the time.
Or I guess just transported some compressed air from an escort, too -- I'm not sure what volumes you're talking about, and if the other gas cylinders a warship probably has on board would be suitable)
Could be a loooong wait, though. I guess that's why they have two.
I don't know much about this sort of thing, so I'll ask the obvious dumb question: why no batteries to start the diesel generator? Was it too big?
Edit: Reading on, it seems like compressed air is the norm. Is it more space efficient than a battery big enough to start a large generator?
However the battery isn't there to start the Emergency Diesel Generator. Submarine EDGs are air started, for many very good reasons.
We still need the batteries since it's possible to suffer a loss of all AC power while the boat is submerged far beyond feasible snorkel depth, and have to recover from it without broaching.
1) wouldn't you just insert/remove control rods as needed to restart the nuclear chain reaction? i'm pretty sure most reactors design control rods to be manually insertable/removable, even if there are other way to insert/remove them
2) a standby diesel generator with good ventilation, especially passive ventilation?
3) a large dc power source (ie big, charged batteries) to "jumpstart" either a diesel generator or the nuclear reactor the way my car battery jumpstarts my car when I turn the key
4) some other form of stored potential energy and a generator that can extract it (eg: compressed gas through a turbine) to start 1 or 2.
5) (really just a subsection of 4) human powered generator of some kind. perhaps a few stationary bikes?
Another issue is you run the coolant pumps to dump a couple MW into the system to reach operating temp/pressure after a day or so, THEN light off the reaction so you don't have varying steam conditions affecting the nuke physics. You don't "heat up" a nuke under nuke power as most assume. Its already thermally hot operating temp when you pull the rods.
then you'd need at least a couple diesel generators and fuel or power cells to get the reactor into a state where it could start generating power.
Since you said megawatts, there will probably need to be a smaller generator or two to start the generators that will start the reactor, since i think MW diesel generators take a fair amount of work to get started themselves.
And we haven't even talked about backup generators in separate parts of the boat/ship in case of engine fire/damage.
Also, there would probably need to be at least another generator/power cell whose only job is to ensure that the sub can blow its ballast at any time (and of course, just regulate it) that comes up as soon as the reactor goes down.
There's the slowest safest possible way to carefully test and monitor a power up guaranteed to cause minimal maint issues and longest possible life and highest safety to the civilian city downwind, and then theres OMG the missiles are flying we gotta get outta port right now. And there's numerous engineering changes you can apply to make things faster. And a tiny little 10 MW plant or whatever a sub has is a whole different kettle of fish than a 1 GW stationary plant. And the stationary plant has to care about efficiency because they're trying to pay off construction loans so any PITA that increases output is a win, but the sub boys have no (direct) loans to pay off and as long as the boat moves when the skipper says, the efficiency doesn't matter.
So they're going to be different.
But yeah, even booting up a sub is going to be some time and some work, even if you're in a hurry.
And there's historical issues like xenon poisoning which boils down to if you shut down a reactor in a "bad" state of the chemical shim system (which is kind of like intentionally dissolving a control rod in the coolant) after it was run hard and put away wet such that Xenon builds up in the core, that dude is not going critical for a day or so even if you pull the rods completely out, until the shim system cleans up the coolant... at least on land. I suppose if I was in the .mil I'd have a way to dump distilled water into the coolant for just such a situation and/or I'd have regs to never run the shim system that high and/or I'd have so much excess reactivity in the control system that, well, a landlubber would be nervous about it, so you could just burn thru the xenon poisoning anyway. And/or a regulation that says no shutting down the reactor in a rode hard / put away wet scenario so xenon would never be an issue. I mean if you're not paying for the fuel, and you're worried about xenon poisoning, one way around it is never shut the thing off, ever, unless its a major radiological issue. That's certainly one way around it.
Generally subs compress air before they need it, so there's usually plenty available before something "happens". If you're just pumping up the tanks right before you need them you've probably got serious problems or doing something completely ridiculous...
"Black start" of a sub would strictly be mid-ocean adventures which are probably classified and/or completely BS sea stories. Normally they power up off shore power while in port. I would imagine this does nothing for secrecy, the lights dim at the harbor and the backup generator is idling, hmm, I wonder whats shipping out tomorrow?
There are often no backups. The front of the sub usually isn't as sensitive as the engineering spaces and the engineering spaces aren't large. There's no snorkel coming out of the forward torpedo room so there's no backup diesel in there, besides, where would the torpedos be? I'm told by actual sub people that the front half of plastic models of subs are usually pretty realistic and usually based off completely declassified stuff, but the back half of most models is pretty much modelers artistic license time, and that's all they'll say, which I guess is how it should be...
I'd be surprised if there were no backup generators at all. Maybe not in the front, but somewhere where the primary backups aren't. Shit happens.
Submarines do indeed carry an emergency diesel generator, and they also have a fairly large battery, but the emergency main ballast blow system can be run off of nothing but previously-stored energy and a hand-actuated valve.
"[...]power can be provided from the submarine's battery through the Ship Service Motor Generators (SSMGs)."
This is a problem that the engineers designing nuclear submarines have thought long and hard about - the USS Thresher and all crew were lost in part due to inability to rapidly restart a scrammed reactor.
Everything I learned on the boat just taught me that I have so much to learn. So many minor details that a ship designer thought up went into each successive class of U.S. submarine. There were many days when I'm surprised again that we haven't lost more submarines due to design flaws or misfeatures.
Me: US navy nuclear submarines are a much-cited example of the successful design, development and deployment of high-reliability systems.
You: I sometimes wonder how it is that more of us are not sleeping with the fishes.
Still, everyone from designers to crews must be doing something right since it's apparently possible to drive such a machine into a rock at flank speed or through a boat or have it commanded by someone exhibiting strikingly poor judgement. Without killing everyone on board and better yet, the planet.
Soviet submarines often had 2 though.
For the U.S. submarines they frequently would test shutting down the 1 operational reactor at-sea and trying to recover from the casualty, just to prove that it could be done when you didn't have time to pre-plan.
Edit: U.S. subs do have diesels though. So next question: how do you bring up the diesel engine and its required auxiliaries without AC?
1. Hand-crank a small diesel engine connected to a small air compressor.
2. Use the small air compressor to build up pressure to start the emergency diesel generator.
3. Start the emergency diesel.
4. Using the emergency power, run one of the large air compressors to build up pressure for starting the main generators.
5. Start the main generators.
The emergency diesel was near the stern of the ship, away from the generator room, to ensure an generator room fire couldn't take out the emergency diesel.
Also, once the diesel is running it is used to power the electrical buses that provide the minimal pumps and other gear needed to recover the reactor and eventually restart (or emergency restart) the turbogenerators that provide ship's service power.
Unfortunately there's no room to have separate emergency generators and emergency diesel so they are co-located.
But I was simply referring to the part where you surface the boat before starting the diesels. I think some folks might be under the impression that you can run those while submerged which is most decidedly NOT the case.
What I think many people don't realize is that a reactor shutdown is likely to be a mission-over/career-ender type of deal for almost the entire officer corps onboard. It's not supposed to happen EVER. It's like forgetting your gun as you exit the helicopter.
BTW, It was "supposed to work" but didn't isn't an excuse. You (as an officer) are responsible. That's what maintenance and drills are for. Reactor shuts down and diesels won't come up? Wow. Major UNSAT. A dead-in-the-water carrier is almost as bad as running the damn thing aground.
I'm wondering how the CNO felt about that poodle-screw.
DIW on a CVN is a big deal, that is true (though hardly a career killer by itself for O-gang, even the ones in Reactor Department). NR takes nuclear safety very seriously and the carrier won't sink just from loss of propulsion so the reactors will very much be configured to fail conservative if necessary.
Even on a submarine, which can flounder without propulsion and only has a single reactor, we do scram drills all the time. A scram can occur for no better reason than that reactor protection was feeling finicky that day, so the drills are designed to assume a scram will happen, and recover safely and efficiently.
On the other hand, an unplanned scram really is one of those things which may get someone disqualified from watchstanding, and possibly de-nuked completely, since those usually represent a crew that doesn't properly respect the power of the reactor.
BTW, I spent some time as a bubble-head, so I do understand what you're talking about here. Just keep in mind that not everything you've heard about subs is true and not everything I knew about subs is still true. A lot has changed since I was in.
The first single-shaft U.S. submarine was a diesel research vessel, USS Albacore, which proved the feasibility of many innovations which were later ported over to the nuclear submarine fleet. USS Skipjack was the first nuclear submarine to include most of those features, including single-screw design.
Option A: You hand-crank the beast somehow? To get the glow-plug going, you again use a hand generator? Hopefully enough to bootstrap the generator (maybe it's a smaller generator that runs a larger one)? Generators all the way down?
Option B: You blow ballast somehow and use the inrushing water to drive a turbine that runs the generator or gets it going?
Option C: You manually pull the control rods and switch the coolant loop to run a small turbine to prime the generator?
Option D: You mayday and get a jump from the Russian/Chinese/Iranian sub following you around?
Option E: You try something dumb and dangerous with hydrogen peroxide from the torpedoes (I think/hope that that's phased out now)?
I mentioned this upthread - USS Thresher seems to have suffered a loss of both propulsion and ballast control while near test-depth with, unfortunately, tragic results for the vessel and all on board.
I suppose if that failed or had somehow discharged incorrectly, there should probably be a way to handcrank the diesel generator, like how early cars required hand cranking to start.
PS: I had to look it up, but that's an interesting reason why that us sub had 2 nuclear reactors.
Remember, it's called the silent service for a reason. Those who know, don't tell; those who tell, don't know.
Without that insignificant-looking bottle the whole machine would have nothing to do.
(Edit: I do have to wonder how wise it is to paint a bottle of hydrogen to look like a fire extinguisher.)
That's not even getting into the whole red-green color blindness issue that could lead to confusing 'Flammable' with 'Inert' contents.
Also the colours are for "the room is on fire, quick what's in that gas bottle over there?" situations. Are you allowed to be a safety responder if you're colour blind? For everyone else the rule is pretty simple; GTFO, and if acetylene is involved, GTFO out of the postcode.
If the room's on fire and I'm in it, I'm a 'safety responder' whether I want to be or not.
Built by Burmeister & Wain , located at H.C. Ørstedværket : https://www.youtube.com/watch?v=jPouLq3yZI8
Maybe a diesel engine of this size was required since we don't have much hydro power in Denmark (the article suggests starting a hydroelectric generating station first).
Generating plants using steam turbines require station service power of up to 10% of their capacity for boiler feedwater pumps, boiler forced-draft combustion air blowers, and for fuel preparation.
Also interesting is that power prices will occasionally go negative in cases where there's a 'surplus' of generation. What's happening in these cases is that generation owners are making the judgement that its more cost effective to pay people to take their power than it is to shut off their plant. Shutting down a big plant is an event, and it takes a while to get them back running. Sometimes, shutting them down doesn't make sense.
Lets say your control and cooling systems require 5% of the heat they handle, that means your 3 GWt nuke would require an absolute minimum of 15 MWe to spin down. Or four if you want to run off grid so you've got two completely independent sources of power each with a 24x7 hot backup (I believe no one ever took the NRC up on that offer, but I could be wrong)
All that is then required is a method of opening the penstock, which can presumably be hand cranked?
* Each of Hoover Dam's generators appear to me, based on this photo , to have three stages of excitation, vertically stacked on the rotor shaft.
* A year 2010 upgrade to digital controls at Hoover Dam  shows:
___ o A total plant capacity of 2.074 GW from the 17 generators
___ o 20 seconds to go from reactive power control ("condense mode") to generator mode.
___ o Pictures of the original and replacement governor equipment; the red cabinetry shows a beautiful 1930s design style
* In "condense mode" , the turbine's penstock valve ("wicket gate") is closed off, the turbine volume filled with compressed air to displace the remaining water, then the generator operated as a massive synchronous motor. In this mode, the excitation controls can provide marketable power factor correction, aka "reactive power" for the grid.
If the permanent magnetic field isn't strong enough you can't even generate enough voltage to power-up the excitation circuit at all, and that's the circuit which would feed the current back in.
So whether this is feasible or not depends on the generator design.
Wikipedia also has a bit about it . It seems that there is usually a backup facility to run a DC current though the field winding before starting, thus magnetising the magnetic paths, for when the residual field has decayed too much. That backs up your comments about reliability.
Generators have more parts and are pretty finicky and delicate compared to alternators which are mechanically pretty simple beasts in comparison.
Alternators are electrically controllable and have a field winding.
Something like a diesel locomotive has a couple stages with a small 32 volt generator providing enough field current to run a small alternator which provides the field for the big alternator which connects to the drive motors. In the old days they used DC drive motors but for decades now they basically have multiple giant rolling VFDs and ac motors. VFDs are more reliable than mechanical commutators, which sounded crazy in the old days but its true.
I didn't realize posting links to encyclopedia articles qualified as "hacker news".
While I think the discussion is an interesting one, it's still odd to see a random wikipedia article on the front page of HN
Thanks for the context.
Hacker News isn't just about news, it's about learning and community. I, for one, would like to see more random Wikipedia articles on HN.
If you actually have to be told this, I don't know what to say, but the analogy is if your virtualization system can't boot without working DHCP and DNS, you've got a big problem if you virtualize your DHCP and DNS.
This is obvious. The more likely failure mode is some goofy homemade thing. Like you can't boot any server including the database server unless the LDAP backend can succesfully talk to the database of user info, but you can't talk to the database unless its already booted, so..