It is not great, actually. PFD (primary flight displays) are cluttered and information-noisy. HUD is a much better tool for flying experience. Fortunately for civilian pilots, this is becoming more common now.
FMS (flight management system) has all the usability of IBM mainframes from 1960s and about the same performance.
The tasks that pilot have to do before the flight are rather simple: you have to input weather conditions, aircraft load and waypoints for autopilot. But with even the most modern FMS it is a tedious and frustrating process, you have non-intuitive control flow and non-qwerty keyboard. Also all text-based, non-graphical interface.
The better parts of aicraft UI are EICAS/ECAM (engine information and alerts) - they are both useful and intuitive to understand, with emphasis on graphical indication.
A lot of hard to use bits are not from any technology limitations - modern aircraft displays are rather capable, but from the decades of industry legacy and expensive certifications required for any change.
I flew along on a small private jet recently, their system was 10x easier to understand and more capable than the typical airliner... So it is possible, probably even at a lower cost.
I don't know what the answer is but attitudes generally flow down from the top, so I'd imagine a good start would be to somehow re-install creative technical people in the top-end leadership roles.
Consequently, you look around and see nothing but conservative people putting in their time. If you're someone more driven, you get tired and leave.
However there's a constant care about making things that are certifiable, and make business sense (otherwise it's just not going to happen). It seems to me that it's difficult for people outside this type of industry to appreciate how certification impacts the decisions.
We strive to make systems that are reliable, easy to use and maintain, and efficient; but they have to make their way to the customer, through the authorities and business constraints.
It's the same reason banks are still running things like their 30yo COBOL code. The cost of replacing it isn't the problem. The problem is, if it's been running reliably for 30 years, then what justification could you possibly come up with for accepting the risk of replacing it?
Hell no. In aeronautics, you want safety-conscious, technically conservative, quality paranoid engineers. You need that because you don't want to retrain pilots on the last release every Patch Tuesday. A lot of the design that goes into the cockpit is to minimize training costs and that is a major procurement driver (remember the 737 MAX?)
I recently watched a few videos of flights in the Cirrus Visionjet, literally the smallest and lowest cost single engine private jet aircraft on the market. Its electronic cockpit looks very straightforward and logical in design.
If you can fly a G1000 in a Cirrus piston or Cessna, the G3000 is an easy transition.
The avionics and FMS of a typical airliner is positively COBOL by comparison. To get type rated in modern GA jets is pretty easy because the avionics are generally what you are already used to. However, the G1000/G3000 aren’t part 25 certified, however there is now a G5000 that is Part 25 legal, so I expect there to be some considerable improvements trickling up into the bigger jets. (Part 25 is basically “transport category” aircraft.)
While it's no G1000 or G3000, the G500 TXi, GTN 750 Xi, and GI 275 are all very straightforward, with engine indications being displayed on the G500 Xi in an easy to navigate package.
Being behind the aircraft as far as interpreting the situation/ indicators and not knowing what recovery steps to take seem to be a reoccurring problem, at least as far as catastrophic type situations.
I wonder if simulated error scenarios ever occur during flight -- could be a good way to expose pilots to rarely used recovery procedures within realistic day to day contexts ...
You can have all the warnings and etc, but how the human processes and interprets and responds is just not always predictable. If they misread a situation, the time to recover/ self correct isn't often very long.
Granted, they've obviously made great progress to some extent, as safety as far as airliners go is pretty incredible these days.
So the small jet in my example indeed has less regulations than a larger airliner. And would probably not be allowed to be used for commercial air transport, only charter flights.
I'm not saying they do (I'm a software developer Jim, not a pilot), just something to keep in mind. I'm rebuilding a webapp myself with more modern design, and in an early demo I've already gotten a remark about information density.
I would consider this a positive. Graphics do not imply improved readability, the information is dense and you have no choice but to present it as concisely as possible. You also need a dim cockpit for low light operations.
What could be a win is integration with the QRG to make access to information easier during a abnormal operating condition. You spend precious seconds locating and flipping through paper books to identify mitigation procedures.
More buttons please!
The G3000 integrated flight deck is pretty much the default in new business jets too.
In my opinion the touch screens are a lot easier to use than the old G1000 screens except for when you are getting tossed around in turbulence. Fortunately, there are still physical buttons for all of the "safety critical" or "time critical" inputs such as configuring the autopilot, changing radio frequencies, or adjusting the barometric pressure for the altimeter.
Source: I am a private pilot and have used the G1000, G300, and G3X touch.
When working on Bioshock I had a strip of buttons that could be programmed to send keystrokes like it was a keyboard. I was working in Unreal Engine on the Xbox 360. I could plug these keys it into the dev kit, and with one click could enter all kinds of obscure console commands I could never remember. Was great.
Update: was one of these. https://xkeys.com/
I really think multifunction keys are the best of both worlds. As the author of this piece describes, the multifunction display with 20 keys around the outside (or, for CNCs, 10 keys across the bottom of the monitor and 10 off to the right, in a 1-4-4-1 spacing so you can feel exactly which button you're hovering over while you're staring unblinking at a cutter chewing through 5-figure assemblies) is a good compromise. It takes some serious concentrated planning to design a set of keys that are intuitive (top to scroll up, bottom to scroll down, one dedicated for enter, two for context-specific operations, etc), but it gives you the freedom to design relatively shallow but featureful menu systems that you can memorize and get tactile feedback to operate with confidence.
I actually looked at those XKeys ones first, but IIRC they were a little too expensive for what I wanted (yes, the StreamDeck isn't that cheap either, but its easier to use out of the box)
StreamDeck is great for non-streaming tasks. I'm very happy with it.
I've got a StreamDeck XL mounted under my monitor, in a button box; its capabilities as a macro machine are vastly underrated, although a few people are catching on that it's not just for live content creation.
It's absolutely amazing when doing remote work to be able to fire up OBS Studio, the meeting join, microphone control etc in a single click - and I have that just on one page, along with other meeting controls such as camera scenes. Another for VS Studio, there's integration with that which is quite useful to send commands directly. I have all my most of ten work websites on buttons of their own.
As mentioned, I also have button boxes however I'm still working out what the best way of sending commands would be; Joy2Key seem to mess up alt keys sometimes, making it sticky. When it worked it was nice, imagine adjusting text size just twisting a rotary for example.
Physical buttons are critical. That's the key difference between an MFD and a touchscreen. The touchbar is a one-dimensional touchscreen, with most of its downsides.
This isn't to say that displays on the buttons themselves are bad. But we pay way too little attention to the ergonomics of fine motor control and tactile/muscle memory. If you look at the article linked in this post, the key point being made is how hard it is to hunt for a featureless touchscreen button while your wrist is in the air being jostled around by turbulence. You don't have to be a pilot to appreciate interfaces that go easy on your fine motor skills though. Any action that requires extended use of fine motor skill (like holding your wrist in the air while hitting a tiny spot) will be at minimum tiring (both mentally and physically), and maybe impossible for children and the elderly.
An MFD with a wrist rest, uneven button spacing/sizing/tactile patterns, rotary controls in the corners, and maybe button LEDs to color-code functions in addition to on-screen labels, would be superior to the touchbar. Actually, the numpad on "full-size" keyboards is tantalizingly close to that in some ways - it would be great if someone took a full-size keyboard and replaced the numpad with something that sort of looks like it but is functionally an MFD.
By the way, all keyboards already have tactile pattern aids - the little bumps on the F and J keys that let your fingers quickly know if they're correctly positioned on the home row. Everyone knows that, but it's just a glimpse of what's possible if we invest more in tactile interfaces.
If it had been in addition to a normal keyboard layout it would have been far, far better - in my opinion, speaking as a PC Streamdeck user.
I think it's called a keyboard ;)
A war plane is something you have to operate while it's burning, or while you're bleeding on it, or while you can't see properly because it's full of smoke or someone just blinded you with a laser. The adoption of touch screens in this sort of cockpit seems misguided. Particularly for anything related to controlling comms or navigation.
It’s basically been decided that we are going to spend silly money keeping a small number of absolutely cutting edge aircraft flying rather than thousands if not tens of thousands of of likely more efficient but less capable possibly drone aircraft.
PS: To be clear it’s possible their making the correct choice. I personally doubt it, but I don’t have access to the kind of classified documents to justify things in one way or another. An effective labor weapon for example might render vastly cheaper drone fleets ineffective.
Ejecting from an aircraft is an absolute last resort, and you stand a good chance of dying or being badly injured if you have to do it, and even if you survive the ejection, the parachute ride, and the landing, it's a better than even chance you're going to be captured and beaten, tortured, or killed on the ground. That's if you land on land of course -- if you land in the water you might just drown or never be found.
That’s simply not the reality of modern fighter jets. The vast majority of time is going to be spent flying over either open ocean or friendly territory. That’s been true even if you’re only looking at recent combat missions.
Anyway, single engine aircraft are always going to be at higher risk for mechanical failure, yet that’s the chosen design. Just look through this list: https://en.wikipedia.org/wiki/List_of_accidents_and_incident.... In commercial aviation 4 crashes per year worldwide not that great, in military aviation 4 crashes a month worldwide is a very good month.
You're describing training flights, not combat missions. It is very common for aircraft to fly missions that are hundreds of miles long, most of which is over enemy territory. I used to sit in CDC on a CVN and watch the missions every day during Operation Southern Watch, which wasn't even really war -- but those pilots were flying over enemy territory for many hours every day.
Same thing in Afghanistan and Iraq, every flight was essentially over enemy territory for its entire duration -- surveillance, strike, and transport. You really don't want to bail out of an aircraft in the tribal areas if there's any way to get it home.
Modern aircraft are extremely reliable, they don't break often. Modern ejection seats are extremely reliable, they don't fail often. And yet, everything I posted above is exactly correct.
Close Air Support is definitely a major role for the F-35, but you have troupes there so it’s contested territory. Patrolling no fly zones is currently much better suited for drone aircraft, but might become important again.
So yes exceptions exist, but you really don’t want to run air to air combat missions out of air force bases anywhere near contested airspace. The risk vs rewards very much favor longer flights with mid air refueling.
That may change some day in the future, but that's the reality now.
And the F35 can do CAS, sort of, but that's not really its role. We've got a whole host of fourth gen aircraft to do CAS as CAS is nearly always done in an environment where we have full air superiority.
That said, you’re right, F-35’s have already been delivered and represent actual capacity not hypothetical alternatives.
However, my personal experience was mostly on the R&D side of the DoD which colors my thinking about this stuff.
High aircraft speeds combined with mid air refueling give nearly arbitrary ranges, add in and the risk associated with air defenses makes long distance attacks more common. You don’t want your air bases within easy striking distance of the enemy.
Several other factors are relevant for example prop aircraft can handle rough runways, but jets need a clean surface as they can suck debris into engines. So, even in the event of a US / China war, it’s not clear how long both sides would be capable of having effective air forces anywhere near each other.
Even Iraq managed to capture US and allied pilots. I think I'll forego the rest; you're reality and actual reality are a bit too divergent.
> it’s better than even chance you’re going to be captured and beaten, tortured, or killed on the ground
Is demonstrably false. War is still an extremely unpleasant business, but the term acceptable losses applies even in peacetime.
Every mission training or otherwise is rolling the dice that the aircraft will be lost. Yet, they still send pilots up knowing those risks in preparation for war. Aircraft designs really do involve similar tradeoffs and injured, dead, or captured pilots really are part of the equation.
That's a fact. And nothing else you've posted argues against it.
Of course people take risks, mitigate risks, and weigh those risks against the benefits from the missions.
That doesn't change anything or falsify the statement I made.
Then overall odds of ejecting resulting in capture is way less than 50%. Further, if mechanical failure is expected to bring down say 15% of aircraft, then the odds of mechanical failure over enemy territory is low vs actually being shot down.
That said, actual odds are a little different as mechanical failure isn’t evenly distributed, and hours spent over disputed territory also risk capture etc. Still it’s clear that a low percentage of ejecting pilots are expected to be captured.
You're adding in all kinds of things that have no bearing on the discussion and don't mean anything in the context of the discussion. And the numbers you made up are silly.
Individual fighters don’t, but widely adopted designs from the 70’s and after stuck around. The F-16 family is currently expected to be in service for 75 years though it’s only reached 42 years at this point. F-15’s have done 45 years at this point and “We intend to maintain the F-15C fleet through the 2020s.” Suggesting 55+ with a fair amount of uncertainty. F-14 was introduced in 1974 and ironically enough is still in use by Iran. Hell the F-4 entered service in 1961, and is still used by Japan.
As to what you said, nearly certainly killed or captured isn’t it’s better than even chance. You can quibble about meaningless numbers chosen to convey meaning not specifics, but as your making a different statement clearly you agree a small percentage of total elections are expected to result in capture. Death and serious injury is a much greater risk, but again overall risks for the lifespan of the design is what’s important, the US military will sacrifice far more lives than the a most few hundred F-35 pilots we are talking about. As demonstrated by the decision to double down on manned aircraft in the first place rather than try and make a air to air combat capable drone.
The F14 is not in service anymore. Iran has probably less than 10 that are actually flyable, and they've been so heavily modified as to be mostly not recognizable as F14s anymore. The only other actual airframes that are anywhere near a 50 year lifespan are the B-52s, and they've been totally redesigned and rebuilt multiple times over those years.
There are no F15 airframes over 45 years, there are no F4 airframes over 45 years. The F15 production line is still open, there are 7 F4s still in service and they are a heavily upgraded version that wasn't produced in 1984 -- and those 7 leave service next month. You're confusing first date of production with the actual production dates of the aircraft still flying in order to make up a point that isn't even accurate as you've stated it.
Anyway, you just keep making up stuff so I'm going to leave this discussion here for now.
However, again for any future readers it’s irrelevant how long an individual aircraft is in service from a design perspective. What’s relevant is the what people using that design use it for, and this how long. Bullets for example are single use. However, individual designs can be used for very long periods of time as long as their serial useful, specific aircraft designs for the same criteria where you can see some of them manufactured for 20+ years.
As the other point was dropped I will take this as you conceding the argument. ;-)
Uh-Huh. Thirty (repeat 3-0) years ago.
What is the basis for saying that? From what I understand, the U.S. military is investing very heavily in unmanned aerial vehicles, including having F-35's control large numbers of them.
>It’s basically been decided that we are going to spend silly money keeping a small number of absolutely cutting edge aircraft flying rather than thousands if not tens of thousands of of likely more efficient but less capable possibly drone aircraft.
Well, you're missing the fact that there will be thousands of F-35s on earth (500 already built). Meanwhile there are less drones like MQ-9 Reaper (200 built) which are basically primarily to bully some ground troops than F-35s despite them only costing $40 million a pop. After all they are cheap. Because you see, the brick and mortar store sells them, so they must be cheap even when they are not.
>than thousands if not tens of thousands of of likely more efficient but less capable possibly drone aircraft.
In a war less capability might mean the total loss of all aircraft. You only need a few F-35s and some anti air support on the ground and the drones will be shot down. Yes, you might be able to execute a saturation attack but once you lost your entire fleet how are you going to respond to the counterattack? Oh right, with your own 5th generation fighter that matches the F-35.
Honestly, the biggest benefit of drones is that you can equip your infantry with loitering munitions and thereby reduce the need for conventional CAS provided by a conventional air force. This isn't a stupid lets build ten million drones swarm buzzword bingo to scare some people who barely know anything about the capability of military weapons. That's nonsensical. It's like plastering machine guns everywhere because "cheap". As if militaries only care about stockpiling weapons with no logic behind mission objectives.
But that’s just the start, the MQ-9 costs about $3,600 per flight hour vs ~35,000 per hour for the F-35. Though that slightly favors the F-35 because training an F-35A pilot costs a little over 10 million dollars.
That said, the MQ-9 is designed for a very different role so per aircraft numbers are deceptive. F-35’s have a much higher payload, higher top speed, stealth etc.
Prices like this for military equipment are deceptive. They're not $40mil a pop. They're the product of an $8 billion project. The build price is probably less than $100k... or at least it would be if a military contractor wasn't absolutely creaming it.
I don't think there are aircraft of any kind doing anything like that for $100k
Something like a TBM 910 has comparable specs as a light aircraft and cost something like $4m.
I also really miss this from the dumbphone era. I used to be able to type SMS texts by feel using a T9 keypad while walking down the street, and only occasionally have to check the screen to see what I wrote. Smartphone QWERTY makes this impossible.
I know from my experience that I took my sight off the road, there could be an atomic blast in front of me and I would hardly notice it. Somebody slamming brakes in front of me might be peripherally noticed but without context could cause a stupid and dangerous reaction.
When Tesla started basically putting tablets instead of knobs some folks cheered. I couldn't be more sad for this trend. Clearly worse direction for those like me.
All physical buttons/switches in my 20 year old Mitsubishi still work. I have a feeling the newfangled, fancy LCD-switches don't last that long, and will be very expensive to fix when they break.
I can absolutely type in my iPhone without looking at it. I just typed this comment with zero visual contact with my phone and no edits.
(EDIT: this is a weirdly divisive comment.)
Everyone in my (much) younger sister’s age group can do this. They grew up on touch devices. You and I didn’t.
Just a note that one group’s personal experiences shouldn’t be generalised to the point of describing others’ as “impossible.”
But I can say that personally I was also able to do it without looking to some extent (perhaps a whole sentence with very low issues to correct), and I'm slowly losing that ability (which was accentuated with a change of hardware, but I was also feeling the loss of accuracy beforehand).
Edit: the answer is no
I think I will never really get the hang of the mobile keyboard(though I tend to use touch swiping), because I just consider it inferior to any physical normal sized keyboard.
That seems... bad, but also totally unsurprising.
Maybe if it were a flip-down thing where you could rest your hand when needed, but also bounce it out of the way when its not needed.
> think how much easier it is to type on a smartphone with your thumbs versus trying to stab at a virtual keyboard on a large tablet with just your index finger.
My experience typing on a touch screen on bumpy roads or even a seemingly smooth highway at normal speed (as passenger of course) is that I miss a lot of keys, even if I grab my phone with two hands and I type with thumbs, which are a little too wide. Luckily I learned to swype and that works much better because of the constant contact with the screen. Fingers can't jump away. Still, getting shifted characters right is a problem. A physical keyboard is much better in that environment.
This is way more sparse and streamlined than I thought. Wonder how big the manual for flight simulator game would be. Some video of UI in action on simulator.
Are there any design documentations for UX/UI for military hardware? Is there a name for this style. Is it actually as functional as it looks? I wonder how these designers feel about dealing with military powerpoints.
It was a bigger, bolder look than was common on desktop computers, and I've always personally loved the style. There was a brief rise of similar rules in the civilian world as things moved mobile and we had to work on small screens with big fingers, but the direction now is to try to remove anything that might hint of interaction from the screen entirely. (Not a fan of this myself!)
I've been in civilian work pretty much ever since so I have no idea how things have changed since then. Edit: on second glance I think a lot of the same principles are still in effect. While colorful I'm not sure that anything depends on reading the color, and seen from the pilot's chair it probably isn't all that crowded.
Deep, rapid breaths. They need to suck oxygen into their body as quickly and efficiently as possible to maintain consciousness, because the g-forces forces blood away from their heads and towards their legs and feet.
Here's a "classic" video of a pilot successfully evading an unbelievable number of SAMs over Iraq. The rapid breathing might make you think he's panicking. Nope, he's got it 100% under control and is following training perfectly. Though I'm sure he certainly needed a drink after making it home.
There's also sort of a method of flexing their thighs that they learn. Restricts blood flow to the legs, so there's more blood for the rest of the body. That's a bit of an athletic endeavor in and of itself. Try flexing your thighs... now hold them that way for 5, 10, 20 minutes. Yikes.
Anyway, how the hell could you even bark out voice commands while doing that sort of breathing!?!?
Second, given how shitty voice interfaces are, I'm shocked they would use them at all. I assume the military funds a lot of EEG research- that would be ideal here.
Given how finicky they are I can't say I'm surprised. Maybe with modern pseudo-AI systems they could be reliable enough to depend on, but none of that is in military hardware specced out 20 years ago.
No, and no. Just good, old-fashioned microphones and speakers. If you're lucky, you have a set of "communication ear plugs" wired up to your helmet so the speakers in your earcups aren't trying to compete with engine noise and your ear plugs.
Do a Google Images search for "DCS FA18 cockpit" or "DCS Harrier cockpit" and you'll see that the real life photos are pretty much indistinguishable from the screenshots, if you take the word "DCS" out of the search term. Every switch and gauge are faithfully simulated, and you can use the real-life operating manuals to operate these simulators.
There's a lot of overlap with a lot of the things I love about computer systems. It's fun to learn, and to operate systems, and to feel that feeling of mastery as you gain confidence in making the machines do your bidding. Those types of feelings are much the same (and different) between operating computers and operating aircraft systems. To a large extent these modern planes feels a lot like operating a big flying computer, at least in the simulators. This is also true of things like the Cessna G1000 glass cockpit in Flight Sim 2020.
One thing that's particularly impressive about the F/A-18 is that the Spec available in DCS (give or take a few features) is almost the same as the first batch from the 80s UI wise.
In 1983, serving alongside the almost completely analog/60s F-14, the F/A-18 had 3 pretty modern MFDs. Definitely more advanced than most Star Wars cockpits, for example.
I wonder at what point the Star Wars people will thematically have to update their cockpits/other tech because it will otherwise date.
Kind of how CyberPunk has dated because they missed out on smartphones...
Also, I'd love one for home automation too. There's only so much data you need to display or enter so the reduced latency of a dumb screen going straight into the back of a internet connected SBC (or even microcontroller) could be really nice to have in the kitchen, rather than having to fiddle around with either just a phone or what would end up being a tablet bolted to a wall.
Note that this was for controlling the audio system only; this predates integrated "infotainment" center stacks.
> Having bashed the interface, the way this jet displays information to you is incredible. The sheer amount of situational awareness I gain from this aircraft and its displays is like nothing I’ve experienced before. The off-boresight helmet is much more accurate than legacy JHMCS systems and I find it clearer to read (although I still want a wide-angle HUD for flight and fight-critical data!). About the only thing missing from the whole cockpit is the lack of ‘feel’.
The prevailing narrative on HN and elsewhere (that seems to be a US DoD disinfo campaign) is that the JSF is an overpriced, overcomplicated piece of junk. Then there are these murmurs (largely from actual operators) leaking the fact that the aircraft is actually "incredible."
It was difficult enough to find stereo with dedicated volume buttons. The rest of the functionality is via touch. Not a fan. I've never driven a BWM, but I believe they have a knob beside the shifter that allows you to go through the menus.. that feels like a much better system.
When I had a rental Renault that had everything on a touchscreen I thought "cool, looks modern!" when I looked at it stationary. And then totally hated it after 5 minutes of driving because it is so much worse to use on the road than the BMW system with actual buttons and the controller you can use blindly.
With another user interface decision that baffled me... The button to enable cruise control was under the central armrest, and if pressed the wrong way would enable a speed limit instead of cruise. Never seen another brand put cruise control under your right elbow instead of somewhere on the wheel.
MFD = multi-functional display
There's always acronyms in these sort of posts that I get to learn. And probably relevant to this:
> Something that has been lost in all glass cockpits is the tactile feel of pressing buttons and knowing you got a response
As I'm assuming they all went touch screen
Honestly, I'm amazed the buttons around the edge of the screen aren't context aware buttons based off which screen a non-touchscreen display is showing.
This is a common problem for large touch screens, that I've experienced for instance in Tesla's massive displays too. the way around it: always rest part of your hand against something stable, ie in the tesla wrap your pinky around the display and then use your thumb or index finger. For me it increased accuracy from 80% to 99%. This doesn't work if you need to touch the center of the screen, all other parts work great.
What's more infuriating is the lack of a binnacle right in front of you. The older Model S & X have one, but supposedly the upcoming refresh is going to take it away.
At least the F-35 has a helmet mounted display even if no HUD.
I believe Musk's rationale is that when these cars become self driving, there will be no need of a binnacle or even a HUD.
The basic problem of lack of tactile feedback is one you can test easily by trying to type on on an iphone vs. an old school blackberry while riding a roller coaster.
When you have something to brace against, it's just a lot easier to be stable. I'm surprised researchers haven't figured out a way to solve this in a better way (maybe it's a haptic screen that can be reconfigured... the way LED keyboards work)
The 20% error rate the pilot describes seems... like a really really big problem.
In conclusion, it is a meh. So unlike the image portrayed in Top Gun novie.
Drones will also be using it, I think.
Also, the red button on the stick really brings home just how much flying these machine is like a flying a loaded gun.
That's mostly the camera angle. The F/A-18 and F-35 cockpit shows have the camera positioned about where the pilot's head would be (looking straight ahead through the HUD) whereas the Harrier photo has the camera positioned higher looking down into the cockpit.
$1.5 Trillion and counting.
The Harrier :
The F35 :
The Eurofighter (for their short discussion on the voice commands):