I just checked, and they don't. It's certainly plain looking and without fancy styling/formatting, but they do send content-type text/html. The links and tracking pixel images are why they need HTML, I guess.
There's an account setting somewhere to always send plain text emails and do not send HTML. I don't know where the setting is, I enabled it many years ago. Been happy with that.
Did you actually scroll through all the way? Some emails send both plain text and HTML. I looked through mine and indeed saw text/html for most Amazon emails (including AWS). Some AWS emails like ACM cert renewals were text/plain. Though like someone else said here, you may have changed a setting in your account preferences. The default is still HTML.
They aren’t talking about HTML attachments. HTML email is typically sent as a multipart/alternative email with one text/plain component and one text/html component. An email with attachments is a multipart/mixed email.
Tracking pixel in an email? I thought nobody had done that in decades because major webmail clients pre-cache all images to prevent leaking user IP etc.