Hacker News new | past | comments | ask | show | jobs | submit login
You are not a software engineer (2011) (chrisaitchison.com)
122 points by llambda on Nov 10, 2013 | hide | past | favorite | 127 comments

> If you were building a bridge or a skyscraper and you told me, before you began, that you knew exactly how it would look when it was finished – I would believe you. If you told me that you knew to some insane degree of accuracy how long it would take to get to ‘finished’ – I would believe you again. That’s how Engineers roll

Oh neat, maybe he can explain why the new Bay Bridge was practically a decade over schedule and billions over budget.

Or the Burj Khalifa was about 2 years overdue?

Or the California High Speed rail is projected to be twice the budget they thought, and they've barely broken ground on it?

So the idea that "Real Engineers" building bridges and railroads and skyscrapers get it right in plans and schedule is total bullshit. We've seen larger software projects, with more people working on them than these examples, hit their deadlines (Windows comes to mind -- except Vista).

And by the way, those "Engineering" disciplines have only been around for, what, hundreds, if not thousands of years. What they do for a living is mostly explored territory. Software, at least at a scale to be considered engineering at all, has been around for about 3-4 decades... maybe. And we're still hitting up against major unknowns all the time at every level of the practice, big and small.

edit: grammar

"And we're still hitting up against major unknowns all the time at every level of the practice, big and small."

I was with you until you got to this line. Let's be brutally honest: the limiting factor for most of today's software projects (i.e. CRUD websites and iPhone apps) is not technology. It's developer competency, experience and self-discipline. I'd go so far to say that most working software developers don't even understand the fundamentals of the technologies they're using -- it's why you see people replacing their relational databases for key-value stores, then trying to re-invent database join algorithms from scratch in the application layer. Or why every new generation of "engineers" re-discovers asynchronous programming in a new language (then promptly writes a framework in Blub...because Blub is so much better than last year's Blub.)

Truthfully, it's pretty damned hard to find gigs working on the frontier of technology. Most projects are predictable, tedious slogs to fit together well-understood technologies without shooting yourself in the foot. And yes, requirements shift and clients get fussy, but that's true of any engineering discipline. You learn to pad the schedule to compensate for the shifts. It's part of being a professional.

As far as I can see, commercial software isn't limited by "major unknowns", so much as an industry-wide unwillingness to learn from experience. But hey...that tends to happen in industries when you're considered "old" at 30....

> As far as I can see, commercial software isn't limited by "major unknowns"

I'm sorry, I needed to get in an afternoon run and actually deleted a paragraph that explained this a little more that I couldn't get just right before posting.

I completely agree with you. There aren't a lot of technical unknowns for most things people are trying to do.

Thing is, I wasn't actually talking about technical challenges with that point, rather, the requirements that are given at the beginning of a project. The requirements for the new Bay Bridge, for example, are pretty darn clear: make a new bridge from Oakland to Yerba Buena Island.

The requirements for making G+ attract Facebook users... errr... uhh...

Or how about the requirements for the next Call of Duty to be fun...

A great many of today's software projects -- especially those discussed here on HN -- aren't straight up engineering problems, they're more design and UX problems. Even for something like the software for the Joint Strike Fighter, you're more into UX than hard-hittin' avionics for a lot of it these days.

And I think that's what makes it hard to predict software development schedules. If we were all building ATM software again and again, we'd be knocking it out of the park. A competitor to Snapchat that is able to sway users over... that might be harder to define up front.

Ah man, this hit slightly hard as someone who just moved from Postgres to MongoDB to avoid database migrations only to realize that I've now lost the power of a many to many relationship.

How would one avoid database migrations by switching databases?

MongoDB guys call a "database migration" something like "adding a column to a table". They'll tell you it's an incredibly complex and time consuming thing to so, AND THAT"S WHY YOU NEED MONGO!

Of course out here in the real world, an "alter table" statement takes no time at all even on a large table, and can be done while the system is running.

Now I am not saying that MongoDB has no uses at all; but I am saying that the people around it don't really have much of a clue about databases in general and aren't in any sort of a position to be choosing technologies.

Could you please explain to me what you dislike about MongoDB?

I downvoted you before I realized that you coming at this from a position of ignorance rather than ego.

Mongo is a way of storing 'stuff'. You don't have to define the form that the stuff takes before you shove it in the database. This makes things easier by lowering the knowledge barrier to getting started, which is a double-edged sword.

What I've gathered is that the tradeoff of not having to deal with schema migrations now is something I'll have to pay for with data integrity down the road. Do you think that's a good summation?

Yes, that's an excellent way of putting it.

Right. Thanks for the help. I'm gonna move back to Postgres.

MongoDB is schemaless, so you don't have to do traditional migrations. Unless you're making a joke about me migrating to a different database to avoid migrations, in which case, good joke.

An undocumented and unvalidated schema, you mean. A database without a schema is a contradiction in terms.

Depends how you define database. Perhaps it's more precise to say that Mongo is a schemaless key-value store, but in truth it provides many functions that people think of as a "database", and the differences between it and traditional RDBMS seem inessential to what distinguishes a database from other things.

My apologies, the official documentation referred to MongoDB as "schemaless" so I figured it was a real thing.

You aren't wrong, MongoDB is schemaless in the sense that you don't need to define a schema to use Mongo. But to use any datastore, you'll be defining a schema somewhere - generally, in your app itself.

Migrations are about data, not schema. You don't need migrations with a "schemaless" database at the beginning, but as soon as you have data you care about, you're gonna need to ensure some sort of consistency.

Do you think I should move back to Postgres? If so, why? Genuinely looking for well backed technically minded opinions here.

I think you should learn the relational model (not SQL). Understand the problems it was trying to solve and how the relational model solves them. Then figure out how that applies to your app. Database in Depth was helpful for me http://www.amazon.com/Database-Depth-Relational-Theory-Pract... .

Yes, you should move back to Postgres. The reason is you can do many more operations on structured data than on structure-less data. You found that out already with the many-to-many thing. There are plenty of other intangibles that will bite you in the ass later.

Wouldn't you look for better migration tooling rather than jumping technology?

As far as I know, the best migration tool for SQLAlchemy is Alembic, and it can't magically handle migrations (which is what I wanted). I jumped technology because it seemed like MongoDB did (and still does) meet my use case better. I'm open to any opinions or advice though.

Granted, most engineers are not exactly employing quantum physics to parking lot design. Most people, in general, work on gluing together pre-built parts that they do not understand all of the fundamentals of.

"Real" engineering has the commonality with software engineering that many projects are quite similar to previous projects and are thus fairly predictable. (This is true also of safety factors; I read a good book on it not too long ago[0]).

A bog ordinary 12 story building will probably come in close to schedule and budget because it's a well-understood problem domain and there is a large pool of existing examples to draw data from.

But the Burj Khalifa required solving some genuinely novel problems, of the sort which only turn up at that scale. When a project involves substantial R&D, schedules become much less certain.

If my business is churning out Wordpress brochureware, I can give a pretty good estimate of how long a given job will take and how much it costs.

If on the other hand my customers require me to develop novel, publishable algorithms, then any estimate I give will need to have very wide bands.

[0] http://chester.id.au/2013/07/07/review-to-engineer-is-human-...

I agree with you that the author of this article doesn't know much about how engineering projects really get done, but I have to disagree with your claim that software engineering has only been around for "3-4 decades... maybe". In the 1960s, IBM was building its OS/360 operating system, the massive project that inspired Brooks' famous book The Mythical Man Month. The Multics operating system (which inspired Unix with ideas like a hierarchical file system and an OS written a high level language) was started in 1964. Lisp, Algol and Fortran were all implemented in the 1950s. So software engineering has been around for at least 6 decades.

You are correct, but I would point out that this does not detract from the argument considering the time scale. Software engineering could be 150 years old, and still not have the close to the history of traditional engineering.

Still, you'd think that after three generations of programming, we'd wouldn't have to constantly re-learn such basic lessons as:

- Accumulation of technical debt is bad.

- The latest trendy programming language won't make your hard problem all that much easier to solve.

- A complex system can't be properly integrated and tested in two weeks (as recent news reports have shown).

- The CEO setting an arbitrary deadline doesn't magically alter the laws of physics.

> Accumulation of technical debt is bad.

Is it always? In dollar amounts, I really do not know that it always is. "Don't let the perfect be the enemy of the good" and all. As a developer, I am always going to be the one push for better tests, more efficient systems, etc. but pg's post a month or two ago about scaling without automation (very rough paraphrasing) points to the fact that this does not always hold.

> The latest trendy programming language won't make your hard problem all that much easier to solve.

Maybe not the latest, but I would think that it was way easier to develop a desktop app in C++ than Fortran, develop a website in PHP than C++, develop a web app in Ruby than PHP, etc. Tech definitely improves over time. Jumping on every third bandwagon seems to be worthwhile.

> A complex system can't be properly integrated and tested in two weeks (as recent news reports have shown).

> The CEO setting an arbitrary deadline doesn't magically alter the laws of physics.

These are not engineering problems, but political/administration problems that have been around forever and in every endeavor. I am certain that stone masons building cathedrals dealt with the same sorts of incompetent management, despite a dedication to craftsmanship and engineering.

Technical debt, just like traditional debt is fine, as long as you understand what you are getting yourself into

Mortgages are debt, are they bad?

> Mortgages are debt, are they bad?

Yes. Yes they are. Many people make a huge bet on the housing market with borrowed money, without even realizing what they're doing.

See where I said "as long as you understand what you are getting yourself into"

We don't have three generations of programming, really.

The majority of people involved in making decisions and programming right now haven't been doing this professionally for 30+ years. And for those who have (I'm closing in on 20), the culture that they grew up in was not shaped by people with experience programming.

The examples of "programming" and "lessons" from IBM/etc in the 1960s hardly affected anyone outside of those few small teams with respect to learning lessons re: software development.

IMO, "modern" development didn't really start until the early-mid 90s, when networking really started to take off at the small business and consumer level. This has meant that people who'd never dealt with making software decisions before now are - most of the clients that I have who are in their 30s and 40s have had 'website' duties thrown in their laps, and it's just another item on a checklist.

The lessons and timetables are still new to these people - certainly the mentors and bosses they had 15 years ago never had to deal with this stuff, so they were never exposed to it. The last 15-20 years have been huge in terms of businesses getting crash courses in software experience (whether they wanted it or not). It'll be another 15-30 years (imo) before these maxims are taken to heart by organizations when planning, because they'll have had 2-3 generations of institutional successes and failures to draw on. MOST orgs don't have that yet.

I'm pretty sure that the kind of engineering that designs circuits to do things in hardware that you'd normally do in software can't be that much different than writing software. A title that I find more ridiculous than software engineer is software architect. Architects are partly like engineers, but they also design things to look pretty while serving their function. Making software look pretty on the inside is utterly pointless, because users only see what the software does, not what the design looks like. Designing software is a lot more like engineering than architecture.

"Or the California High Speed rail is projected to be twice the budget they thought, and they've barely broken ground on it?"

A correction: They've broken no ground on it. An AP article today reports that the "California High-Speed Rail Authority is in escrow on just one parcel of the 370 it needs" for the first 30 miles. http://abclocal.go.com/kabc/story?section=news/state&id=9320...

And the entire effort is in trouble: "Sacramento County Superior Court Judge Michael Kenney ruled that California's high-speed rail authority had violated the letter of the 2008 ballot initiative authorizing $10 billion in bonds for the 500-mile train's construction." http://online.wsj.com/news/articles/SB1000142412788732410820...

I actually agree with the parent comment re: engineering but wanted to make sure that folks didn't think ground had been broken already on California's high speed rail plan. I wasn't sure and had to check myself.

Ah, thanks. I thought they had started building something out near Bakersfield, Modesto, or wherever the heck that thing is going on.

If large scale civil engineering projects were not muddled by politics, contracts, and bidding wars, I imagine that wouldn't be the case.

So in an abstract since, and in a world where engineers are the only ones involved in construction, I understand his point.

Waterfall software design would also probably work if it was not for changing requirements, limited budgets, optimistic estimate push, etc.

> If large scale civil engineering projects were not muddled by politics, contracts, and bidding wars, I imagine that wouldn't be the case.

And software development is never involved in any of that?

While I suspect software is more often plagued by problems I do not see that it is another kind of problems than other forms of engineering.

Like the healthcare website?

>So the idea that "Real Engineers" building bridges and railroads and skyscrapers get it right in plans and schedule is total bullshit.

A few examples do not an argument make. You don't think in the "law of long numbers" sense.

If you did, you'd find out that MOST engineering projects do end on time and budget, and even if they miss, they miss far more gracefully and with extremely better predictability of outcome that MOST software projects.

That you can find some counter-arguments doesn't mean much -- what TFA proposes holds in general, and holds much better than the alternative propositions (that engineering is as fucked or more fucked than software). Of course there will be several counter-examples, it doesn't have to be perfect to be near-perfect compared to software schedulling.

>And by the way, those "Engineering" disciplines have only been around for, what, hundreds, if not thousands of years. What they do for a living is mostly explored territory.

That just reinforces the original posts thesis.

The skyscrapers and bridges that are finished on time and on budget are the ones that have been built before. For physical structures, it makes sense to do the same work again, because then you have two bridges or two skyscrapers instead of only one. People can live in two different locations, and they can cross yet another river, which is useful.

For software, if you need another copy, that's a trivial task. It's more on schedule and budget than any skyscraper or bridge could ever hope to be. Once built, we can use it everywhere. The only thing that requires any real effort, is building that very first skyscraper.

I agree with you. My post was only really trying to promote Agile over Waterfall. Never intended for it to be taken so literally. I hope people enjoy reading it regardless.

It certainly makes for good HN discussion fodder :)

FWIW, I've had the "Real Engineering" discussion before -- way more in depth than you illustrated here. My grandparent response above is probably a bit of pent-upness towards those discussions more than anything about your article in particular.

I come from a civil engineering background. The problems you cite are not engineering problems - they're management problems. In the environments I've worked in, heads would have rolled for the over-runs/over-dues you mention. We call these NFE situations.

BTW - thank you for mentioning (indirectly) that civil engineering is the world's oldest profession. ;-)

The author didn't say that every engineering project was perfect — only that he would believe an engineer if they gave him a very specific estimate.

It's a slightly flowery (haha) way of putting it, but I agree whole-heartedly. I recently held a talk at a Python conference and I asked the question: degrees and job titles aside, are we scientists, engineers, artists or a combination of all of these. The overwhelming response was "all of the above".

My preferred term is "artisan". A software developer is applying techniques acquired primarily through experience, supplemented by training and outside knowledge. The artisan has a clear vision of the end result in high-level strokes, but the actual process and implementation is strongly dictated by experience and intuition.

Obviously there are different branches of software developer that have more characteristics of engineering, others of science, but I would hazard to guess that 80% of software development is essentially a guided artistic process.

You should have said to them: 'you're only f* programmers'. Just as a joke. As a software engineer (?), I am quite fed up with people in their early 20s calling themselves 'architects', 'artist', etc.

You're not a scientist, and not an artist. Being a scientist and a programmer is extremely different because of a simple, seemingly minor thing: the lenght of the feedback loop. As a programmer, your feedback loop is sometimes an hour, sometimes a few minutes, sometimes a second (IntelliSense/other IDE help), sometimes weeks. But for scientist, it's sometimes forever. So it's for very different personalities.

Heh, well I actually say "developer", because "artisan" sounds douchey, "engineer" is (imo) incorrect and "programmer" tends to be a very narrowly defined role. Design and operational sides of a "developer" are not really adequately covered by "programmer".

But that's semantics really. We're talking about what sort of techniques do you employ. It doesn't really help to say that programmers use "programming" techniques because it says nothing about the common attributes with other industries / professions.

Which is where "artisan" comes in. A good developer is, IMO, more like an great chef - excellent technique, a wealth of experience across many disciplines and the best tools are the (ahem) recipe for success, not "good process".

I think "Process Implementer" is best. I can see both a mathematics and engineering of processes. Processes instead of computer, because it is more general and applicable to fields like biology.

Also computer science might be the worst -- there is zero science in CS. Science has to do with nature![0]

[0] R. Feyman: http://www.youtube.com/watch?v=lL4wg6ZAFIM

There is a lot of overlap between CS and Physics. For one example: http://en.wikipedia.org/wiki/Digital_physics

That makes very little sense. I'm not saying all developers are scientists but the length of the feedback loop as absolutely nothing to do with the scientific method, which is the only real defining character of a scientist.

Unfortunately "programmer" has come to be synonomous with "fancy typist" by the people who pay the bills. "Engineer", "architect", and "developer" all imply someone who codes with a focus on X, whether it be low level reliability, high level design for scalability, or general competence and requirements gathering skills.

Like in most professions, there are multiple feedback loops of varying length. A lot of the accidental complexity in each profession arises from the shearing effect between the different loops.

No that's not right. I would rather state software developers are not scientists since they don't have to conform to a scientific peer review process (journals etc.). (Please don't come with code review as peer review... just don't).

Just the same software developers are not engineers since they don't have to uphold an industry certification process nor are they held to public safety and ethic standards.

I disagree for two reasons:

First, software engineers exist in a broader culture. The connotations of the various words in our respective languages are not in our control. "Engineer" and "gardener" have very different connotations. In a profession that sometimes struggles to gain respect, it would not behoove us to use a term that (wrongly in my opinion) is associated with lower social and professional status. If we could rewrite the English language and define "gardener" as a person with rare, hard-to-learn, and highly valuable skills, then perhaps we would do well to embrace the term "software gardener." But we can't.[1]

Second, software is engineering. This article seems to define engineering as Big Design Up Front. While that may describe part of what engineering can entail, it's not a complete or general description. If I had to describe engineering generally, I'd say it has to do with understanding and manipulating complex systems, analyzing and fulfilling requirements, distilling vague notions to concrete implementations, and building things that work. Software fits all of that.

[1] As I hinted above, I don't think it's fair, right, or accurate to denigrate actual gardeners as compared to software engineers. I'm stating the way most people perceive social status, not the way I'd like them to.

In August 1991 during the S&L recession and fresh out of Vocational School, I landed my first CAD jockey job drawing fabrication plans for a precast prestressed concrete manufacturer. The first task, after running Diazos and learning that neckties would become caught in the feed and where the reverse button was by feel as my face was pressed to the top of the machine and my air supply was rapidly constricting was drawing plans for a series of double tee members [TT]. It took a couple of weeks to generate the 100 odd variations and get them through the QA process, but then I moved on to other things.

But come October, they started to roll off the line...20+ kips of concrete a pop and then stacked three high. To this day, the sensation is fresh; "So that's what the fuck it really looks like."

The reason it's fresh is because it returns every time I am in the presence of some lines I put on paper manifested.

The picture of the bridge is not the bridge. The engineer, like the hacker, has better intuitions regarding the way in which the picture will correspond to its instantiation - but it is still no more than a [hopefully] informed intuition.[1]

[1] The idea that there is an Engineer rather than a thousand authors of a successful bridge tends to be a bit absurd in modern construction practice. Such heroics are still far more likely in software development.

I was hoping that a more substantial point was going to be made than this piece of fluff. Here is the substantial point.

If you're building a skyscraper or a bridge, an engineer has to sign off on the design. If the design subsequently proves to be defective, said engineer is personally liable. In many places, calling yourself an engineer when you are not licensed to sign off on designs and be liable in this way is against the law.

We can debate whether or not extending this principle to software development is a good idea. What we can't debate is that software development does not currently work this way. You, the software developer, are not an engineer. If you think a design is bad, you do not have both the legal authority and responsibility to stand up, declare it so, and force the design to be changed to something saner.

But saying you're not an engineer because software projects don't succeed like projects done by real engineers - that's both silly and wrong.

It has already been extended into software development. Plenty of software projects have to be signed off in aerospace, automotive, telecoms, energy and defense. In fact I'd be amazed if it did not extend into consumer electronics in large companies, e.g. Apple et al cannot risk bricking millions of phones with a bad update. The point might be that there are thousands of badly run projects, just as there are in construction.

There have been rumblings over the past decade or two about quantifying a practice and study aimed towards turning software engineering into a capital-e Engineering discipline, but evidently they never really go anywhere.

That's what makes it a stupid point: it depends on a specific definition of engineer that is not used (and is not possible to use) with software engineering, and that definition is oriented around chartering/certification of the professional themselves.

That he buttons the essay up in such a self-serving way is just icing: taking "engineering" too literally for the context, then calling himself a gardener.


I wish we took the engineering metaphor more seriously. In particular, I'd like to see some real consequences for malpractice on the part of practitioners -- this would help us in our struggles with management to get projects done successfully.

I've seen so many cases, for instance, where people screw up simple things, such as generating primary keys, and keep making the same mistakes over and over again. This has got to stop.

> In particular, I'd like to see some real consequences for malpractice on the part of practitioners

I agree as long as we also see some of the benefits - required registration with a professional body - along with a requirement that certain projects cannot use uncertified practitioners (in other words, better pay for Software Engineers).

And worse pay for people who can't get certified for some reason.

As someone who lives in the mecca of the oil and gas industry and is thus around a lot of engineers--chemical engineers, civil engineers, mechanical engineers, and more--I can tell you that trying to argue too passionately about what constitutes an "engineer" is futile at this point. Engineers do everything from physically working on an oil rig to somewhat abstract economic analysis at a desk all day.

The only legitimate argument I can find regarding the use of the word "engineer" is that there are actual engineering licenses that can be obtained. But if we said that you had to have such a license to be called an engineer, that would screw up the naming conventions in a ton of industries.

The fact that the feedback loop of a software engineering process is much tighter and cheaper than that of civil engineering does not mean that it is not engineering - that's a fallacy.

Perhaps it's less applicable to civil engineers, because of the scale and safety requirements of their profession, but let's look at electrical engineering. An electrical engineer will build prototypes; they will build models; they will use computer simulations to predict how systems will behave; they will build testing and QA infrastructure. It's definitely harder to iterate—once you've built a million widgets, shifting circuits around is going to be expensive—but it's not qualitatively different to developing a software product.

As in any engineering discipline, software engineers must optimise for a system's required qualities. In some cases, reliability might not be that high up the list. In others—let's say medical systems, or those used in space travel—software engineers have rigorous systems in place to ensure quality, and in many cases substantial up-front planning and certification will be involved.

Ultimately this seems to say that software engineering is different from (specifically) civil engineering. I think that's broadly rather true – the nature of civil is such that generally there are stringent safety requirements, and indeed massive costs involved in making subsequent changes. The majority of software does not have the same requirements, and so it's no surprise that the process is somewhat different. And I agree that not all development is engineering, of course, but to dismiss the entire field is a bit of a shallow argument.

I disagree. When I code for my own amusement I might see myself as an artist but when I do professional work I definitely want to see myself as an engineer as well as a craftsman.

To me it feels as if we are just at a very early stage. It takes huge amounts of time to learn software engineering, putting aside mastering it and humans haven't been practicing for very long. So I'd guess that we're just clueless enough to not be able to feel like engineers yet. We learn most of our practical abilities from experience so thats an argument for craft, but once we get a better understanding of what we are actually doing, and formalize it, our job will probably be very engineery. There is just millions of problem domains and no formal education on the domain of writing software yet (no a CS degree is not it). And I think there is a class of applications that are already so well understood that they do get developed in an engineering fashion already.

I grow tired of the endless comparisons of software development with some other practice, profession, or physical process.

All analogies eventually break down if you take them too far. (If they didn't then you wouldn't be comparing something to something else; you'd be comparing something with itself.) But software development is so different from so many other practices and processes that most comparisons to gardening, building, finances, etc. don't provide much real value.

Its especially tiresome when it's claimed that "sofware isn't like that, it's like THIS". In the article, I find that neither gardening nor engineering is an especially enlightning analogy to software development.

I just checked my diploma, it says my title is 'Engineer' (studied computer science).

I have to agree strongly with this. It's like a professional trainer calling themselves a professor just because they teach. You are an engineer if your diploma says so. It is an earned title, not a job description. I say this as a CS dropout that never calls myself an engineer.

Engineering is about process, not about degrees. My CS degree did not at ALL prepare me to be a software engineer. It taught be to be a programmer. Engineering is more about the process than the technology. CS teaches theory and technology.

100% agrees, I didn't say I didn't do engineering, I just don't call myself an engineer. Ironically, I do call myself a programmer though, and I don't need a degree to do that. The state of CS degrees is a whole other topic, which from the sound of it we agree upon so far. Maybe I just can't call myself a scientist ;)

This doesn't contribute anything. You're missing the important question "what is engineering?".

Saying it's just "whatever engineers do" is meaningless.


"Engineering is the application of scientific, economic, social, and practical knowledge in order to design, build, and maintain structures, machines, devices, systems, materials and processes. It may encompass using insights to conceive, model and scale an appropriate solution to a problem or objective. The discipline of engineering is extremely broad, and encompasses a range of more specialized fields of engineering, each with a more specific emphasis on particular areas of technology and types of application."

Application of scientific/practical knowledge: check. Design, build and maintain systems/processes, check. Using insights to conceive, model and scale a solution to a problem, check.

Sorry, but this is just a nonsense discussion imho. Stop devaluating your own grade.

I only objected to you defining engineering as "what an engineer does". It does not devalue the profession to challenge that assertion.

Engineering is a philosophy. First principles applied to real-world problems.

I'm not a Civil Engineer. So what? What does a Civil Engineer have in common with an Electrical Engineer or a Chemical Engineer? Very little day-to-day.

Or an Engineer on an oil rig? They'd laugh that Engineering means getting it right every time.

I can also tell you a Civil Engineer has very different problems if you're building a skyscraper in Asia, somewhere waterlogged, as opposed to somewhere geotechnically active. If you picked up your average skyscraper and dropped it in New Zealand, you'll have problems. Saying the techniques are the same is a gross generalisation.

I would like to see him “growing” a database or a compiler, perhaps a firmware for a car or the CAD software used by the architect to design a skyscraper.

This is basically wrong, because it compares designing software with constructing skyscrapers. But engineers don't construct skyscrapers, they design them. And designing software shares many, many similarities with designing skyscrapers.

I agree with the author though, that part of the problem is using engineering as a metaphor (at least, I agree up to the point where he just replaces it with his own, equally bad, metaphor). Software development is not like engineering, it is engineering, and the actual practice of it is as different from civil engineering, mechanical engineering, electrical engineering, chemical engineering or any other branch of engineering as those fields are from each other. None of those, by the way, bear even a passing resemblance to the description of 'engineering' contained in the post.

So yes, let's quit with the metaphors. Instead, let's talk about what engineers actually do, which is design: http://www.zerobanana.com/essays/reclaiming-software-enginee...

That is actually also wrong.

Its rather a case of each engineering profession is a regulated industry with an accreditation body, that certifies you as an engineer. Mechanical, electrical, electronic, chemical, industrial, civil, all have standards organisations, usually different ones in each country.

See IEEE for instance...

Also the engineer term is a protected designation in many countries, just as doctor and laywer is...

So no. engineers aren't guys that design stuff, and until the software industry is as regulated as the rest of the engineering industries are, software engineer is the wrong term. The only people who can call themselves software engineers perhaps is working in the medical device, avionics software etc. industries.

At least in the US (which has the largest software industry of anywhere in the world), the title of engineer is not regulated. Only the title "Professional Engineer" is regulated. Accreditation for engineers only applies to areas that have an impact on public safety. This means that civil engineers usually are accredited, but mechanical and electrical engineers usually aren't. So for people located in the US, it is perfectly appropriate to refer to someone as a software engineer.

Please don't find this reply condescending :D But Americans also call their train operators "engineers"...

I don't find that condescending. What I do find condescending is attempting to apply the laws of certain countries to the world as a whole. There are, in fact, many jurisdictions where being an engineer does not require any form of accreditation. The fact that some jurisdictions do require accreditation does not give engineers in other jurisdictions any less claim to the title.

Where did I do that? You were the one highlighting America as having the biggest software industry...

The part where you claimed that only people who are officially accredited are engineers. People who live and work somewhere without such accreditation are completely justified in calling themselves engineers without being accredited.

My apologies then, I was not trying to force my viewpoint, I only shared it. Just as I don't believe anyone who's read Gray's anatomy (the book) can or should call themselves a doctor, just the same I don't believe anyone writing code should call themselves an engineer...

So, according to your viewpoint, there were no doctor's in the US until the late 1800's?

You'll have to provide a bit more context for me.

But again comparing modern day professions to the 19th century equivalent does not bode well for your argument. If you'd prefer the medical industry return to its standards and practices of the 19th century, your welcome to visit such a doctor.

I prefer my modern day certified medical professional.

The late 1800's is when doctors were first licensed in the US. Before that doctors practiced medicine but were not licensed, yet they were still doctors. Official licensing undoubtedly raises the quality of doctor's practicing medicine, but it is not an inherent quality of being a doctor. In most places, someone is not allowed to practice medicine without a license, but in places without medical licensing, someone who practices medicine without a license is still a doctor.

Engineering is the same. Licensing most likely raises the quality of engineers, but that does not mean an unlicensed person who does the job of an engineer is not an engineer.

Pray do tell where in the world is an unlicensed medical practitioner called a docter?

My point being, in this day and age, to call yourself a docter, you must be licensed. Bringing up history does nothing to change that fact. I would state that should also apply for engineers, and already does in most countries.

Merely the fact that train drivers are called engineers in the US proves my point. It dilutes the term to be basically meaningless.

Train drivers being called engineers has nothing to do with this. It is simply a coincidence that they happen to have the same name. They are sometimes called "engineers" but what they do is never called "engineering". No one thinks that the two jobs are the same thing any more than they think that an academic doctor is the same thing as a medical doctor. With software engineers, that is not the case. There is a great deal of academic study in the field of "software engineering".

There are, in fact, many places where engineer is not a protected title and to claim otherwise is just wrong. Many large countries like the US, UK and France do not restrict the use of the title engineer. They only restrict something like "Professional Engineer" or "Chartered Engineer".

It has everything to do with it. Just as much as you are saying what train drivers does has nothing to do with engineering, just the same I am saying writing javascript also has nothing to do with engineering...

There is a great deal of academic study in the field of "software engineering". That I agree with, but that academic research is being done by degree'd people, either with computer science or computer engineering degrees. Even still they don't practice engineering, they are researchers or scientist. Much like in the other engineering professions, scientists study and advance the engineering fields.

They only restrict something like "Professional Engineer" or "Chartered Engineer". Ok that I agree with, but I restate, writing code does not make you an engineer, anymore than performing an operation makes me a doctor. Being board certified, makes you a docter. Same with engineering.

Can we agree that any definition of "engineer" that excludes Filippo Brunelleschi or Leonardo da Vinci (as yours does) is worthless?

Thats a bit of a random litmus test ;D

I would hope we would have gone a bit further than the Renaissance era in how we define professional fields. Would you also call Leonardo da Vinci a doctor, since he did breakthrough anatomical work?

In that same vein, would you call a random person digging up graves and dissecting corpses a doctor today? Would you let them operate on you?

Leonardo da Vinci wasn't a doctor because he didn't practice medicine. He studied corpses; he didn't operate on living humans. On the other hand, it would be ludicrous to say that Hippocrates wasn't a doctor.

I wouldn't let either operate on me, but I also wouldn't let a licensed doctor from 1920 operate on me either. Modern doctors have vastly superior medical knowledge compared to historical doctors, but that doesn't mean that historical people who practiced medicine aren't doctors.

So let me get this straight. You guys insist on using the definition of the word engineer as stated in the renaissance era, not the modern definition, but also then want to apply that definition to software, which didn't exist for another 400 years afterward?

Me thinks the logic isn't quite sound...

There is nothing random about it, the term was invented during the Renaissance to describe exactly such people.

I admit that I like the cachet that goes with the title "Engineer".

I have no interest in worshiping the "real" engineers with their protocols and whatever. An engineer is qualified to build a bridge because they know how to build a bridge. Their professional ethics and protocols are secondary. And we certainly have ethics of our own, even if it isn't codified and we don't wear special rings.

Bleh... Can we just stop with the metaphors already? Maybe I'm not an engineer or a gardner or a scientist but maybe I am. I can be all of those things or none of them. I know how to make software of varying types and that's enough, how I apply those skills is a completely different thing. Maybe I'm a biologist using python to help see the migration patterns of fish better. Maybe I'm a web developer building highly scalable web systems in java. Maybe I'm writing drivers at a kernel level. It doesn't matter, programming is a skill set not a job definition. Engineers aren't just Engineers. They are Mechanical Engineers, Electrical Engineers, etc.. Scientists are just Scientists, they are Biologists, Chemists, and Computer Scientists. When we want programming/software development to have that same level of social standing we will use programming as a skill set not a job title.

Changing requirements and development landscape do not an analogy to a gardener make.

I do not 'grow' nor 'tend' code, trusting some unknown universal force to keep me on the right path.

I engineer buildings, bridges, roads, tunnels - all sorts. Sometimes they're very small and sometimes they're very large but they're all subject to the forces pushing and pulling on them - my job is to build them and keep them upright as well as I can subject to the laws and constraints of the environment.

I am not a gardener. I am an engineer building, modifying, and destroying complex structures daily in a controlled dance so as to keep their superstructure useful and safe.

Only to the naive eye could such complexity be reduced to such apparent simplicity.

To me, engineering is about solving problems, it's about taking systematic analytical approach to whatever problem arise. It is a state of mind, and that is why engineering now covers everything from software to biochemistry.

The part of this metaphor that I really like is how a garden is always changing. Unlike a bridge or a building, software doesn't stand in isolation; it's always relying on other software for something. These other pieces of the system are in constant churn, and your software must change with it. This is even disregarding other factors like changing customer demands. You have to continuously prune and maintain your garden, or the weeds (continuously changing software/hardware/services/etc. environments) will choke out your plants. Software is never "done".

I think the largest error in this analogy is that coding is closer to what the engineer does when designing something - not when building something. I guess construction in software is more like compilation.

Can a civil engineer say exactly how long it will take to design a bridge? No. Might putting more engineers on that project speed it up? Perhaps!

Coding is not so much constructing a program, but more creating detailed descriptions of every aspect of the system's operation for someone else (an interpreter, compiler etc.) to follow, and that is very similar to engineering design.

"Real" projects also know what they want in a year and don't expect the engineer to double the lanes on the bridge because the bridge went viral on social media and now needs to handle twice the traffic.

I'm not going to get into a who has bigger stones pissing contest, but lets just say the expectations and requirements for skyscapers are different than software.

You'd do just as well to call engineers "traffic gardners" who don't know how to make a bridge scale.

Software is more malleable than concrete though.

Engineering is about following best practices based on empirical data/knowledge as much as possible and "winging it" when faced with the unforeseen. Although "winging it" is a bit of a loose statement because generally unforeseen challenges are usually solved based on past experience and quite a bit of lateral thinking.

Therefor in my opinion software development "done properly" has more in common with engineering than gardening. :-)

My take on this. Not to say some people don't 'do' software engineering....but it is still nascent. http://jcooney.net/post/2012/02/27/What-Other-Engineering-Di...

Quite a few people really are software engineers, by qualification and by profession.


That said, Chris has a good point that calling what you do engineering doesn't make you an engineer.

Dismissing all other organizations as worse at "gardening" than Google was a bit offensive.

And the lowest bidder for contracted work often sucks, or finds ways to bill more than the original bid. :)

I said they didn't have the same soil. That would include the multitude of internal tools they use to facilitate their software development, most of which are not publicly available, their culture, and the aptitude of their people.

I personally prefer the term programmer. What I do is program machines to do as I wish.

Gardener fits, but we design the plants in essence....

To me Programmer, developer, even software architect seems closer than gardener.

Op clearly doesn't understand software engineering and automation. Op may be a "software gardener" but some of us build proverbial skyscrapers.

A friend's mother once gave him a handwoven little sign that said "Engineer: faultless, accurate". As programmers we thought it was funny.

So what exactly is the take-away of this piece?

That you should not believe that classic engineering techniques work in software. Also, do not believe that you, as a software developer, know how engineering works in real world. You don't.

Well, the classical engineering domains are all pretty different anyway (electrical, structural, civil, etc). I remember my grandfather saying he thought it was ludicrous that they were all covered by a single qualification.

Building software with an engineering approach is a real thing. Not everyone subscribes to it, but doesn't mean it isn't a real thing.

For the record, I do a lot of gardening too, and building software has fuck all to do with that.

I also don't get how everyone who argues against software-as-engineering talk like buildings and bridges never fall over. They do.

1. We don't need to know how engineering works in real world. You need to be in a domain and work in that domain to acquire that knowledge. Knowing how to calculate stress in civil/structural engineering doesn't mean you are an engineer. You need a job. You need an internship if you were a student.

2. It is quite dumb to assume we build software in the same way that bridge is built. That's essentially what Water Fall method would do. You build the blueprint precisely, build a prototype and then build the actual bridge. I don't see why the author would assume we think we were classical engineer. I never assumed we would be using the same technique all the time.

1. Well, you don't need to, but it's certainly interesting. 2. People assume all the time that software development is engineering. That's what leads to clashes between management and developers; clients not understanding why you can't estimate precisely; neverending projects; etc.

It's a very important thing to understand and explain that software development is _not_ an engineering discipline -- at least not yet. We strive to make it another branch of engineering, that's why we have design patters, methodologies, etc. Engineering is usually boring, but predictable, and that's a very important property software lacks at the moment.

That pretty much sums it up and is in fact quite accurate. Well put!

Prefer Agile software development methodologies over Waterfall.

Software Engineering is an oxymoron.

This is why I became an attorney.

I'm a software hacker that gets paid an engineer's salary.

I use old tools (vim, terminals), like engineers use old tools (protractor, pencil), to make comparatively much larger artifacts (search products, management tools), like engineers (buildings, bridges).

You're not judiciously applying the metaphor. You've only rephrased what it means to be "self-taught"; it goes without saying that we don't allow unlicensed people to engineer things. It also goes without saying that no one lives or dies by a faulty HTTP request header.

I think this [silly] argument is nothing more than a special case of the argument over whether words have inherent meaning, or derive meaning from usage. I don't think 'software engineer' was ever meant to denote a new subtype of engineer. I think 'software engineer' is a compound word that means whatever it is we do. At work, whenever someone says 'get an engineer to look at that', absolutely nobody thinks that means to call one of the 'real' kinds of engineers on the phone. They know it means to get a software developer/programmer/code monkey/dev or whatever you want to call people who make software out of computer code.

It is far more than semantics, the term engineering denotes a rigid adherence to processes and protocols, whereas 90% of people that call themselves "software engineers" are just developers at best - they write code to do what they are told it should do with very little concern for the overall processes involved in an engineering discipline.

It's closer to the British use of the word engineer, which can mean anything from the civil engineer who designed the Channel Tunnel, to the mechanic who repairs the trains. I think I prefer the prescriptive definition, though, it's useful to have a word for someone expected to work with that level of planning and rigour.

This misses my point completely. My point is that the term 'software engineering' is not meant to denote a type of engineering. It may include engineering as a loose metaphor, but the term 'software engineering' stands alone as a word in itself, with its own meaning, and that meaning is obvious to anyone who is or works with software engineers.

More analogies: Should we not have software architecture, because it isn't real architecture? Should we not refer to systems programming, unless the practitioner has studied systems theory? Should we not have windowing systems, because no real windows are involved? Almost everything in computing is termed by metaphor with 'real' things.

I enjoyed the fresh perspective :-) Thanks for sharing

You're welcome. Thanks!

I for one really like the article. Yes it's true engineering projects aren't anywhere near as perfect or on-time as people often given them credit for, but that's exactly the point. People often expect engineering project to fit a agh exile exactly. The article is about changing that perception and dealing with the reality that as an industry we don't estimate very well at all. So we need to change the metaphors to get people to understand more clearly what is I we are doing. And the Gardner metaphors is apt. Great Article!

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact