On: “But didn't you write an embedded OS?”

[gaius]

I am not looking to move right now but I still have a couple of job searches saved from before and everything it seems is data science, machine learning, big data etc now. Even jobs that are very obviously Excel or similar and paying accordingly.

[rjsw → gaius]

It is also difficult to get any funding or interest in what I would call "medium data".

[gaius → rjsw]

I suspect a smart engineer can make the vast majority of big data problems fit in memory by appropriate filtering and pre-processing but you’d never get your purchase order for that 200-node Hadoop cluster approved if you admitted it...

[currymj → gaius]

“It takes a big man to admit his data is small.”

[rspeer → rjsw]

Even though every nearly every enterprise runs on medium data, and can't admit it because that would make them seem inferior to their competitors, who they think have big data.

[gaius → rspeer]

I remember when we used to just call that “data”

[mr_toad → gaius]

Sometimes those terms are added to advertisements to attract people who want to be doing those things, not because they are actual job requirements.

[gaius → mr_toad]

Also known as “bait and switch”.

Most job ads mentioning Haskell and OCaml are really for Java too.