Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
Algorithm and Blues: The Tyranny of the Coming Smart-Tech Utopia (stanford.edu)
77 points by raleighm on Aug 16, 2018 | hide | past | favorite | 44 comments


> Most people do not subscribe fully or exclusively to the ideals embedded in the smart-tech utopian vision, yet they’ll have no choice but to live by those ideals.

All too true. The kinds of comment like "but they can just not use X" always appear in the context of Facebook/Google (often when they appear on HN). But that's like saying you should just "not use CCTV". I'm not a user of FB/Google/Smart Tech, it uses me, and when it is deployed pervasively, it becomes by definition, impossible to avoid. I can't stop my friends getting an Alexa / Siri / Google Home thing, so I can't help coming into contact with them.

We can't have it both ways. Making tech / apps / etc addictive or indispensable or "impossible to live without" (once you've had it a few weeks and so do your friends), and then asserting people can "just not use it" is contradiction 101. As a corpus of people, I think we engineers need to look much harder at the world we are building and the constraints / motivators that are causing us to do it.


"Smart speakers" are getting to be everywhere and it really makes me uncomfortable. Like if I book a hotel I now have to remember to check if one is installed so I can unplug/disable it. Or if I'm at someone's house I have to decide if I want to look like a tinfoil wearing loony and ask them to unplug it or just accept that everything I say gets sent to some remote server.


One of the truly sad aspects of this phenomenon is that smart speakers, in principle are totally fucking cool. That's literally Star Trek technology! You have a cheery computer you can boss around! Except now corporate greed had to shit all over it.

It would be one thing if the Alexa was free... but they actually charge for the thing, and they don't even develop their own apps/skills, that's on the community.


> Except now corporate greed had to shit all over it.

One of the big plot holes of the Star Trek universe is that money and bartering would ever go away (they ended up back tracking in a major way on this) or that anything like the Federation would ever be as benevolent or magnanimous as it is portrayed.

That is, I don't think taking corporations or greed out of it will make the tech better. People are people, whether they report to the Minister of Stuff or the Chief Whatever Officer.


Well, it's not exactly a plot hole as it was kinda Roddenberry's vision to show what a positive future for humans would look like. All the while exploring aspects of humanity through interactions with "alien races".

I think it's great to have future utopian stories to tell ourselves.

It's likely we'll end up somewhere in the middle but if we only listen to the bad stuff then that is all we can hope for because we can't imagaine any other state :)

Microsoft actually commissioned a bunch of authors to write some positive short stories about the future in hopes of getting people in a more positive mindset.

It's called Future Visions and you can grab it for free here: https://news.microsoft.com/futurevisions/


Personally I don't see it as a plothole so much as not receiving sufficient backstory justification - or doing so not fitting the genre well.

Like if the earth spent a while as a cyberpunk dystopia and had "ancestors" of Augments who had lesser issues but were used to give the elites a self-perpetuating edge writ large, disregarded space as having no profit, and refused to provide any welfare despite a pitance of their production being required to prevent horrific suffering could give justification for why the federation is so radical on certain issues and why Ferngari would consider Wall Street worthy of pilgrimage - awed that humans of all species once "bested" them. Granted that should probably be regarded with about as foreigners visiting sites of travesties to celebrate them.


Starship Troopers had that sort of thing going on, in the sense that Heinlein portrayed the society of the novel as a militaristic, conservative authoritarian regime born out of economic turmoil of a vaguely sketched past that alluded to predecessors being too laissez faire, sloppy and permissive.

On some level it was a joke shot through with distortions, deliberately inaccurate misinterpretations of history, and willful ignorance among the characters of the xenophobia’s capacity to forge bonds among the ingroup of humans volunteering to accept the burden of fighting outsiders as a gateway to other privileges.

This part is glossed over with the premise of starfleet academy, or the motivating factors that impel characters toward their rank and status. So, we start to see that star trek is something of a cartoon, with “post-scarcity economics” being a deus ex machina for unlimited resources, leading to unlimited technology, leading to unlimited resources, with only a vague line connecting warp drive to first contact with vulcans, which then grants all other technologies for free as originating from alien discoveries.

Anyway, I think we’re pretty close to the idea of robots doing a lot of tedious things for us, if we play our cards right, which means we start to see a lot of things essentially growing on trees. Automatic hamburger machines mean less people slaving away over a hot grill in a low paying fast food chain, which is great, but this premise of automation won’t really save us unless robots can solve the human condition end-to-end.

It means we need a place to stay, clothes to wear, food and water, and something to keep us stimulated and occupied in such a way that we don’t get lonely. All this so that we can go out and find things that keep life interesting, once all our basic needs are met by default. That doesn’t seem to be where all our great inventions are taking us though.

With a harsh light and a strong lens, a lot of consumer oriented inventions do nothing for anyone. Business still seems to aim at bankrupting customers and competitors alike in furtherance of bigger business. Taken to logical conclusions those coziest with successful businesses get taken care of, and it’s near total neglect everywhere else.

But that doesn’t exist in a vaccuum. Really all the most extraordinary inventions have been miitary concepts. Preparing for war makes peace. Maybe that’s the proper inspiration at work here...


The Star Trek universe provided ample backstory to this over various series and several movies: http://memory-alpha.wikia.com/wiki/World_War_III


Also Past Tense[1] for some history prior to WWIII.

[1] https://en.wikipedia.org/wiki/Past_Tense_(Star_Trek:_Deep_Sp...


No, they're not that cool in day-to-day beyond a geeky gimmick, that's the point. Maybe it's cool in dated sci-fi, but not everyone subscribes to the idea of needing a dumb serf to boss around, much less of looking dumb bossing around a cheap circuit built by a cheaper company as if that's cooler than actually knowing your way around technology and keeping a modicum of control in one's life. Maybe I'm old school, I'll go back to vim now.


Okay, so wait a second. Hold it right there. @nerdponx is onto something here. This is really important.

You take your fingers, and take your 100+ key keyboard, and you think about how reliable your structured articulation of codified text syntax can be, when storing files on a file system the UNIX way.

Take that same philosophy, and make that happen with spoken word, and a language that has ~65,000 words. Phrases over text files, spoken through the air, instead of written down, saved and interpretted.

If that were what these speaker/microphone combo systems were about, and they weren’t internet connected, and exclusively piping profitable surveillance data home to some corporate data center to mine for buying habits in aggregate, this would all be very different.

Anyway, the future is fucking stupid, and I hate it. I hope JavaScript bitcoin mining eventually sucks so much accidentally wasted computational energy into some quantum computer with an unterminated while loop, that it conjures a black hole and erases us all.

Just my two cents.


To me it would be more concerning if the Alexa was free. I would always be wondering what the nefarious business model was (data collection, advertising...) Free as in open source would be nice though


> everything I say gets sent to some remote server.

Why do you think everything is recorded and sent to a remote server?


Why don't you think that?


That's a basic instinct of a HN reader. Since it's a blackbox, you have to assume the worst scenario.


It's even more the case in China, where their big tech companies have integrated with the government. Imagine being unable to get a loan without a Facebook account, or being unable to vote without Google.

It's tempting to see these trends and just cut yourself off even further; boycott Big Tech and claim that they don't affect you because you're opting-out. But we're reaching a point where that's not enough, because eventually we won't have the option to opt-out unless we do something about it now.

Instead we have to engage with our society and take action in our democratic channels, to change things before they get to that point.


Well, in the good ol' USA, gov't seems to be increasingly shifting to Twitter these days. That's more than a little disconcerting.


Concerning Facebook and Google specifically, what makes them “impossible to live without”? That would be very surprising considering I (and many others) don’t use them.

Not that I disagree with your overall sentiment.


So yeah, I guess they aren't "impossible" to live with out in the strictest sense. But having lived with them for some years and then going cold turkey becomes impractical to the point of impossible the next time you organise some get together and dont have a way to coordinate with a large group of people. Don't get me wrong, that is a really excellent feature of FB/Google tools, which is what keeps people around in spite of the creepyness.

Like you say, lots of people get by fine without, but is that because you have never really used them so much as to become dependent on them? The world worked without the internet, but try taking it back to that place now and you'd be laughed at!


Why not use email or group SMS for organizing events? You can also use E2EE if needed.

There are viable alternatives to Google and Facebook that don’t require giving up on technology. It’s important for people to realize that.


See the siblings' comment by brundolf. In China they are implementing a system without cash, and with a social credit reputation system, where you have no choice but to use government-approved apps provided by Tencent and Alibaba and others.


This is such a conundrum. When I really sit down and think about all the modern tech in my life, and how much of it is a promise to make my life easier, I can't help but laugh. The modern world is far more complicated and difficult to navigate than ever before. Each new piece of tech just adds to it.

Now we have to know how to navigate healthcare.gov to understand our insurance options, understand email, text, and all other smart phone etiquette. We need to know how to scan our own items at the store, how to use GPS and other touch systems in our vehicles, and know how to use multiple operating systems on computers, tablets, and other devices.

It is never ending! In 20 years, I imagine most engineers and computer scientists won't really be able to understand the scope of all tech we need on a daily basis. Technology will eventually become the equivalent of a magic crystal we carry in our pocket, but have no clue what it's source of power is or how it functions. Technologists will effectively become wizards! Without those wizards, the tech-powered society would crumble into dust.

The author is right that most people will effectively become automatons, mindlessly obeying the little taps and chimes of their tech-addled existence. They wouldn't have a choice of course, unless they are one of the few capable of obtaining a couple masters degrees in STEM.


>The author is right that most people will effectively become automatons, mindlessly obeying the little taps and chimes of their tech-addled existence. They wouldn't have a choice of course, unless they are one of the few capable of obtaining a couple masters degrees in STEM.

A couple of masters degrees in STEM isn't going to save someone from having their serotonin spike when their phone vibrates. Being the blacksmith that forges the shackles doesn't make your wrists impervious to your own creations.


I think it goes even further than that. In my day to day use of my smartphone, even, an iPhone 7, I find the experience largely unpleasant. Even what is essentially just a touch screen computer connected to the internet seems to have all sorts of unpredictable and strange reactions to my inputs. Or it will do something strange without any input at all.

I would argue that the future we have created with technology is still mostly pretty janky - and we give the tech too much credit.


> They wouldn't have a choice of course, unless they are one of the few capable of obtaining a couple masters degrees in STEM.

That's already quite difficult given high specialization in IT. Even if you put hardware aside and take only software engineering, the difference between, say, kernel coding and the so-called "front-end development" is enormous. It literally takes years to master an ecosystem, and the complexity increases steadily just as we speak.


When technology goes well it provides tons of value and becomes invisible. Like the layers in an OS or 1000s of parts in a car for example.

The complaints that life is more complex than before usually fail to compare it to the complexity of things we're accomplishing and what that could have looked like 50,500, 500 0 years ago...

made up example: Communicate with someone on the other side of the planet...

Now: type a message or skype, instantaneous, searchable, recorded backup...

- 50 yrs ago, make an international telephone call. Its unclear, not recorded, difficult to verify(securely) who you're talking with etc.

- 500 yrs ago, write, if you can, on some paper and send it via horses or merchants... who knows if its delivered or if an answer is coming

- 5000 yrs ago. No. You can only talk with people in your village unless you're wealthy, royal or otherwise powerful.


This makes an assumption that there is value from being able to talk to someone on the other side of the planet.

I am not trying to argue that it does or does not. Just that we are operating on that assumption. I could see the counter example that a simpler life could be a more fulfilling.


Clearly there is value to some people, as evidenced by them doing it.


Note that the capabilities introduced by telephone-based technology also presented issues that were seldom entertained by the minds of people. This was also true for the car and horse VS the mere walking traveler.

Telephones/Telegrams allow for quick communication at the cost of guaranteed integrity of the information (in the case of an eavesdropper altering data in transit), at the cost of privacy and at the cost of reliability. None of these issues have to be problems faced by the users but all have the capacity to be introduced by the service providers at leisure or as a byproduct of their foresight.

Telephones, telegrams, cars, horses, houses, boats, schools and governments have all brought with them new forms of dependence -- and people have thus far been able to perform cost-benefit analysis of and bring innovation to these technologies. However, it seems that today more and more people are incapable of coming to true results when performing an analysis on the integrity of today's technologies and service providers, perhaps out of naivety -- and this is likely the product of not understanding the technology well enough to move on, to develop an alternative platform, or to properly govern one's activity on the platform to mitigate perceived risks.


Look at the number of people you can potentially communicate with, and there will be a visible increase in complexity. 5000 years ago it would max out at a few thousand even if you were one of the rare people living in major cities. Now you could instantly communicate with billions and have to take active counter-measures to prevent the ones you don't want to communicate with from doing it.


I think the point at the end of the article is reasonable. But the argument in the middle is a tad silly.

The idea that modern annoyances (sitting in traffic, waiting in checkout lines, searching/browsing for information) are somehow essential to the human experience is super weird given that most of these things have only been around for 50ish years in their current form and less than 1,000 years in any form.

If I didn't have house chores or a commute, then I could spend a lot more time learning new pieces of Mathematics. Or work through the rest of the half-finished anatomy textbook on my bookshelf. Or finally get around to building a digital simulation of a human heart. Or start a garden. Or just hang out with a coffee at the hackerspace or coffee shop or church basement.

There are a lot of opportunities for serendipity, many ways to build grit, and infinite opportunities to socialize.

Sitting on a 1950's style cement highway for 30 minutes to go to a mall where I stand in the 1960's style Macy's checkout line is not the end-all and be-all of what it means to be human. That lifestyle an odd cultural aberration unique to the 20th and early 21st century.

The idea that doing dishes or vacuuming or driving a car in rush hour traffic are necessary to experience serendipity or frustration or boredom is a truly tyrannical vision of what it means to be human.

It's certainly true that we're not headed for a tech utopia (or dystopia), and that new technologies will have unintended and probably negative consequences (in addition to positive consequences).

But I'm not worried about ending commutes or killing the modern grocery shopping experience. Those things are inessential to the human experience and a net drag on society.


>The idea that modern annoyances (sitting in traffic, waiting in checkout lines, searching/browsing for information) are somehow essential to the human experience is super weird given that most of these things have only been around for 50ish years in their current form and less than 1,000 years in any form.

There two ways (at least) that the argument can still be perfectly valid:

1) Recentness or not doesn't matter. Women vote and no slavery/segregation are also recent things that have also "only been around for 50ish years" (or close enough), but one would presumably still consider them essential.

2) The gist of the argument is probably not about those particular annoyances per se, but about having annoyances (or non-optimizations or room for error, etc) in general (all of which are driven away by technology).


Women's suffrage and laws prohibiting slavery are modern but are not modern annoyances.

Your second point is already addressed: learning a new field of mathematics or science can be deeply frustrating and requires grit. The automation of daily chores does not necessitate the death of annoyance or grit.

Just like people still work hard every day even though farming highly automated.


I think you have been a little unfair the the argument cited. The author is not arguing for any of the modern annoyances you list. They are arguing for boredom, tedium, and for serendipity. Why are they arguing for some measure of these things? Let me quote your argumnet again:

>If I didn't have house chores or a commute, then I could spend a lot more time learning new pieces of Mathematics. Or work through the rest of the half-finished anatomy textbook on my bookshelf. Or finally get around to building a digital simulation of a human heart. Or start a garden. Or just hang out with a coffee at the hackerspace or coffee shop or church basement.

> There are a lot of opportunities for serendipity, many ways to build grit, and infinite opportunities to socialize.

Indeed, you would technically have more time to do these things. But you would not necessarily know you want to do them, nor find the time to sit and ponder. Not if every moment has been optimised to speed you through your day and onto the next productive task.

Perhaps, you argue, we would realise such moments are important and build them into the system, leaving patches of "hard reality". But we have already begun the process, and the activities you cite are so far faring badly. Putnam and Murray (Bowling Alone/Coming Apart) have both shown how the last half century has eroded actual participation in the activities we have been freed to do more of. They also show that it is hurting us, particularly anyone who is not bright or rich.

Ultimately, we need both the time to build grit, socialise and be serendipitous, as well as the moments of frustration and boredom which allow our minds to wander to such possibilities.


Your post and my post are both full of hypotheticals, so let's stick to the core empirical claim that could prove you're more correct:

> the activities you cite are so far faring badly. Putnam and Murray (Bowling Alone/Coming Apart)...

There are two problems with Bowling Alone.

1. Bowling is boring; I'd rather grab a cappucino.

Putnam and Murray suppose that the social institutions and conventions of 1910-1940 were a platonic ideal and therefore ignore the myriad of new ways that people socialize and engage in their communities.

To pick just one relevant example, hackerspaces only existed in a few major cities when I became interested in them 10-15 years ago. Now there's at least one in every major city as well as many in smaller communities. But hackerspaces are just an example; there are thousands of other examples of the same phenomenon: popular and thriving community forums that didn't even exist in 1910-1940.

This form of community engagement is the sort of thing that Putnam and Murray completely miss in their analysis because, for them, "community engagement" means regular contact with one of ten or so institutions they happened to have statistics for when they wrote their book.

I spend less time at church potlucks and bowling nights than my grandparents. But then, my grandparents never met friends at coffee shops or hung out at hackerspaces.

2. Far more damning, Putnam and Murray weren't even correct for the tiny subset of community engagement metrics they chose to form their best-selling "darn kids born after 1940" thesis. See e.g., Everett Lad's critique of Bowling Alone.

So not only did new forms of community engagement pop up in response to changing times and interests, but traditional forms of community engagement continued to thrive!


I agree with your contention that the examples of modern annoyances chosen by the author are not hidden pinnacles of humanness to be preserved at all costs.

However, I think the author's deeper point still stands, despite his poor support for the argument.

Can we not agree that the _je ne sais quoi_ of humanness is threatened, on some level, by modernity?

It is a very difficult empirical case to make, as you have made clear with your totally acceptable critique of _Bowling Alone_.

But, in my view, supporting the claim that our "humanness" is under assault is not really where we should be focusing our energies here... It is much more interesting to discuss how we can preserve the "old good" things from our past, while somehow enabling ourselves to take advantage of the "new good" things unlocked by technological progress without being undone in the process.

I'm tired of all these jeremiads bewailing the loss of all that we hold dear, ripped from our grasp by inhuman techno-corporate-behemoths.

Not sure what the roadmap for a more productive discussion is--but perhaps first we must define exactly what it is we valued from our pre-industrial, supposedly unsullied past.

I agree with you that we must be very critical any rose-tinted "back in my day it was better" line of inquiry, but I do believe that there are things worth preserving. Another important question to answer is, why are those things valuable to us? Is it because they titillate our neurons in just the right way? Or is there something more there?

Then we need to figure out how to implement our technological progress in a way that fosters these values, rather than undermining them.

PS: above-mentioned link to Ladd's critique of _Bowling Alone_: https://www.csmonitor.com/1999/0301/p9s1.html


> but I do believe that there are things worth preserving. Another important question to answer is, why are those things valuable to us? Is it because they titillate our neurons in just the right way? Or is there something more there?

The article discusses the fact that there are things beyond happiness that are important to humanity/humans. The author mentions self-determinism ("...a dystopian nightmare wherein humans are reduced to automatons") as well as seredipity and randomness ("...value of searching, browsing, being bored, being lost, failing, missing out, daydreaming, being surprised, going off script...")

My own opinion is that a liberal mindset of the form Wallace discusses in https://en.wikipedia.org/wiki/This_Is_Water is important.

If we leave human rights in-tact and preserve the 40 hour work week (or less), there's no shortage of personal freedom, serendipity, randomness, and wonder to be found in this world. But if these things do not happen naturally, then we'll need to teach them.


The book addresses some of those points. Individual volunteering may be up, for example, but not forms of volunteering that are more community based. Charitable donations require no cooperation with other members of the community, so it is irrelevant.


> Putnam and Murray suppose that the social institutions and conventions of 1910-1940 were a platonic ideal and therefore ignore the myriad of new ways that people socialize and engage in their communities.

Are the new ways the same though? Not all social experiences are equal.

I'd say bowling offers a much richer social experience than getting coffee or going to a hacker space. There is direct competition, there is teamwork, commitment and the comradery that comes with it, there are winner and losers, good days and bad days, etc. With bowling or church you will also be interacting with a much wider range of the community, it's a much less self selecting group.


However, even supposing these congestions are important to human wellbeing, the argument still fails to be compelling because it understates the development of psychological knowledge that would occur alongside the technological development.

Why shouldn't the techno Utopia be able to take advantage of psychological findings to maximize happiness of humans? If the theory about congestion leading to happiness is true and empirically discoverable, then the techno Utopia can take advantage of it to increase happiness by integrating the 'best' kind of congestion possible into the lives of its human constituents.

I personally agree that these congestions are inessential. They are only desirable insofar as they force people who ordinarily "live in the fast lane" to meditate, daydream, and socialize. These are actual essential activities in my opinion. When inefficiencies are removed people will actually have more time to directly focus on these things, rather than having their meditation/social time relegated to periods where they are waiting on something they should not have to.


"There’s more that matters about being human than happiness"

I would go a step further and argue that happiness itself requires that friction, and can't be optimized or quantified. It's human nature to grow discontent and even depressed when given any kind of constancy for too long, no matter how "perfect". The idea that you can use social-engineering to perfect human happiness isn't just incomplete, it's fundamentally broken.


Indeed, you say friction, I'd say contrast, we need frustration to be able to enjoy the ease, discomfort to enjoy comfort, and it goes on for all emotions. Too long in one state, and we're back to the dissatisfaction state.


happiness... can’t be optimized or quantified

Neither of these is true in my experience. Happiness definitely can be optimized by changing your lifestyle (less stressful work, more free time, a healthy diet, regular exercise, adequate sleep, etc). To see it from the other direction, consider how events like onset of chronic pain and permanent disabilities negatively impact long-term happiness.


Obviously happiness can be increased, but it can't be solved. You can't get yourself, much less all of society, to a particular place and just say "welp, that's it, perfect happiness is achieved forever". Not with infinite resources and political power could you do this. It goes against human nature.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: