Hacker News new | comments | show | ask | jobs | submit login
Inadequacy and Modesty (lesserwrong.com)
223 points by JoshTriplett 4 months ago | hide | past | web | favorite | 102 comments

Wow. The section beginning from ”If I had to name the single epistemic feat...” and ending at ”...on modern-day Earth.” might be the most riveting description of finance I’ve read in recent memory. If that series of bullet points doesn’t grab someone’s interest and make them want to engage in the robust hyper-competition of modern capitalism, I’m not sure anything will.

Really, that entire example of price discovery as a demonstrable core competency and focus of humanity is very interesting to think about. This is a great (and cynical) observation, though it’s much more powerfully delivered in the context of the article:

”Our civilization cares about whether Microsoft stock will be priced at $37.70 or $37.75 tomorrow afternoon.”

> ”Our civilization cares about whether Microsoft stock will be priced at $37.70 or $37.75 tomorrow afternoon.”

This is not a good thing. Vastly more effort is being poured into this than is being dedicated to averting climate catastrophe.

In the future, this era will be looked back on as the pinnacle of the grotesque irrationality and chaos of Capitalism, if there's anyone even left to have such thoughts.

Somewhat ironically, if you want less societal resources to be spend on price discovery, you have to make price discovery easier. Ie unleash the full powers of the market via unlimited short selling, exotic derivatives, elimination of the sub penny rule (https://www.chrisstucchio.com/blog/2012/hft_whats_broken.htm...) etc. If less effort can discover prices quicker, there will be less money to be made total, and thus in equilibrium those bright PhDs will rather go and help eg Google sell more ads.

Im not a believer in the efficient market hypothesis. Remember, it's a hypothesis.

Also, The grand central station analogy is just that, an analogy.

Both of these dangerously oversimplify the phenomenon they try to describe. Modern Markets are unfathomably complex systems.

The Efficient market hypothesis is useful as a tool in reaching approximate, generalized, comprehension (ie: for lays and as a peripheral complement for practictioners), but not at all useful in application (some wonderful historical examples out there, study up!).

The fact is that price and markets are not mechanistic. Price has some seemingly objective measures, but those are actually based on projections of future value.

Price is based on collectively determined projections/belief of future value, sure, but this talk of markets becoming more efficient is moot, as we are seeing that, while reacting faster and in more iterations due to transaction efficiency, those don't help us find a 'better' indexable measure of the future value. Furthermore, transactuon costs have lowered, but it's arguable that the diversity of perspectives governing price have been reduced quite drastically.

1) unquestioning belief in efficient market hypothesis is a classic 'confuse the word-concept rose with the actual rose' fallacy. It doesn't work in making actual decisions.

2) price is a subjective gauge of expected future value. As we arent in the future it's impossible to have a more efficient price, since there is no objectivity with which to match.

3) price finding efficiency ≠ transaction efficiency

4) transaction efficiency has improved concurrently with the hyperstandardization of perspective, method and hypercentralization of participation, which has made price-finding of 'financial markets' much less effective as a universal gauge with any bearing on physical markets composed of commercial transactions with merit to anyone other than speculators in abstract 'markets.'

5. Considering all of the above, your argument that improved transaction efficiency is the same as improved price efficiency, and that faster and cheaper transactions will reduce brain-drain seems about as silly as the 'we don't need to worry about babyloniancivilization-induced mass-extinction because singularity.'

The term 'efficient market hypothesis' is a bit of a misnomer in the singular. It's actually a bunch of hypothesis that eg differ in strength. The strongest form, that markets knows everything, is probably wrong. The weakest form, that it's hard work to beat those traders at hedge funds and Goldman Sachs with information you got out of the evening news, is almost certainly true. Exactly which strength in the middle applies in the real world is an empirical question and depends eg on the markets under observation.

In any case, https://www.chrisstucchio.com/blog/2012/hft_whats_broken.htm... makes for some interesting arguments.

Not sure it's necessary? The trend towards index funds will do it.

There's an argument that a lot of money is made by correcting other investor's mistakes. As below-average investors switch to index funds, competition gets tougher among the remainder who are smarter on average.

Yes, the move towards low cost investing is great, too. Sucks out lots of profitability out of the financial industry.

Is it irrational? Unfortunate, perhaps, in a tragedy-of-the-commons sort-of-way (assuming that everyone shares your beliefs and goals), but who is being irrational?

If you make every decision optimally but still end up driving your car off a cliff, there may be something wrong with you definition of rationality.

That doesn’t seem to be a neutrally presented analogy in good faith to the discussion. You can mount a cogent argument that various financial institutions in our culture are suboptimal for a given metric, and you can further posit that those metrics are what we should be optimizing for to achieve some normative imperative.

But those aren’t arguments you made, and as stated your analogy is so hyperbolic and unsubstantiated it feels like you’re only engaging with the topic to forward an ideological disagreement.

It’s not at all self-evident to me that hyper-efficient price discovery in modern capitalism is comparable to optimizing local maxima until you drive off a cliff. I’m willing to be shown why this is the case, but again, those aren’t the arguments you’ve made.

That doesn't seem like an equivalent situation. I'm talking about a tragedy-of-the-commons situation, where an individual has a negligible influence over the climate, and so might rationally go ahead and instead spend his effort on something that he will actually get some benefits from.

This is also something Yudkowsky has something interesting to say about


Summary: LDT is a decision theory that is able to recognise that the decisions of all agents who implement LDT will be correlated. When it makes a decision it knows that it's making the decision for its entire decision-theoretic equivalence class. If it ever decided to knowingly do a thing that is "individually rational" but collectively disastrous, in cases where the personal cost of the disaster outweighs the personal benefits of defecting, then it would be malfunctioning.

I put quotes around "individually rational" because, in light of LDT, CDT is not really rational. It performs worse. It doesn't win.

And, personally, I don't think the old model of decisionmaking was closer to what humans intuitively consider to be sane, effective decisionmaking, I think we had to be taught to be ruthless parasites who can't keep promises, and I hope we can unlearn that now.

Individuals may be acting in their own self-interest, but civilisation is acting irrationally.

One of the roles of government is to impose rules and regulations that steer individual (and corporate) self-interest in directions which are widely agreed to be in the interests of civilisation (like preventing/mitigating climate change) but which would otherwise be ignored or worsened if left to individuals or corporations.

> Individuals may be acting in their own self-interest, but civilisation is acting irrationally.

Yes, individuals acting rationally is just the thing. If we look closely enough at a civilisation or other group of people, it does break apart into individuals. The individuals are the ones who ultimately has the capacity to act, and has goals (a utility function) and knowledge to base their acts upon.

Right, individuals are the point. Local optimization, no matter how well done, may not get you to a global optimum.

Are you sure it is a matter of local versus global optima? Isn't it rather that what you refer to as the global optimum isn't the optimum for the individual actors, and that each individual benefits from deviating from it (at the expense of everyone else)?

This is the tragedy of the commons viewed as an optimization problem. A global optimum provides benefits essentially perpetually, making it more valuable than the local optimums which are arrived at by each actor individually. (It does require extending the time though the actor's descendents.)

Hence the old saw's insistence on "enlightened self interest".

Granted, but it would still seem rational for everyone to prioritize aligning our short- and long-term incentives so that this sort of tragedy doesn't become worse than it has to be.

I mean, maybe you're not optimizing for not driving off a cliff :)

Don't companies participating in hyper-competition only compete for the best products/services/etc. in the eyes of their customers? I mean, companies only get money (investments) if there is promise or results that their product can make money (sales) in a ratio beneficial to the investors. So doesn't everyone win in this case? Not accounting for practices that can arise out of monopolistic tendencies of companies like Amazon or something -- but even then, if competition always exists, isn't the onus on the company to provide the best product for the consumer?

> make them want to engage in the robust hyper-competition of modern capitalism

But the message of that section is exactly that doing so is irrational, given that enormous resources are already deployed on that problem.

Well no, the conclusion was that the available inefficiencies should be just about enough to pay the salary of an average person working in that field. Since salaries in that field tend to be really quite good, it's going to far to say that the argument suggests that this is irrational. Instead, it suggests it would be irrational to expect to be able revolutionize the field or otherwise contribute substantially more than those already practicing.

That's true, and a better statement than mine.

I guess I should rephrase: my point is that Eliezer made what I would consider one of the most compelling pitches I’ve seen for entering finance if you’re looking for high stakes, intellectually gratifying work.

If you've not seen it, you might like this:


Which talks about literally bulldozing mountains for the markets.

> ”Our civilization cares about whether Microsoft stock will be priced at $37.70 or $37.75 tomorrow afternoon.”

i think it is worth noting that MSFT has about 7.72 billion shares outstanding; that $0.05 difference represents $386,000,000 in value. and that total market cap moving around is what matters. the stock could recombine tomorrow so the same $386M movement turned into a $100 swing in stock price, or split so that it became a $0.001 swing.

How much money was made by people specifically selling shiney new financial instruments prior to 2008? How much did the subsequent collapse cost the majority of (first world) humanity?

Explain to me again how powerful and intellectually satisfying the hyper-competition of modern capitalism is, please.

It appears you took my praise of Eliezer’s writing for some endorsement of laissez faire capitalism; allow me to sidestep that argument by reiterating my point more concisely for you. Of the pitches you can make for a career in finance, Eliezer’s is one of the more compelling ones, for people who like intellectual challenges.

I neither endorsed nor condemned a career in finance, nor the ideology of capitalism itself, nor its failings. Please grind your axe elsewhere.

>If that series of bullet points doesn’t grab someone’s interest and make them want to engage in the robust hyper-competition of modern capitalism, I’m not sure anything will.

In that vein, I'm not a stock analyst so when I was young, I didn't "grok" what made investors tick. The stock market seemed incredibly boring. Yes, it could make people millions but as an outsider, the idea of looking at numbers all day to get those millions seemed like a hell on earth existence.

The 1993 book "Market Wizards" by Jack Schwager[1] changed all that and completely opened my eyes. It was the first time I had seen the word "thesis" in regards to picking stocks -- as used in the phrase "investment thesis" by interviewees. It immediately let me map it to physicists playing with equations to see which ones correspond better to reality. Just as discovering explanatory equations is intellectually satisfying, the same nirvana happens when investors discover a flaw in an asset price and get proven correct when they exploit it.

Stock investing is sort of like The Ultimate Game of Cunningham's Law[2] and the XKCD cartoon[3]. The insatiable human urge to "correct" other humans results in millions for investors.

If we on HN/reddit see a person claim that "Apple has a smartphone monopoly", we'd would correct the false statement with "No, Apple only has 17% share and Android has 83%". The reward for our correction is invisible internet points that you can't even buy a stick of gum with.

On the other hand, an investor like Michael Burry[4] will notice that other entities are mispricing mortgage backed securities. His analysis shows that they will default. That's his investment thesis. It contradicts statements from smart people like Alan Greenspan and Ben Bernanke -- both who have PhD in Economics. It contradicts smart guys from Bear Stearns and Lehman Brothers. Even his own limited partners in his hedge fund lose faith and withdraw their investments. The 2008 housing crash proves his thesis was correct and he got $100 million in profit. Yes, it must be incredibly intellectually satisfying to prove everyone else wrong especially when they have the same information he does. He just crunched the numbers differently based on different assumptions. Stock picking is not "boring" to people like them; it's a fun intellectual game. I wish had the disposition to play it.

[1] https://www.amazon.com/Jack-D.-Schwager/e/B000AR7ZM4/

[2] https://en.wikipedia.org/wiki/Ward_Cunningham#Cunningham.27s...

[3] https://xkcd.com/386/

[4] https://en.wikipedia.org/wiki/Michael_Burry#Investment_caree...

> Stock investing is sort of like The Ultimate Game of Cunningham's Law[2] and the XKCD cartoon[3]. The insatiable human urge to "correct" other humans results in millions for investors.

Most (By number) people invest not because they think that market prices are wrong. They invest because it's the only way for someone with limited capital to be an owner, as opposed to a worker.

I'd like to not live under a bridge when I'm 73.

>Most (By number) people invest not because they think that market prices are wrong.

Sure, I understand. My reply was about the bullet points the parent poster highlighted. Instead of long-term retirement savings type of thinking of the average Joe, the bullets from the article were about:

>“Short-term relative pricing of liquid financial assets, like the price of S&P 500 stocks relative to other S&P 500 stocks over the next three months.”

... which attracts physics PhDs, neurologists like Michael Burry, etc.

I have been operating at the intersection of engineering and entrepreneurship for my whole career. Two key traits I notice in entrepreneurs is overwhelming optimism and the ability to take huge risks without batting an eyelash.

Conversely, on the engineering side, my fellow nerds are almost paralyzed by over-thinking things and wondering about what the "experts" say, if a decision is "safe", agonizing over career moves, etc. The result is a safe, careful life with above-average to upper-class income, but avoiding the risks that would lead to super-charged results.

This essay reads to me like the ultimate nerd analysis of why you should never take any risks. Why start a company when every good idea is taken, and MicroApple AmaGooFace can destroy you the moment you get traction? Why buy any stock when the smartest people on the planet already priced it accurately (surely you don't know more than them)? Why do anything outside of mainstream thought at all?

I assume future chapters of his book will address why the rational market hypothesis is incorrect, or why it can be rational to buy AMZN when the market (obviously) knows more than you, but I wanted to comment on this specific post.

The truth is that infinite opportunities exist to make money, make an impact, start something worthwhile. However there is a limited supply of people with the balls (or ovaries) to seize these opportunities and take the necessary risks. So many people settle for the cushy life, handcuffed to the big company.

The risk takers earn the rewards, and even if they fail, the journey to failure almost always leads to meeting tons of people, tons of opportunities, and a future path that leads back to the cushy high-paying job they tried to avoid.

So buy the stock, start the company, assume you know more than the experts, take the risks. You can always go back to the safe life.

The author is not saying that you shouldn't take any risks or disagree with the masses - nearly the opposite. Essentially the article states that while there are some circumstances where it is true that you almost certainly can't 'beat the market' (the stock market being one), one shouldn't believe that if something was a good idea it would have already been done. Apparently in the next chapter he will lay out a framework for identifying the specific areas that are most likely to present these opportunities.

What's beating the market mean to you?

The meme that the s&p's performance +/- is as good as you should expect to do is so bizarre to me. I know where it comes from -- I've read the same stuff about warren buffet's bet and everything else.

After having traded a while myself it's just so hard to believe. I don't think it's axiomatic for people who don't have enough capital to overcome liquidity. I wonder if someone has ever paid a PR firm to perpetuate that idea.

If the PR firm were successful, it would drive more people away from active investing towards index funds, lowering volatility. That would help explain why shorting the VIX has c-c-c-c-clobbered the S&P's performance for a few years. If I start to see news stories about rags to riches stories I'll probably start going long volatility. Haha.

My most successful trades this year have been betting against the consensus. The consensus is hilarious and terrible about a lot of things. I bought shares of a good property/casualty insurance company the friday ahead of irma. It was down like 35% in a month as the news convinced traders florida was going to sink. My theory was that if the storm was as bad as advertised, the stock would move about sideways. If it was anything less than there was money to be made. I was up 20% on the trade by Monday.

In August when North Korea news hype was peaked and missiles were being tested, I shorted the vix hard. I didn't think the panic was sustainable. Because of how much I put on it that was probably my riskiest trade. Made the S&P's YTD twice over in 2 weeks.

In June I saw silver flash crash to 14$ an ounce and that just felt stupidly cheap for such a useful precious metal. Sold it for the S&Ps YTD about a week after. There was no research in this, I was just into hobby jewelry making and thought "hmph that isn't right."

I watch the news pretty regularly and I'm mostly happy to stay uninvested unless I see an opportunity to bet against hype. Then I put about 10-20% of my savings on the hypothesis and I beat the market pretty handily doing that, with less of my cash on the line and everything.

I guess one of these days I'll have so much money my block trades will get me sniped or I'll lose 5x in a row and start investing in the S&P again or something. Haha.

I would define "the market" as the maximally diversified portfolio fitting a given risk profile. If you're limited to large cap US stocks, then yeah, the S&P 500 would be the market. Better to think of a globally diversified portfolio though.

By 'beat the market', I mean have a consistent expectation of outperforming the market by a sufficient amount to justify the effort and risk. Obviously there is a ton of uncertainty, so simply achieving higher returns than a given benchmark is not, for these purposes, beating the market. Unfortunately, that also means it's impossible to ever be 100% sure you have indeed determined a way to beat the market, although obviously the more logical the reasoning behind your approach, and the more evidence of it being successful, the more confident you would be.

So, is this impossible? No. As he even says in the article, the expected equilibrium would be that it's possible to the extent that the professionals engaged in doing it earn just more than they would at their next best alternative. But is it possible to consistently do even better than that, or at significantly less effort? Unlikely. If it were, you would have found the metaphorical 20 dollar bill in the middle of Grand Central Station.

Usually the claim is weaker than "you can't beat the market". It's something like "after fees, the returns of active funds don't beat the market". And AFAIR the claim A Random Walk was even weaker, closer to "even if some funds can beat the market after fees, you have no way of distinguishing them from lucky ones".

From where comes your confidence that you are not "picking up pennies in front of a steamroller"?

I have very little confidence. That's why I stay mostly in cash and largely avoid single company equities. I capture my gains when it feels "early" and I leave a lot of money on the table doing this. All these behaviors come from trying to limit my exposure to the steamroller. The trades I get excited about though are ones that feel like the steamroller has already gone through and may have arrived prematurely.

The S&P gives me even less confidence.

The sector rotation often feels so artificial and controlled. Couple weeks ago when Apple had their keynote and the market reacted badly to it, I noticed bank stocks rising the next day about exactly as much as Apple lost market cap. Just feels like there's a smoothing function running on the S&P right now. If that function has operators then there's an enormous and still growing short opportunity for them to someday turn it off.

For those of us who don't trade, but feel we have something to learn from the type of thinking that leads to these counter-consensus insights - do you have any examples of how this line of thinking has led you wrong, either in trading or other fields?

For me, I associate counter-consensus insights tightly with a lot of cynicism. Having a deeply cynical attitude is isolating. It's hard to trust people to a severity that I'm constantly hyper alert to subtle signals that people are trying to take advantage or mislead me. This has had some false positives and made it hard to form deep, lasting relationships. I deeply treasure the ones I have though. The same attitude makes it hard to accept and be accepted by teams.

As for bad trades. I lost a little betting on a biotech rally last week. I've never had a really catastrophic trade though. I tend to aggressively scale my position with my confidence and that's been an effective shield so far.

> The risk takers earn the rewards, and even if they fail, the journey to failure almost always leads to meeting tons of people, tons of opportunities, and a future path that leads back to the cushy high-paying job they tried to avoid.

At which point, the "safe path" guys are already nearing their early retirement.

> This essay reads to me like the ultimate nerd analysis of why you should never take any risks.

On the contrary, it analyzes in great detail how you can better calibrate your sense for when you should or shouldn't believe you can do better. Which seems like an improvement both over the "you never can" mindset (which you're arguing against and seem to think the article espouses) and the "you always can" mindset.

It's not just about taking risks, it's also about understanding that the big-company oracles which turn over billions of dollars a year do so from ivory towers. Though they may have the numbers on what is happening far from New York or San Francisco, they don't have the eyes, the boots on the ground, or the personal contacts to know everybody locally and their problems which need payment-worthy solutions.

To argue that there are no market opportunities for new businesses is to argue that the world is a problem-free happy place to be in. This is clearly and inherently false. Some problems may require more capital than you currently have access to - which is why investors take meetings with the hopes of being persuaded, and many times, you just have to reduce the scope in order to reduce the amount of capital needed. The only real limits are legal and ethical in nature.

I really appreciate this essay, if just for categorizing a type of argument I've run into multiple times myself. I've often shared ideas with others and found that when ideas cross a certain "weirdness threshold" and are sufficiently deviant from mainstream thought, the "modest epistemology" argument crops up. After all - if weird idea X was so great, it should already exist. I've never had a proper standard response to this sort objection.

Sometimes the key to recognizing something is wrong is the ability to categorize it.

"Weirdness threshold" is probably not the best term here. Similar arguments crop up often in notably non-weird discussions, such as "if women were really paid less for the same work, a company employing only women would have a major competitive advantage."

That's likely to simply flip your current intuitions in favor of investigating more ideas that pass the weirdness threshold. Without considering the specific context of ideas under discussion, I'm not sure that gets you anywhere.

One convenient metric is "how likely is it that someone with the particular knowledge required to think of this also has the problem I do?"

Maybe. But there are two modalities to this:

1) Implementation often takes one clever person with the requisite knowledge and then everybody copies it if it's a good idea. BitTorrent is a good example. Lots of people could have developed BitTorrent or developed something almost like BitTorrent, but Bram Cohen pulled it all together into one neat, usable package. This modality is probably harder to spot as the "Am I actually clever?" question is difficult to answer with good Bayesian priors.

2) Implementation requires someone with an intersection of skills that limits how many people can exist. My last experience getting an EEG is a good example: the individual pieces of EEG equipment are absolutely primitive to any decent electrical engineer and the user interface to the software is horrifically bad (one step up on reading a paper chart strip). Yet, to improve it, you need an intersection of low-noise analog design, UI programing, signal feature detection and extraction, machine learning applicable to signals, and knowledge of how EEG's work and are used for diagnosis. There simply aren't that many people with all of those characteristics that could move the front forward. However, this modality is VERY easy to spot: "Do I have the intersection of skills necessary to be this person?" is a very straightforward question.

“Knowing is half the battle”

When we critique a government, we don’t usually get to see what would actually happen if the government took our advice. But in this one case, less than a month after my exchange with John, the Bank of Japan—under the new leadership of Haruhiko Kuroda, and under unprecedented pressure from recently elected Prime Minister Shinzo Abe, who included monetary policy in his campaign platform—embarked on an attempt to print huge amounts of money, with a stated goal of doubling the Japanese money supply.5

Immediately after, Japan experienced real GDP growth of 2.3%, where the previous trend was for falling RGDP. Their economy was operating that far under capacity due to lack of money.6

Given that Japan has been in a slump for nearly 2 decades and that everything tried before didn't work (including stimulus spending), it's reasonable that there would be skepticism.

The fundamental assumption of the article seemed to be that the Bank Japan's committee are idiots; any further inquiry into why they make the decision they do stops there.

Most bad decisions find their origin in either relying to heavily on ones own thoughts, or not sufficiently trusting them.

Having a good meta-instinct for knowing when to cede to conventional wisdom and when to trust your own instincts is like a superpower. It's standing on the shoulders of giants and then reaching a little further.

Building a strong conceptual foundation around this problem could be really useful.

I found this article convincing. However, I also found Scott Alexander's article about epistemic learned helplessness convincing:


Being epistemically helpless, or at least a bit modest, is a good way for an individual to avoid having false beliefs.

I don't think this advice is good for the society as a whole, though. Encouraging people to be modest, stand in line, and yield to the majority view by default is a pretty good recipe for a society to become biased toward inertia, often in a very oppressive manner. Japan is one example of such a society. They've made impressive economic and technological progress, but their culture and politics are stuck in a weird loop.

The article you linked to also acknowledges that people who are less epistemically helpless are "the only people who can figure out if something basic and unquestionable is wrong, and make this possibility well-known enough that normal people start becoming willing to consider it." Societies need people like this, even though they share some traits with terrorists.

So although overconfidence and an experimental spirit might lead individuals to have more false beliefs and failures in the short term, encouraging them might be more beneficial in the long term on a larger scale. This is something that both authors could agree with.

I don't know whether Eliezer Yudkowsky would actually be willing to go in this direction, since he looks rather preoccupied with ensuring that each individual human (or AI) makes the best decision at any given time; but since I'm sure he wishes the best for the future of our civilization, I look forward to seeing him pay attention to the social and historical consequences of the individual strategies he's been promoting. A horde of smart robots could behave very differently from a single smart robot if they use the wrong consensus algorithm.

That Scott Alexander's "Epistemic learned helplessness" blog post (2013) -- is an excellent generic rebuttal against Eliezer's arguments.

Eliezer's argumentation is bright, inspiring and mostly right. But then Eliezer makes a critical mistake in his reasoning and the overall conclusion is just plain wrong (such as "buy cryogenics").

> That Scott Alexander's "Epistemic learned helplessness" blog post (2013) -- is an excellent generic rebuttal against Eliezer's arguments.

It's a fully general counterargument against anything.

That is a brilliant article.

This is very eloquent but somewhat verbose and rambling in parts. The only solid take aways i pulled from it are:

1. The assumption that if its easy than any one would have done it in some markets is very true but is not a universal maxim.

2. You have to search out the markets where that is less true.

To expand on the station analogy with the $20 bill they mention in the middle of the station where the traffic is highest but what about in the alley behind the station or next to the stand with the new careless employee? Arbitrage isnt just limited to the most trodden popular paths (s&p 500). The context always changes the ebb and flow surrounding arbitrage, whereas you cant fight the raging river and expect to beat it, you may find opportunity in a swirling eddie

It’s not really true. There are real cases where people have radical, obvious insights. Look at history of science and math!

Science and math are a repeating story of civilization-level of knowledge reaching a threshold at which some breakthroughs become easy to figure out, followed by a bunch of smart people making those breakthroughs simultaneously.

I.e. the famous scientists were not that smart - they were just the smartest and therefore first to react to the waterline of knowledge in their domain rising high enough.

What often happens to startups, is they begin with some exciting idea, and having looked into it/tried it, it doesn't pan out, and they "pivot" - sometimes slightly, often wildly.

I'm not sure how common this dynamic is in science and maths. Certainly, as you learn more, your ideas and concepts are inevitably refined. (Like: no plan survives contact with the enemy). But I don't know whether that "refinement" is too subtle to count as a "pivot".

However, serendipity has a storied past in math and science.

LesserWrong? What is its relation to LessWrong? It talks about itself as "LessWrong 2.0". Is that an official statement or a figure of speech?

Edit: This is embarrassing. I had had written "its" as "it's". I need to find a way to do penance.

It seems to be a rewrite of the site that will have LessWrong data migrated to it if things go well: http://lesswrong.com/lw/pfl/lw_20_open_beta_live/

Yunyu's correct. (I'm one of the people on the transition team.)

The market price is based on people's intuition multiplied by the money they control. There are plenty of situations where the majority of the money ends up on the opposite side from the smart bettors. Eventually, in a long enough time frame where agents don't die, yes the smart bettors will control most of the money. But the world is imperfect, there are plenty of fools still with money.

For a somewhat contrary view, there is Richard Feynman and Disregard! [1]

I tend to fundamentally disagree with the notion of this paper. For a reason why let's consider something like quantum mechanics and relativity. Right now relativity and quantum mechanics are incompatible in domains where they intersect. There is an absolutely enormous incentive to reconcile this. The Nobel Prize would be little more than a formality for a discovery of this magnitude. And the best and brightest in the world have been working on this for many decades.

So the implication of this paper is that, thus, you probably shouldn't try to improve the work here. Of course that's nonsensical since it's obviously provably in need of improvement. And there will be some individual, or group of individuals, that manage to succeed here and push humanity that much more forward.

He relies on examples that are not falsifiable. The absence of evidence is not evidence of absence. In particular in his stock market example, he argues that it is operating optimally by little more than an appeal to authority and a lack of contrary evidence. It's like saying that no human will be able to run faster than Usain Bolt since lots of people (and massive supporting teams) are spending their lives trying to do just that (with 0 barriers to entry) and all have failed, so there's no reason to believe any given individual could ever do better. Of course the one thing the olympics shows is that records are set only to be broken.

I suppose it depends on your life view, but I think people should pursue that which interests them - even if an objective analysis would lead them to believe that their chances of meaningful (and who gets to determine that?) success are negligible. And I would take this a step further. Not only should people do this but the entire progression of humanity is contingent on people doing this. The people that make true progress in a field tend to love that field. And their progress is more a consequence of that love than any sort of higher level objective analysis of fields where their best chances of success lay.

Maybe it's best to conclude with a simple counter example. He mentions, repeatedly, you should question yourself if you see a $20 bill laying on the floor in a populated area for hours. And this is supposed to be meaningful. However, instead of relying on a likely very rare outside force (somebody dropping a $20 bill) let's consider something that's an entirely typical and common social phenomena - elevators. How many people have come to a crowded area just outside an elevator, only to find that the problem is that nobody has pushed the button? There's certainly a major incentive to push that button, and there's no barrier to entry other than the arrogance of thinking everybody else might be a bit silly - yet time and again we find nobody pushed the button.

[1] - https://stepsandleaps.wordpress.com/2017/10/17/feynmans-brea...

I don't think the article is arguing that no one should pursue hard problems that have economic incentives to be solved, it is saying that when you are a non-expert, you should defer to popular opinion. There's nothing stopping people from pursing the hard (yet profitable pursuits), the article mentions people who make their livelihoods in these arenas and does not say they are wasting their time.

> He relies on examples that are not falsifiable. The absence of evidence is not evidence of absence. In particular in his stock market example,

The article includes an counter-example, and we all know that they exist. People have bet against the market prices and come out ahead. The article is saying that such an event should not attributed to skill.

> How many people have come to a crowded area just outside an elevator, only to find that the problem is that nobody has pushed the button?

That's easily explained by information cascade: everybody tries to assess the situation calmly, notice no one is doing anything, and conclude nothing shall be done. Eliezer gave the example of smoke under the door (vs a fire alarm): the more people in the room, the less likely they are to act.

The $20 bill is very different: while the area is crowed, each individual is alone, and doesn't expect any attention from bending down and picking up the bill.

> The absence of evidence is not evidence of absence.

Yes it is? http://lesswrong.com/lw/ih/absence_of_evidence_is_evidence_o...

Eliezer, as always, vastly overstates the value of his own intelligence and intelligence in general. I believe this essay is one of the worst he has ever written.

The reasoning on this is correct. The problem is, he is arguing from hilariously inaccurate axioms. For instance, he seems axiomatically convinced that "creating trillions of dollars of value" is an objective good. That is totally fine for people ideologically "all in" to ideologically cooky notions of macroeconomics, which is one of the most intellectually shaky disciplines still in circulation.

Since he seems familiar with the "two economists walking down the street" parable, I will offer him this one:


Two economists were walking down the street one day when they passed two large piles of dog turds.

The first economist said to the other, "I'll pay you $20,000 to eat one of those piles of turds." The second one agrees and chooses one of the piles and eats it. The first economist pays him his $20,000.

Then the second economist says, "I'll pay you $20,000 to eat the other pile of turds." The first one says okay, and eats the turds. The second economist pays him the $20,000.

They resume walking down the street.

After a while, the second economist says, "You know, I don't feel very good. We both have the same amount of money as when we started. The only difference is we've both eaten turds."

The first economist says: "Ah, but you're ignoring the fact that we've engaged in $40,000 worth of trade!"

Disagree with your view of the essay, but your anecdote is interesting. I learned something from analyzing the anecdote with inappropriate sincerity.

Why- of their own free will- would each economist offer $20,000 to eat the turd? There can essentially only be one answer. They value the schadenfreude or sense of power derived from watching their fellow economist eat the turn at greater than $20,000.

Why would each economist eat the turd? They value an extra $20,000 more than they value avoiding the disgust associated with eating the turd.

Long story short, that $40,000 of seemingly destructive trade appears to have improved both their lives according to their own value functions.

This story is a remarkable reductio-ad-absurdum of the Subjective Theory of Value.

No, it isn't. It introduces a non-standard situation where the actors' motivations are hard to model, and results in a non-standard outcome. That doesn't help build the firmer X-free worldmodel that I would count as a refutation of X.

It requires us to posit someone who's money-hungry enough to do something disgusting for a large amount of money and yet who still would spend all of that gain to get some (for-most-people) trivial kick out of seeing someone else do the same.

Well, yes, if two people both had that bizarre preference set, and you fully intuited the implications of that situation, it wouldn't be strange to view it as creation of that much value, because both of them satisfied each other's values.

I don't see how this parable carries more kick than if you cut off the parable halfway through and said, "hah! Someone ate feces for money! That's silly, isn't it?" Yes, bizarre values lead to bizarre outcomes. But then, if that's all you want to prove, then just "go Rule 34" and link some fetish sites.

To the extent that the parable has a valuable lesson, it's "back-and-forth exchange of money for services, if officially canceled out, is a kind of gain in utility that doesn't show up in formal accounting". (E.g. Alice provides romantic satisfaction to Bob, who simultaneously provides romantic satisfaction to Alice. They do not transfer money on net. "We're right where we were before, and didn't create any value." Um, yeah you did.)

Or, if the point is that decisions can be regretted (which you could tweak the Alice/Bob example to include) , sure, but that doesn't shed a lot of light on the Subjective Theory of Value.

It seems abundantly clear to me that humans routinely take actions that are far more irrational than eating a turd for $20,000. There are literally TV shows dedicated to that type of thing.

The whole point is to draw absurdity to the Subjective Theory of Value -- the claim that, if a trade occurs, the trade must be Good, because both participants (with full information!) made a rational (!) calculation that this trade was in their best (!) long-term (!) interests. I find this proposition -- one that rests at the heart of economics -- to be incredibly dangerous and outrageously wrong, but since our entire economy / political system sort of depends on this being true, I don't know what to do about it.

The weird step in the example isn't eating a turd for $20000. It's paying 20000 to see someone eat a turd.

That the thought experiment is badly constructed is clear once you take the money and indirection out of the picture. Does two - clearly somewhat weird - people agreeing to eat a turd if the other person eats a turd, somehow disprove economics?

Clearly for each of the two people it's the case that they get more from watching the other person eat a turd than it costs them to eat one. Maybe they're perverts. Whatever. Value was actually clearly produced.

I was replying to the idea that the parable demonstrates those points for someone who doesn't already agree. (And that's not the SVT you're describing, but the SVT plus some ancillary claims that I agree are flawed -- see the last paragraphs of my other reply.)

I'm curious to pick your brain about this. What is a better concept to describe the idea that "if a trade occurs, it is Good?" I agree STV does contain real insights about the nature of trading, but there's some ideological extrapolation that transforms obviously correct things like marginal diminishing utility to "justifying every trade as it occurs as inexorably good"

See also: http://www.paulgraham.com/wealth.html

You're actually right, I think -- I don't know of a specific (standard) term to describe that fallacy, and every time I've criticized its appearance, I've had to make up a neologism or spell it out expliclity [1]. ("Vulgar Keynesianism" is one term for it, but it's not the only school that does it so it's a fair term for the precice concept.)

In any case, I was just trying to make the point that

a) The turd-trade example does not help the debate about the underlying concepts -- regardless of label -- because it's uses an intuition breaking situation to build intuitions, which is no more insightful than pointing and laughing at people with bizarre preferences.

b) STV is not the same as the thing the parable is criticizing.

[1] Example comment I remember: https://news.ycombinator.com/item?id=12242525#12243088

Man. Thank you so much. "Vulgar Keynesianism" is indeed a very good summary of my central complaint. although it arrives at it from a totally opposite direction. Sidenote: I miss when Paul Krugman was actually good :(.


Ah. Thank you for teaching me that the Subjective Theory of Value is the specific cooky idea I find disastrously wrong in modern economics.

Why do I suspect that this reasoning is circular?

You would do well to check if your beliefs are falsifiable. If you believe that GDP objectively, universally, and precisely maps to real-world value, no thought experiment will disabuse you of that notion.

Are you claiming that "GDP objectively, universally, and precisely maps to real-world value" is non-falsifiable? Unless you reason is that nobody can even tell you what real-world value is, that proposition can easily be falsified.

If you ever observe a trade that changes GDP in a way that does not correspond to the change in real-world value, the belief is shown to be false. Of course that isn't just a thought experiment, you have to actually do the observations.

I said something slightly different; I claimed the commentor's beliefs were potentially unfalsifiable, and then I characterized those beliefs as "GDP mapping objectively etc to real world value"

I bet "GDP mapping objectively etc to real world value" is in fact falsifiable (and false, at least to some extent).

You would have to compare the GDP to some measure that better maps to real world value. And the choice of measure to use would be controversial. HDI? GNH? HPI? GNW?

I agree that GNP is a terrible measure of real world value (a lot of things increase GNP that decrease human well-being on a global or long-term scale). But if you want to falsify it, you need some other measure. Is the other measure falsifiable?

If this is one of his worst, I must read the rest. You are unsatisfied with an essay that is merely of correct reasoning, can you recommend some even better reading material than this?

Collection of Eliezer essays: https://www.lesserwrong.com/rationality

Yeah. Other LessWrong posts are usually great. I recommend almost everything at http://slatestarcodex.com, http://ribbonfarm.com, http://meaningness.com and other insight sinks.

"Eyeballing this question, my off-the-cuff answer—based mostly on the impressions related to me by every friend of mine who has ever dealt with medicine on a research level—is that I wouldn’t necessarily expect any medical researcher ever to have done a formal experiment on the first thought that popped into my mind for treating this extremely common depressive syndrome. Nor would I strongly expect the intervention, if initial tests found it to be effective, to have received enough attention that I could Google it.

"But this is just my personal take on the adequacy of 21st-century medical research."

I am guessing that the subtitle of his new book is, 300,000 words on why I have more smarts than everyone else?

> For instance, he seems axiomatically convinced that "creating trillions of dollars of value" is an objective good.

Is he?

The fact is, many people do behave as it is an objective good, if only to justify their own wealth. I think the arguments leans on that more that it leans on the belief that GDP growth is actually a good thing.

And as much as GDP growth sucks as a utility function, it does seem to be correlated with much goodnes. How strongly correlated exactly is the $3^^^3 question.

I think it's implicit that the 'trillions of dollars of value' are dollars of actual value, like purchases of goods and services that people actually want. Your parable is amusing, but not analogous at all. Of course if each economist extracted >$20,000 of sadistic pleasure out of the other eating poop, then, in fact, there was a net benefit to both of them. (But sadistic or capricious behavior throws a big wrench into economics, anyway...)

Why is that implicit? The economy seems full of huge transactions that have nothing to do with the quality of people's lives. I feel like this is... a pretty obvious position to arrive at if you start critically examining the types of transactions that take place, especially at the tops of finance. Some finance whiz is going to claim that derivatives, credit default swaps, and billions made from LIBOR rigging somehow benefits the common man. Many people actually believe this!

Don't forget to add "and created 2 jobs" to the punchline.

I got a snortchuckle out of "Comments sorted by magical algorithm".

A truly fascinating read. Actually inspired me to preorder the mentioned book. I’ve never read a book this strongly Econ, but it interests me to no end so this should be an interesting journey.

That was a good read, thanks for posting.

Wow, that constantly updating page title is irritating. Couldn't even read because of the constant animation at the top of the page.

It's a new site and is on the todo list to fix.

Does this blog have a RSS feed?

Yes: https://www.lesserwrong.com/feed.xml. Firefox auto-detected it.

All that Eliezer's argumentation is thought provoking and fun.

Just keep in mind that Eliezer is good at suggesting mental frameworks for making decisions, but fails when trying to make the best practical decisions himself.

Applications are open for YC Summer 2018

Guidelines | FAQ | Support | API | Security | Lists | Bookmarklet | Legal | Apply to YC | Contact