I think it is irrelevant, as PhotoShop is notoriously poor in UX. GIMP has even worse UX. The battle is not in cloning PhotoShop, but in rethinking complex photo editing.
A bad UI doesnt mean something doesnt work, it also doesnt mean something does work. A critical mind is required to actually investigate if something works in all the way that should.
Yeah, I do not get the dismissiveness given that the researchers themselves were not as dismissive.
> The connection was a “little bit far-fetched,” she says. “But I could imagine a first-year Ph.D. student coming up with exactly those same questions and ideas.”
This one in particular made it seem like a very ordinary interaction.
It's kind of misleading information. Most who have worked with AI can see issues with what the AI Engineer created, and how what he's doing can't be 'scaled up' to society.
Everyone in the article seems desperate for attention and engagement, and it makes some readers uncomfortable: because of the awkwardness, and because this guy is spreading a 'bad idea' that probably shouldn't be replicated.
Imagine if everyone starts spamming emails? The researchers are amused this time, but I guarantee they wouldn't be if their inbox filled up with agent emails.
Not to mention the way the agents reached out for help is probably a bad idea: asking someone with 30 years of experience to apply all their knowledge to your small, specific problem in another knowledge domain, with no other detail or context puts all the mental burden on the unsolicited email recipient.
There is already mass spamming emails. I already get hundreds of emails per day that are spam as I post my emails publicly for people to get in touch. If you want to truly and maliciously spam, you can do that.
The fix is already AI triage.
That is the current state of email today.
So why couldn’t this scale unless for some reason our reaction to this is to shut off email and not build better classifiers?
Personally, I don't care what the guy does. It's entertainment for him, and obviously the people replying to his emails were entertained. I doubt they would continue to be entertained if more agents emailed them. I'm just pointing out issues with the article, why people might be upset.
Also, Hackernews tries to hold itself to a certain standard. Reading an article about an AI Engineer who gives an AI agent access to a tool, with clear directive and access to use the tool, who is then later confused when the agent uses the tool in a slightly different way, suggests the article is below Hackernews standards.
To answer your question though: yes you absolutely could fight spam with AI on your side.
Should we go down that path as a society, just for amusement? Essentially saying: yes, someone should pay for AI service to combat AI spam, just so we can continue to use email.
It depends on whether you bought books to learn or bought books to solve.
There are a vast number of books that I purchased not for any interest in the topic, but to solve a particular problem. I have zero interest in understanding Docker. I find it tedious. But I do have a book on it as I did need to know it at some point.
I wouldn’t buy that book today, as AI means I no longer need to know Docker.
All these analogies are kind of tortured as they ignore the elephant in the room. The students want to be there to get their job getting paper. They aren’t there to learn.
If society offered some reward for lifting the weight while not enforcing how, forklifts would absolutely be used to lift weights.
The job-getting paper ceases to be meaningful if it no longer verifies competence. If it merely verifies the ability to prompt an LLM then nobody will pay a premium for people have it, and then nobody will pay to obtain one.
And what is the mechanism by which society could stop such AI damage and push for punishment as per law, not per subjective usefulness? Voting every 4 years to a president that never fulfills his promises?
No, society does not want corporations with no responsibilities.
Does publishing it matter? You would almost have to keep it out of the cloud to avoid it being ingested as policies change. So even sharing it may become higher friction.
The challenge here is that the business world doesn't really recognize the concept of cheating.
In particular, tech is very open to people cheating and if billions of dollars could be had by somehow communicating the chess engine's work to a human at chess, the world of business would cheat at it.
Tech has a number of large startups that basically started with the assumption of "what if we assumed the law had no teeth?"
This whole discussion is basically a field demanding that their field be preserved for them alone to discover. No competition allowed besides the monks of mathematics.
You can invent whatever fantasy you like. I hope more honest people will read the letter (from the fields medalists and other endorsers) and consider it on its merits.
Here's the thing. I read the letter. I'm considering it on its merits. And it has very little. They made great arguments for why it's a good thing that the mathematical community operates the way they do. They could have made a good argument for why practitioners within the mathematical community shouldn't be seduced by the power of AI and should continue to build mathematics they way they do now. Ignoring AI as a tool, but perhaps not ignoring the results coming out of it, builds understanding and skill and develops humans. I'd be all for a letter that calls on humanity to not give up their humanity to AI tools. To not become lazy and overly dependent on them.
The letter makes no arguments why AI companies proving a bunch of results quickly at all affects the ability of mathematicians to do what they want to do. It's just a giant self-congratulatory list of all the wonderful things the mathematical community does and notes that AI companies aren't doing the same thing.
It's not enough for them that they are still free to pursue all the goals they outline in that letter to their hearts content. They want to make sure everyone else doing mathematics also sets aside their own goals and pursue theirs. I distrust AI as a technology regardless of alignment. And I've learned to just not use them and focus on the things in my life that matter to me. It turns out that I'm still free to pursue the things in my life that are meaningful regardless of the existence of LLMs.
The communique from the mathematicians when shorn of polite language is blunt viz.
AI companies are stealing our hard-won lifelong research findings, which we were already sharing freely, without attribution/credit and building upon them without informed consent nor compensation.
It should now be clear that the AI companies behaviour i.e. backstabbing the mathematicians and stealing their life's work is the problem and not the usage of AI itself.
I also pointed you to Self-Determination Theory(SDT) to understand Intrinsic/Extrinsic Motivations that drives Mathematicians (and also Scientists/Researchers/Knowledge-workers) to spend their entire lives in the pursuit of knowledge. From SDT it can be seen that the AI companies behaviour, threatens everybody's Autonomy, nullifies their Mastery/Competence and robs them of Purpose/Relatedness/Belongingness. Nobody should accept this.
A) According to the letter, mathematicians most value:
- mathematicians developing their mastery
- developing mathematics that provides insights and can be eventually synthesized down conceptually to textbook theories
- caring for students and fostering their growth
- human mathematicians getting credit for doing important work
- etc.
B) According to the letter, AI labs aren't trying to do any of these.
Conclusion) The result is that AI is not competing with them in their goals of
- mathematicians developing their mastery
- developing mathematics that provides insights and can be eventually synthesized down conceptually to textbook theories
- caring for students and fostering their growth
- human mathematicians getting credit for doing important work
- etc.
The upshot is that mathematicians still have autonomy to pursue those goals, develop mastery at achieving those goals, and remain part of a community of others pursuing them. The only mathematician who loses these sources of motivation is the one who embraces the use of AI and personally abandons those goals.
The real crisis will come if AI does try to align itself with the goals of the mathematical community and if AI turns out to be better at developing insight, training students, writing comprehensible textbooks, etc. Then the top mathematicians will truly provide little value to their community.
You have conveniently left out the spirit of the mathematicians communique and are only trying to argue its letter which is what makes me think you are being disingenuously clueless or cluelessly disingenuous.
To repeat myself again, the crux of the problem is;
AI companies are stealing our hard-won lifelong research findings, which we were already sharing freely, without attribution/credit and building upon them without informed consent nor compensation.
The AI companies are robbing the mathematicians by not involving them in major decisions about solving the leading/promising research problems in their domain. They are the ones who have identified the problems, its importance, promising approaches of attack etc. which have all been freely shared and which the AI companies have used to build their models.
For example, in the Navier-Stokes case, OpenAI could have easily informed the mathematicians like so, "hey, your research approach looks promising, do you have any objections to us using your research in our models and throwing a lot of compute resources at it so that we can finally solve it?" Every mathematician would have jumped at the chance since that is what he was doing anyway but at a small scale and far slower pace.
Instead OpenAI went behind the mathematicians back while building upon his and others work without attribution/credit nor compensation. This is plagiarism, cheating and despicable behaviour and should not be tolerated by anybody.
Yes. Everything I've said and want to say is about this letter.
Let me try to summarize this discussion in a way that an overly obsequious AI would never dare:
- I argue that the arguments in the letter are bad.
- You mysteriously assign me homework on the topic of human motivation.
- Confused, I reiterate the points made in the letter, and I make arguments against them
- You ignore my arguments, call names, and then defend the letter by making points that the letter doesn't make.
- I ignore your points, because they aren't the points made in the letter. And my original post was about why the letter was misguided.
- You call names. You feel like your points are valid. You then claim that the letter is valid because your points are valid.
- I keep disagreeing with the letter.
- You call names again, because why am I so obsessed with talking about the letter. I must be an idiot, or an evil lying phony, or an evil lying idiot-phony because I keep bringing the conversation back to the letter on a thread about the letter.
I had imagined i was interacting with somebody who could understand the larger picture given only the key points. Apparently that was wrong and i need to spell out every detail.
I didn't call you names but implied that you had an agenda and were masking it by trying to debate the literal words in the original communique from 25 fields medalists which was written to be politically correct. Apparently asking you to "focus on the spirit and not the letter" of the communique was too much. So i highlighted it, repeated myself three/four times and yet nothing seems to have worked to aid comprehension.
I point to a most important and relevant psychological theory viz. SDT, which explains how one's behaviour is influenced by intrinsic and extrinsic motivations and ask you to think about how they might explain why the mathematicians are angry at the current situation of AI companies shafting them. I even used specific terminology from SDT to highlight its applicability in this case. Apparently this is too much "home work" (and needed thinking) and one needs to spoon-feed everything without assuming any human intelligence/curiosity/initiative at the other end.
It seems my attempt to show the larger context and situate it in actual psychological research has been of no avail though not for want of trying.
You and I aren't having the same conversation. You want to psychologize people's motivations, including my own, which is interesting to speculate about but off topic. I want to discuss the arguments made in the letter, the arguments that 25 Fields medalists actually signed on to.
I am capable of having a conversation with you on a great many topics. What you aren't capable of, apparently, is forcing me to want to have the one you want to have.
As far as calling names:
"Your comment is ... disingenuous."
"you are being disingenuously clueless or cluelessly disingenuous."
and now:
"I had imagined i was interacting with somebody who could understand the larger picture"
Nope, you need to engage in a root-cause conversation which is the key here. Just focusing on the words in a letter which as i already pointed out is couched in politically-correct terms due to etiquette is meaningless. There is a lot unsaid there which you have to tease-out by reading between the lines. It was written in response to OpenAI's behaviour (Tristan Buckmaster himself called what they did as "malpractice" in one of his tweets) but looking at the larger picture of AI in Mathematics. The key phrase from the letter is;
... Often these solutions are announced in a rush, leaving no time for a proper writeup, the isolation of new methods and ideas, and citing relevant previous work of others. As in all creative professions, this raises severe attribution and plagiarism questions. ...
The inference should be clear.
Hence we need to start with the underlying psychological motivations and then see how it explains observed behaviour. And it is not even complicated but somewhat obvious. The fact that you (many others) refuse to address this is why i question your (and theirs) motivations/agenda.
As regards your last few lines regarding "calling names" they are all only w.r.t. to the issues being discussed and are just rhetorical/descriptive judgements on your comments.
Fair enough. But I think you may be conflating an explanation with an excuse. I think your root cause analysis may be fruitful for explaining why they wrote the letter. But I don't think that it excuses what they actually wrote.
The letter is just a call to action reminding everyone how Mathematics is done and how Mathematicians operate within their domain with all the Human factors involved.
But because of the bad behaviour (plagiarism, going-behind-the-back etc.) and incentives misalignment, AI companies are currently not aligned with that.
There is also the structural problem of generating proofs at a rapid pace just because you can but then have no way for "proof digestion" which is the key in the mathematical process. See Terence Tao's writings - https://teorth.github.io/tao-web/ai-views.html
The real issue is that there is "research" and then there is research. Most publications are simple recapitulations of well known ideas but applied to somewhat unique environments. Imagine if you are a carpenter, you are just using your existing tools to make more stuff, but fundamentally what you are doing is no different from what any other carpenter is doing. It's workmanlike production.
The truly valuable stuff is coming up with new ideas, that is, new techniques that allow for breakthroughs. That is rare, is done by only a handful of people in any decade, and is very, very hard. When you study a book on the history of math, you see the names of people that created brand new techniques which allowed them to solve problems no one else could solve.
But you still have that 99.9% that needs jobs, and they need to publish, but what they are doing can be mostly replaced by AI.
The specific situation with Navier-Stokes really highlights this. Mathematicians came up with the technique, but the AI managed to apply it faster than even the technique inventors. So it appears that AI is now good enough to be doing the workmanlike stuff, which is the bread and butter of a lot of mathematicians that are just trying to get their publications in so they are not fired.
I do think this creates real problems for the field and that some changes are necessary.
Exactly. This is what the letter should have focused on. The issue is not alignment, per se. If AI can do the workmanlike stuff at breakneck speeds, academia will decide between two options:
1) Keep the average mathematician employed doing redundant mathematics just to have capable humans around. Every now and then you get one of those mathematicians actually developing new ideas, but most departments will entirely be just for show. It's doable though. College sports is able to keep itself going along these lines (and I mean the track, softball, and polo type sports).
2) You get unemployed mathematicians who were still developing their abilities. And as a result you lose the institutions that generate the mathematicians that contribute new ideas.
You get to keep the handful of exceptional mathematicians that are developing new ideas, and that's survivable if you happen to be a Fields medalist. None of this really has to do with the AI companies aligning themselves to giving credit and developing insights. If AI companies became aligned to that, then the AI's would be replacing the Fields medalists, too.
I agree. But my frustration is that there is no argument why AI should be aligned with mathematics.
Why can't the mathematicians that value their own community remain aloof from what AI companies are doing. Can't they continue to take their time digesting proofs, gaining insights, and attributing credit to mathematicians doing good work. Here's how I perceive the situation:
Before:
- mathematicians digest current results and develop insights
- insights lead to new results
- new results give mathematicians an opportunity to credit those insights
Now:
- AI companies release a bunch of potentially uncredited proofs
- mathematicians digest these results and gain insights
- mathematicians recapitulate AI proofs in terms of their deeper insights and theory
- mathematicians give credit for these new insights and progress in understanding, even though the binary true-false status of theorems were already determined beforehand.
If the true-false status itself isn't real mathematics, then mathematicians still can do the real mathematics after the fact and continue to celebrate each others' work. The only thing they lose is the ability to attribute a human to deciding the true-false status, which isn't real math anyways (though maybe valuable for motivation). What they gain is efficiency. Every mathematician working towards proving NS won't blow up can now shift their resources to understanding why it can blowup.
Perhaps the letter is implying that the mathematical community itself will become misaligned with how mathematics is currently done. I'm unpersuaded it's entirely the AI companies' fault if that happens. AI may create a lot of temptations for individual mathematicians to become lazy, but that seems like something the mathematical community needs to resolve for itself. Every institution needs to take a lot of self-ownership here. I'm also annoyed about parents complaining about their own children being addicted to their phones as if it isn't in their own power to determine if their children have phones in the first place. I think this letter would be better directed at universities and journals. They should be holding their own institutions to account if they feel like they are adopting the mentalities of the AI companies and no longer faithfully executing the values of mathematics.
Shouldn't the AI companies know by now that all mathematical knowledge belongs to the mathematical community? Hopefully this letter knocks some sense into them.
Spot on. They now feel threatened that there's multiple challengers to their intellectual monopoly. This is their "whaaahhh... whaaahhhh... private company bad, now," but where OK when Halliburton, Boeing, General Dynamics, Monsanto, Open Society Foundation, Tides Foundation and many other shitty and scummy private and so-called "non-profit" entities were funding their shit. Now their entire business model is changing. Is not that it'll completely collapse, it's just changing and they are throwing a bitchy fit.
reply