Hacker News new | past | comments | ask | show | jobs | submit login

Mturk can be used as a source for automation training.

If you start writing bots to do the tasks, you're now the mostly-blind leading the blind.




That could be addressed by having an optional meatbags-only flag when creating tasks.


I guess it may also be for quality. For example it's not inconceivable that one could write an audio transcription bot that is quite good and may be good enough for a lot of tasks, but still not as good as a human and may fail quite badly at complex tasks.

Once the market gets flooded with bots, the buyers will work out what's going on and start to lower their offers to cover the risk of getting a bot transcription. Then the real humans leave.

And of course, if a task can be fully automated then amazon would prefer to integrate it into their cloud offering and take all of the profit themselves.


Amazon has to deal with the quality of human workers, too. It shouldn't matter who is behind the work.

>And of course, if a task can be fully automated then amazon would prefer to integrate it into their cloud offering and take all of the profit themselves.

And that's what Amazon should do if they could.


Humans are more likely to care about reputation than bot herders who can trivially flood the market with programs which will work 24 hours a day. As soon as you allow bots, it becomes 99% bots very quickly.

You would also get people doing some work themselves to build reputation up and then swapping in a bot.

It would be quite interesting to build a dedicated market for bots. Just let people upload scripts with a documented input/output format and then pay the developer a royalty each time it is run.


From Amazon's perspective it doesn't matter if the user is a bot or a user. An user can also work themselves to build reputation up and then start doing low-quality work to increase pay. If you can't create a market for humans, you can't create a market for humans and bots.


The selling point of MT is that you can get human tasks done, if bots chase the humans out they loose that. It's similar to marketplaces like etsy in that regard.


Who are "they"? Amazon shouldn't care if the turks are humans or bots, they'll make the same dollar in any case. The people who create tasks for turks shouldn't care either: they just want stuff done.

The point of MT is that it's a market for jobs that cannot be easily automated. If someone can automate the task then so be it, it doesn't matter.

The point of MT is not a market place for "tasks that can only be done by humans", it's a market place for "tasks that can't be automated easily, therefore everyone and everything should have an opportunity to complete the task by any means what-so-ever. if you can only complete tasks on drugs then so be it. if you can only complete tasks by writing a bot so be it.". The seller just wants task to be completed cheaply.


The advantage of listing a job on MT vs finding a program to run is that you know it is at least reviewed by a human being who cares somewhat about their reputation within the system.

Once that guarantee goes away you affect the value of all transactions within the market. What is commonly known as a "Lemon market effect".




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: