Human Computation and the Story of Google Image Labeller Slaves
...the ESP Game, described in this talk, is an enjoyable online game -- many people play over 40 hours a week -- and when people play, they help label images on the Web with descriptive keywords. These keywords can be used to significantly improve the accuracy of image search. People play the game not because they want to help, but because they enjoy it. -- Luis von Ahn, Game Creator
Note: Game inspired by ESP Game created by Luis von Ahn , Carnegie Mellon-- licensed BY Google .)
Human
Computation
and the
Story
of
Image-LabellerSex
Slaves
!
Google 
Image Labeler Game
Your partner has suggested 18 labels.
off-limits
cat
kitten
kitty
cute
my labels
im just wondering if you saw
the video about this process
and how we get to be unpaid
September 1, 2006
You have 90 seconds for you and a partner to agree on words to describe as many images as possible. At first you think, “90 seconds? That’s nothing.” So you play. And you play again. And then you look up and it’s 4pm and you’re almost on the leaderboard, so you play a little more. I beg of you–stay the hell away from this game. For god’s sake, I mean it. And if you beat my record of eight images in 90 seconds, please don’t post it here to brag. Not even a little bit.
(Note, this game is inspired by the ESP Game created by Luis von Ahn, and I believe Google licensed the game from Carnegie Mellon.)
- Luis von Ahn
- ABSTRACT
- AUTHORS
- abstract
- REFERENCES
- CITED BY
- PUBLICATION
- Human Computation and the Story of the Google Image Labeller Slave Machine
- Google Image Labeler (i went for kitty after I tried to communicate with my partner and got shut down) stay tuned for my Google Image Labeler Slave Story)
- http://whatgetsmehot.posterous.com/google-image-labeler-i-went-for-kitty-after-i
- Welcome to Google Image Labeler Slave Machine (video at 11)
- How does it work?
- Tips:
- What do you need to participate?
- MORE AFTER THE INTERMISSION
http://www.mattcutts.com/blog/
WATCH out guys …. sometimes the image are offensive, I was playing with my wife and I see this cartoon where the gal is sitting down n guy is standing obviously they r nude so i had to guess … and my partner said “sex” eventhough i was more precise
…. Google how can we avoid showing such images or filter ..??
Maybe thats why u guys came up with this game … lol
Myles September 17, 2006 at 9:45 am
top ranking of the day… 12 in 90s
Jagadish September 26, 2006 at 3:31 pm
I scored 12 today too ..ha ha ha
I discovered there is this labelling thing today and needless to say I am addicted. I agree with what Bradley had written that people tend to over-generalize objects, events and things. Tagging images with labels like man and woman easily matches my partners and I dislike doing that even though I like to score more…Thanks but no thanks to Google..
Nas Raja September 28, 2006 at 1:46 pm
Matt,
You guys probably already know this: There are ALREADY attempts to spam the image labeler. I was just now getting strange labels from players such as “carcinoma, accretion, bequeathing” etc. – for images that had absolutely nothing to do with these relatively rare usage words.
emma October 5, 2006 at 1:19 pm
i heard jo whiley of bbc radio 1 talking about this and thought i would have a look, i wish i hadnt, i was nearly late picking my kids up from school as im addicted. ezcept for coming across the spam numerous times today, what is the point
loving it
Tobora Bender October 26, 2006 at 5:24 am
To Nas Raja:
Nas – it’s funny to see how so double-standard and hypocritical your opinion is… On one hand, if Google decides to exploit millions of people by using a tool that automates the costly annotation data collection process without paying a dime – it is fine and dandy… However, if someone else starts using a tool that automates the one used by Google – it is immediately called spam and abuse by Mr/Mrs Nas Raja! Do you really think the the spammers would want to use just a simple set of easily filterable keywords?…
Congratulations, Nas – you are a golden standard of fair, unbiased and objective judgement towards Google and everybody else!
Tobora
-
Tobora,
Irritated at being found out so fast and getting wiki’ed to boot, are we now? Care to explain exactly what positive use would come out of trying to spam the Image Labeler with high-paying AdSense keywords except – well, except to improve the relevancy of your pages to illegally pull in even more AdSense traffic? A flower being labeled carcinoma is way beyond preposterous! Here’s just one example of a website set up for the explicit purpose of generating AdSense traffic for high-paying keywords such as carcinoma. I rest my case.Do realize though, that a simple captcha would put automated spamming scripts for Google Image Labeler in their place. I guess it hasn’t gotten out of hand yet for Google to do that. If so, my advice would be to lay low and look up the job description for the guy whose blog you posted this comment on. You’re playing with fire here.
Oh, and – it’s “Mr.” Nas Raja, thank you!
ABSTRACT
Tasks like image recognition are trivial for humans, but continue to challenge even the most sophisticated computer programs. This talk discusses a paradigm for utilizing human processing power to solve problems that computers cannot yet solve. Traditional approaches to solving such problems focus on improving software. I advocate a novel approach: constructively channel human brainpower using computer games. For example, the ESP Game, described in this talk, is an enjoyable online game - many people play over 40 hours a week - and when people play, they help label images on the Web with descriptive keywords. These keywords can be used to significantly improve the accuracy of image search. People play the game not because they want to help, but because they enjoy it.
|
| ||||||||||||||||||||||||||||
| View colleagues of Luis von Ahn | |||||||||||||||||||||||||||||
abstract
REFERENCES
| 1 | ||
 | 2 |
CITED BY
3 Citations
| |
| |
INDEX TERMS
Primary Classification:I. Computing Methodologies
I.2 ARTIFICIAL INTELLIGENCE
I.2.m MiscellaneousINDEX TERMS PUBLICATION
| Title | K-CAP '07 Proceedings of the 4th international conference on Knowledge capture table of contents |
| Editors | Derek Sleeman University of Aberdeen, UK |
| Ken Barker University of Texas at Austin | |
| Pages | 5 - 6 |
| Sponsors | SIGART ACM Special Interest Group on Artificial Intelligence |
| ACM Association for Computing Machinery | |
| Publisher | ACM New York, NY, USA ©2007 |
| ISBN: 978-1-59593-643-1 Order Number: 607070 doi>10.1145/1298406.1298408 | |
| Paper Acceptance Rate | 20 of 60 submissions, 33% |
Julia Spranger
Google TechTalks July 26, 2006 Luis von Ahn is an assistant professor in the Computer Science Department at Carnegie Mellon University, where he also received his Ph.D. in 2005. Previously, Luis obtained a B.S. in mathematics from Duke University in 2000. He is the recipient of a Microsoft Research Fellowship. ABSTRACT Tasks like image recognition are trivial for humans, but continue to challenge even the most sophisticated computer programs. This talk introduces a paradigm for utilizing human processing power to solve problems that computers cannot yet solve. Traditional approaches to solving such problems focus on improving software. I advocate a novel approach: constructively channel human brainpower using computer games. For example, the ESP Game, described in this talk, is an enjoyable online game -- many people play over 40 hours a week -- and when people play, they help label images on the Web with descriptive keywords. These keywords can be used to significantly improve the accuracy of image search. People play the game not because they want to help, but because they enjoy it. I describe other examples of "games with a purpose": Peekaboom, which helps determine the location of objects in images, and Verbosity, which collects common-sense knowledge. I also explain a general approach for constructing games with a purpose. Google TechTalks July 26, 2006 Luis von Ahn is an assistant professor in the Computer Science Department at Carnegie Mellon University, where he also received his Ph.D. in 2005. Previously, Luis obtained a B.S. in mathematics from Duke University in 2000. He is the recipient of a Microsoft Research Fellowship. ABSTRACT Tasks like image recognition are trivial for humans, but continue to challenge even the most sophisticated computer programs. This talk introduces a paradigm for utilizing human processing power to solve problems that computers cannot yet solve. Traditional approaches to solving such problems focus on improving software. I advocate a novel approach: constructively channel human brainpower using computer games. For example, the ESP Game, described in this talk, is an enjoyable online game -- many people play over 40 hours a week -- and when people play, they help label images on the Web with descriptive keywords. These keywords can be used to significantly improve the accuracy of image ...all » Google TechTalks
July 26, 2006Luis von Ahn is an assistant professor in the Computer Science Department at Carnegie Mellon University, where he also received his Ph.D. in 2005. Previously, Luis obtained a B.S. in mathematics from Duke University in 2000. He is the recipient of a Microsoft Research Fellowship.
ABSTRACT
Tasks like image recognition are trivial for humans, but continue to challenge even the most sophisticated computer programs. This talk introduces a paradigm for utilizing human processing power to solve problems that computers cannot yet solve. Traditional approaches to solving such problems focus on improving software. I advocate a novel approach: constructively channel human brainpower using computer games. For example, the ESP Game, described in this talk, is an enjoyable online game -- many people play over 40 hours a week -- and when people play, they help label images on the Web with descriptive keywords. These keywords can be used to significantly improve the accuracy of image search. People play the game not because they want to help, but because they enjoy it.Google TechTalks July 26, 2006 Luis von Ahn is an assistant professor in the Computer Science Department at Carnegie Mellon University, where he also received his Ph.D. in 2005. Previously, Luis obtained a B.S. in mathematics from Duke University in 2000. He is the recipient of a Microsoft Research Fellowship.
Posted via email from Dogmeat