Update From Amazon on the Mechanical Turk process used in the search for Steve Fossett

user picture
Submitted by Mike D. on Sat, 09/15/2007 - 19:57.

Update on the Search for Steve Fossett

THE FOLLOWING WAS POSTED AT http://aws.typepad.com/aws/2007/09/updat... BY MIKE AT AMAZON: 

 

Recently I blogged about the use of Amazon Mechanical Turk to scale out the search for Steve Fossett. As a pilot who used to be involved in traditional Search and Rescue efforts, this form of innovation is incredible. Someone's fate no longer depends solely on a relatively small number of aircraft; instead a large number of people can quickly search and cross-check high-resolution images.

If you have not yet helped in the search, please visit www.mturk.com to pitch in.

So it seems appropriate to provide some feedback to all of the tens of thousands of people who have helped in the search. Accordingly, the following is straight from the product team:

Workers: thanks for your continued support!

Since launching the search for Steve Fossett, the support from the Mechanical Turk worker community has been outstanding. To date, tens of thousands of Steve Fossett searchers have completed millions of HITs. Your support in reviewing hundreds of thousands of images, covering thousands of square miles of terrain, has generated a number of highly credible leads. This effort has filtered the images down to less than 0.03% of images received.

After you submit each HIT, Mechanical Turk compares your answer to those received from workers looking at the same image. As highly rated images are identified, experts review them using Google Earth and pass the most promising leads directly to search teams.

Images are made available through the support of providers GeoEye, DigitalGlobe and Sanborn. Teams at Google prepare the raw images into the tiles. Data is then processed using EC2 and stored in S3 before being made available through Mechanical Turk.

Workers have already reviewed hundreds of thousands of images from GeoEye, and are now working on imagery from DigitalGlobe. We've just begun processing Sanborn data and will begin loading new HITs shortly.

Your continued participation is sincerely appreciated. Thanks for all your support.

So what have they found? Here's a couple of screenshots...


Experts reviewing each image have immediate access to the comments provided by workers as well as the percentage of workers who flagged the image.


After workers submits their HITs, responses are reviewed by experts using Google Earth to better examine the surrounding areas and evaluate each lead.

-- Mike