Automate HITs Verification for Amazon's Mechanical Turk
$250-750 USD
Cerrado
Publicado hace casi 14 años
$250-750 USD
Pagado a la entrega
We are seeking an experienced programmer that can help us automate the process of verifying answers or HITS when using the Amazon Mechanical Turk Platform.
What is the problem we wish to solve?
We are requesting workers to search for an item available on a specific site. We will provide the URL of the specific site. We require worker to enter the item text in the search box of site and not use any other entry point to find item. When exact item is found we require that the worker provide us the URL of the page where the item was found.
When viewing the item URL the item is usually found within 2 boxes. 1 box is on top, 2nd box is at bottom. Worker must indicate in which box the item was seen, by entering “1” if found inside the top box or “2” if found within the bottom box. If there is just one box, worker will enter “1” by default.
If item is not found within the site, they may select a drop box that states, “Item not found”.
How we wish verify accuracy of URLS and Zones of Boxes?
We would like to get multiple answers (and thus use multiple assignments) per HIT and reach the correct answer by consensus. There is only one right answer, if the answers all match, they are correct. We will award each HIT to three workers, all URL that match will be considered correct.
How we seek to implement?
We are seeking to generate 12,100 HITs within one group. We have 12,100 items that need to be found which equates to 12,100 URLS.
We need an experienced individual that can code a system/method to help us achieve our goals.
What we will supply?
We will provide 12,100 in spreadsheet that has Item that needs to be searched.
How we need final data?
We will require all URLs and Item Zone (1 or 2) to be appropriately appended to spreadsheet.