Download & Extend

Amazon Mechanical Turk Integration

This module provides the Amazon Mechanical Turk (http://mturk.com) integration for academic research. It is used for http://openturk.org.

For a brief introduction of human computation, please see Artificial Intelligence, With Help From the Humans

The mt_task module provides:
* Load HITs/Assignments into Drupal site.
* Provide infrastructural support for other AMT integration modules.

The mt_analysis module provides:
* Calculate Fleiss inter-rater reliability score.
* Calculate single results from multiple input (eg, 5 workers classified an item as 'red', 1 worker classified an item as 'blue', the final result is 'red' due to majority votes).

The mt_task module provides:
* Production leaderboard based on the number of approved HITs.
* Responsiveness leaderboard based on workers responsiveness to new HITs.
* Conformity leaderboard is a general measure of workers' accuracy.

Downloads

Recommended releases

Version Downloads Date Links
7.x-2.0-alpha3 tar.gz (36.09 KB) | zip (44.4 KB) 2011-Nov-21 Notes

Other releases

Version Downloads Date Links
7.x-1.0-alpha11 tar.gz (29.87 KB) | zip (37.81 KB) 2011-Oct-17 Notes

Project Information


Maintainers for Amazon Mechanical Turk Integration

  • diamrem - 7 commits
    last: 19 weeks ago, first: 35 weeks ago
  • danithaca - 45 commits
    last: 23 weeks ago, first: 47 weeks ago

Issues for Amazon Mechanical Turk Integration

To avoid duplicates, please search before submitting a new issue.
All issues
Bug reports