- \n
- A starting link to your independently hosted survey (e.g. Qualtrics)<\/li>\n
- A single text box for data entry<\/li>\n
- Instructions (i.e. \u201cClick the link to be redirected to our survey. Please, LEAVE this browser window open as you will be asked to paste a code provided in the survey in the box below.\u201d)\n
- \n
- Be sure to emphasize keeping the browser window open, as in the example provided above.<\/li>\n<\/ol>\n<\/li>\n
- This can all be easily accomplished through MTURK’s “Survey Link” template.<\/li>\n<\/ul>\n<\/li>\n
- Create separate surveys for each round of data collection using your respective survey service.\n
- \n
- Have the survey provide a randomly generated number at the end using a random number generator. \u00a0Qualtrics uses their own web services<\/a> to provide a random number generator and I recommend them. \u00a0Tyler Burleigh\u00a0offers a nice walk through here\u00a0<\/a>(and this will guide you with most other survey services as well). \u00a0Survey Gizmo mentions an internal random number generator feature in this<\/a>\u00a0help document. \u00a0Feel free to give that a try if you cannot settle with Qualtrics.<\/li>\n
- As a buffer, in case a problem occurs with your random number generator, I recommend asking for the respondents’ WorkerID on the same page as the random number generator output or directly before (if possible and ethical, require this output in your survey).<\/li>\n<\/ul>\n<\/li>\n
- Use MTURK’s CSV file download\/upload method to “mass-approve” HITs.\n
- \n
- Click the “Manage” tab, then “Manage HITs Individually,” then “Download Results,” and again “Download Results” as in the screenshot below.
![\"mturk](\"https:\/\/i0.wp.com\/justinwiegand.com\/blog\/wp-content\/uploads\/2015\/01\/mturk-download.jpg?resize=720%2C191\")
<\/li>\n - This provides you with a CSV file \u00a0you can open in Excel or any type of text editor.<\/li>\n
- Amending\u00a0your spreadsheet created with Tyler’s guidance earlier in this step, you can now match up WorkerIDs lacking a legitimate verification code to\u00a0your downloaded CSV file and use the Excel’s fill function to\u00a0approve all HITs (with an “x” in the “approve” column). \u00a0Then, hand-select those without legitimate verification codes for rejection and re-upload the file. \u00a0Alternatively, you could create an Excel function\u00a0to do this for you.<\/li>\n<\/ul>\n<\/li>\n
- That takes care of the externally hosted aspect of your surveys and the use of verification codes to ensure data integrity. \u00a0The next part (2)\u00a0explains how to\u00a0follow-up with workers for subsequent surveys and match data between your survey waves.<\/li>\n<\/ol>\n
References<\/strong><\/p>\n
\n\n\t\t1559346<\/span>\n\t\t{:ZTWW9MKX},{:G8WWE2R8}<\/span>\n\t\t<\/span>\n\t\t<\/span>\n\t\t<\/span>\n\t\t<\/span>\n <\/span>\n\t\t1<\/span>\n\t\tapa<\/span>\n\t\t50<\/span>\n\t\tcreator<\/span>\n\t\tasc<\/span>\n\t\t<\/span>\n\t\t<\/span>\n\t\t<\/span>\n\t\t<\/span>\n\t\t<\/span>\n\t\t<\/span>\n\t\t<\/span>\n\t\t<\/span>\n\t\t<\/span>\n\t\t<\/span>\n <\/span>\n 195<\/span>\n\t\thttps:\/\/justinwiegand.com\/blog\/wp-content\/plugins\/zotpress\/<\/span>\n\n\t\t\n\t\t\t\n\n\t\t\t<\/div>\n\t\t<\/div>\n\t<\/div>\n\n\n","protected":false},"excerpt":{"rendered":"Amazon\u2019s MTURK is a promising way to collect data in the social sciences . \u00a0The sample (as compared to other convenience samples), timeliness, ease, and cost are all strong positive attributes of the service (Landers & Behrend, 2014). \u00a0However, there is not a convenient method to collect multiple waves of...<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"Guide for using Amazon\u2019s MTURK for multiple waves of data collection http:\/\/wp.me\/p51adQ-39","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[32],"tags":[63,67,62,65,68,64,66],"class_list":["post-195","post","type-post","status-publish","format-standard","hentry","category-guides","tag-amazon","tag-follow-up","tag-mturk","tag-qualtrics","tag-random-number-generator","tag-survey-gizmo","tag-waves"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p51adQ-39","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/justinwiegand.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/195","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/justinwiegand.com\/blog\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/justinwiegand.com\/blog\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/justinwiegand.com\/blog\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/justinwiegand.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=195"}],"version-history":[{"count":21,"href":"https:\/\/justinwiegand.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/195\/revisions"}],"predecessor-version":[{"id":896,"href":"https:\/\/justinwiegand.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/195\/revisions\/896"}],"wp:attachment":[{"href":"https:\/\/justinwiegand.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=195"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/justinwiegand.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=195"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/justinwiegand.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=195"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
- Have the survey provide a randomly generated number at the end using a random number generator. \u00a0Qualtrics uses their own web services<\/a> to provide a random number generator and I recommend them. \u00a0Tyler Burleigh\u00a0offers a nice walk through here\u00a0<\/a>(and this will guide you with most other survey services as well). \u00a0Survey Gizmo mentions an internal random number generator feature in this<\/a>\u00a0help document. \u00a0Feel free to give that a try if you cannot settle with Qualtrics.<\/li>\n