Mechanical Turk Research Ratings
Mechanical Turk Research Wage History
Top Worker Reviews
Cosmo Average Pace
Study on health and workplace environments - $2.00
Underpaid
Poor
Approved
$ / hour
00:00:00 / completion time
Pros
* Initially it seemed like a quick HIT.* Reversed a rejection quickly.
Cons
* It was not properly sandboxed before posting. It should have been a 45 minute survey. So, I left my performance time out of this review. The HIT itself took me 2 minutes but probably over the 45 minutes of fighting a rejection. Even at $2 for 45 minutes, this is why I rated it as Underpaid.* It seemed very quick at first, but I found out later that it was supposed to be a screener. But when you didn't pass the screener, it took you to the end AND auto-submitted the HIT.
* Reviewer sent everyone who took it an E-mail saying there was a mistake, with a link to complete the survey.
* Survey worked but then announced the screener portion of the HIT and wouldn't allow completion of the survey.
* E-mail reply went to a bouncing mailbox.
* HIT initially rejected 2 days later: "Sorry, you did not match our criteria. Thank you for your interest!"
* Looked at original E-mail and went to the .com of the E-mail address. Found the company's feedback forum.
Advice to Requester
SANDBOX your HITs before publishing them, especially if they include an auto-submit or a screener. Rejections affect our ability to do work, especially new MTurkers, it impacts them very severely!WildFlower Relaxed Pace
Study on health and workplace environments - $2.00
Underpaid
Excellent
Approved
$2.67 / hour
00:45:00 / completion time
Pros
Excellent communication. The Cons are all true, but I sent a message to the Requester on the website to alert them of all the problems, I received a prompt response, very professional and apologetic and assurance that they would be reversing the rejection, they just had a ton of problems receiving messages sent through MTurk.Cons
- They made a mistake in how they set up their survey.- Sent out an email with the way they actually wanted it to be and still rejected you even if you completed that.
- It would've been way more honest to just reject right then, not ask for additional information, screen you out and then reject you.
- They got a lot of free data out of this, because having a full survey pool, not just qualified participants is still important data.
- I'm basing pay generosity on their own estimate.
Advice to Requester
Learn how to post a proper screener so that you are not alienating people you need to complete your surveys in the future, which is what you've done by rejecting everyone including the people who followed the link in the email you sent out. Also, $2 for 45 minutes is abhorrent and unacceptable for a company based in the US and last time I checked, Celebration, FL where you are based is indeed part of the US. Up your pay to at least be in line with minimum wage.gurlondrums Average Pace
Study on health and workplace environments - $2.00
Fair
Excellent
Approved
$ / hour
00:00:00 / completion time
Pros
1. Responded to email on company website promptly.2. Reversed rejection quickly.
3. Apologized for inconvenience.
Cons
1. Auto submitted after demographics.2. Followup email was sent with link to full survey, got screened out but could not return hit as it auto-submitted.
3. Still rejected even after realizing their mistake.
Advice to Requester
Test your hits before making them live and rejecting based off the brokenness.