MTurk Answer Elicitation Ratings
Workers feel this requester pays well
Approves Quickly
No Blocks
MTurk Answer Elicitation Wage History
Top Worker Reviews
Yoyo Average Pace
Write questions about Video Games with multiple hops - $1.25
Low
Poor
Rejected (All)
$1.29 / hour
00:58:09 / completion time
- HIT Rejected
Pros
You only have to do five questions, technicallyCons
Takes waaaay too much time and effort to come up with questions that might be acceptable; the conditions for the questions are very confusing - what is the difference between a hop vs. a condition, why isn't it explained, and if only some questions require hops and some require conditions why are they part of the same HIT asking for hops? - and the amount of time you'll have to take out of your day in order to think up good questions, and research them to make sure they're acceptable (assuming you aren't rejected even after all this!) is just too much work for too little pay.Advice to Requester
Given how long it takes to come up with good questions, only to be met with a rejection without good explanation "Not all questions required multiple hops (some had multiple conditions instead)", I feel like this HIT needs two changes made to it.One, all of these types of HITs need to be much, MUCH clearer in what it wants. The examples often aren't very good at showing what types of questions are or aren't acceptable. If some questions require hops and some conditions, explain the difference between them, and which types go where. The instructions as is are short, and vague with poor examples that are open to interpretation. More than three examples would be great, too, as it seems there can be multiple different types of hops, and would help Workers understand what types of hops are hops, what types of hops might be conditional, and what types you're actually looking for, and what even a hop is, as that was not well explained! Saying it's two questions within one, but providing examples like "What is the name of the love interest of Luigi's twin brother?" and saying that this is an example of a two in one question with a hop ( who is Luigi's brother, who is the love interest) doesn't make a lot of sense, because it's not asking two questions. It's asking one question, with the assumption that you have the knowledge required to understand what it's referencing. So, again, not very clear what is actually required to pass a two-hop HIT, when it asks for a question within a question but the examples don't provide evidence of that.
Two, it can take quite a while to think up and research questions that will be acceptable to the criteria (assume they even are in the end!), so the pay needs to be a lot higher than $1.25. If effort is to be put in, the pay needs to reflect that, otherwise there's no reason to even bother working these HITs knowing that there's a chance for rejection even if you spend an hour working on it, trying to research and create unique questions and answers. $1.25 is just far, far too low. Even double that would not be enough. Low pay like this just encourages Workers to rush through it and put no time or effort in, leading to lower quality work, and more rejections on your part, leading to people being less and less likely to work for you as they become nervous about rejections.
Lastly, I think communication needs to be worked on. Saying "Not all questions required multiple hops (some had multiple conditions instead)" isn't clear at all of what I did wrong. Did I include multiple conditions when I should have had hops? Or were some questions of the five questions (let's say, two of the five) requiring hopes, while the others required conditions? That's how it sounds, but that wouldn't make little sense? Also, what even is the difference between a hop and condition in this case? As is, I literally have no idea what I did wrong, and so, it doesn't make me want to work differently in the future, it just makes me nervous to ever accept HITs like this again.
Oct 15, 2021 | 9 workers found this helpful.
AfterDarkMark Average Pace
Submit questions and answers about Ancient Civilizations - $2.00
Fair
Unrated
Approved
$11.45 / hour
00:10:29 / completion time
Pros
Pay is fair, but could be better (see cons).Cons
Should pay more imo, as more work has been added (now need to cite two sources and give the answer for each question created (10)).Times will be all over on these.
I averaged my time on three of these today to get my time, but my times varied by multiple minutes.
All writing, and will definitely take longer if you aren't quick at this type of task.
Aug 6, 2020 | 4 workers found this helpful.
AfterDarkMark Average Pace
Submit questions and answers about Historical Figures - $2.00
Fair
Unrated
Approved
$11.45 / hour
00:10:29 / completion time
Pros
Pay is fair, but could be better (see cons).Cons
Should pay more imo, as more work has been added (now need to cite two sources and give the answer for each question created (10)). Times will be all over on these. I averaged my time on three of these today to get my time, but my times varied by multiple minutes. All writing, and will definitely take longer if you aren't quick at this type of task.
Aug 6, 2020 | 3 workers found this helpful.