Research Ratings
Research Wage History
Top Worker Reviews
Yoyo Average Pace
Search Explanations Human Study - $1.00
Unrated
Unrated
Rejected (All)
$9.97 / hour
00:06:01 / completion time
- HIT Rejected
Pros
Cons
Rejected for missing a hidden attention check, which I feel for HITs like this that seem to be qualifications for larger HITs is rather unnecessary. Especially since you have a little quiz you have to answer before you can even continue onto the actual work, which makes attention checks all the more questionable. (If you can pass the quiz, why is it necessary to make sure you still understand it later?)Basically, in this HIT, you read a sentence, then read two additional sentences that are rewritten versions of it, and judge whether these rewritten sentences will still pull up the same article if plugged into a search engine based on 5 separate criteria, such as semantics and syntactics.
When answering these questions, each word is highlighted and blue, which when clicked on, will bring you back to the top of the page, and give you a paragraph of explanation and some examples of how the question functions.
So, for example, if you're judging a sentence based on "Fluency", you can click the word and it will bring you an explanation. If you're judging it on "Clarity", you can click it and it will explain that, too. Which is very necessary, as by definition, if something is fluent it should be clear, so you'll want to understand the minutia of the differences in how you're supposed to judge the sentences on these criteria.
My issue was that I spent so much time jumping back and forth for each question and the aspect I was judging it on (because remember, all the explanations for how to judge the questions based on these qualities are at the very top of the page, and the questions are the bottom, requiring you to scroll down a ways) that I missed the hidden check, which is set up like all the other questions (complete with button to jump to the top to view the explanation for how to judge it) but at the very end says "(Choose 4)".
So technically my fault, but I feel that this HIT could be more better designed to avoid this. Especially since while you're only judging 2 sentences for the whole HIT, you'll be doing a lot of back and forth and trying to understand the criteria they want in order to give quality work. I actually would not have been rejected if I answered randomly other than that one question, which makes it all the more silly!
Advice to Requester
If you already have a quiz in order to judge if someone understands the HIT, no need to insert attention checks. Especially on a HIT that seems designed to judge whether people qualify for further HITs. That's just overkill.Also, if you're expecting quality work, I think paying Workers more than $1 is fair, especially given how much reading is involved, and how much time it might take them to understand the complexities and differences between the different types of judgements they're making. I completed it a bit over 6 minutes, and I still missed an attention check, so for someone taking it even slower, in order to be super, SUPER careful, the work might not be worth it anymore.
Oct 11, 2022 | 4 workers found this helpful.
Marla Relaxed Pace
Draw bounding boxes around logos - $0.02
Fair
Unrated
Approved
$3.79 / hour
00:00:19 / completion time
Pros
First time working with this requester.Because of high approval rate I took the plunge and did some over a few days.
My first day I did some 20+
They have now all been approved.
Pay could be better, but they are super quick to do and I enjoy them.
Cons
May 7, 2022
shakeita Jones prince Careful Reader
Generating Timelines from Crisis Domain Tweets- multiple hit - $3.00
Unrated
Unrated
Approved
$5.09 / hour
00:35:22 / completion time
Pros
very interesting hit, good pay as allot of attention is needed to complete, although it comes with interesting bonus for high quality work.Cons
Hit can be hectic as the first review could be lengthy taking a whole lot of time to complete
Jun 15, 2022