Textual Choreography Ratings
Workers feel this requester pays fairly
Approves Quickly
No Blocks
Textual Choreography Wage History
Top Worker Reviews
Naria Proficient Worker
judging meaning similarity of English sentences - $0.22
Generous
Unacceptable
Rejected
$22.63 / hour
00:00:35 / completion time
- HIT Rejected
Pros
Cons
Context, these are hits comparing sentences for intent similarity, you compare a sentence to a given example sentence. You do all this with a slider ranging from "nothing alike" to "identical meaning", or some equivalent phrasing. In the instructions they state that if given two literal identical sentences, to mark them as "identical meaning", which makes sense, however, being sliders this is going to be ballparked a little. It's the nature of sliders, and I was not aware that they needed to be an exact 100/100 or else, which is absurd to begin with.I had mass rejections for these being in the 90-100 range instead of dead on 100.
Actually 1000+ rejections for that reason.
Upon contacting them they basically (in a wordy way) just said they would not be overturning it, and that my data was unusable because of that small inconsistency.
The rejection note makes it seem a lot more cut and dry than it was, but ambiguous wording got me a massive amount of rejects on a closed qual, and they don't seem to care... so consider this your warning label.
Advice to Requester
Avoid mass rejections of account ruining proportions over ambiguous rules.
Feb 22, 2019 | 12 workers found this helpful.
Thank you for doing our HITs. However, we clearly state in the instruction that you need to give sentences identical to the reference 100/100, as a check of attentiveness. You failed all such checks. We have to exclude your submissions to e
jessers Average Pace
Judgments about English sentences - $2.00
Low
Unrated
Approved
$6.00 / hour
00:20:00 / completion time
Pros
Possibility of obtaining a qual for future work.Cons
Threats of a block if they don't like your answers. Yucky.Advice to Requester
I left a message on the HIT about how detrimental mturk blocks are, and encouraged them to use a qualification for a block rather than mturk's system.
Sep 24, 2017 | 3 workers found this helpful.
dgrochester55 Average Pace
Subjective Probability Estimation - $0.15
Unrated
Unrated
Approved
$13.17 / hour
00:00:41 / completion time
Pros
East to get a hang of. Closed qual, batch lasts long time, approval often within 24 hoursCons
Some questions can be hard to estimate.
Jan 21, 2019 | 1 worker found this helpful.