Lupyan Lab Ratings
Workers feel this requester pays fairly
Approves Quickly
No Blocks
Lupyan Lab Wage History
Top Worker Reviews
Yoyo Average Pace
Do these words sound like what they mean?(~ 7 minutes) - $1.00
Fair
Unacceptable
Rejected (Unfair)
$8.82 / hour
00:06:48 / completion time
- HIT Rejected
Pros
Cons
Takes a long time to complete if you're giving attempting to put any thought into it. You are required to rate 72 words on a scale of 1-7 of how much they sound like what they are.Requestor is unfair in rejecting work too. They claimed I failed too many attention checks and rejected me, but I don't believe they actually looked at my work.
There are 4 attention check questions in total during the study. The first is "Please choose the middle option", so I selected 4, as it was right in the middle, as you can see:
[1] [2] [3] [4] [5] [6] [7]
The next attention check was "Please choose the right-most option", so I chose 7.
Next was "Squares have four sides", so I selected 7, which was written as "[7] Strongly agree".
The last attention check read as "The word red has two letters". This one is a BS question, to be honest. If you disagree you're right, because the word red has 3 letters. However, because it has 3 letters this also means it has 2, meaning if you agree you're still technically right.
In any case, I selected "[1] Strongly disagree" as my answer.
However, my work was rejected for failing "multiple" attention checks. How? My only guess was that for the question about red having 2 letters, you were ACTUALLY supposed to select the number "3", to indicate it has 3 letters, and for the question asking if squares have 4 sides, you were supposed to select "4", indicating it has four sides; even though four is the neutral option, given that 1 and 7 are labeled as "Strongly disagree" and "Strongly agree" respectively, meaning you feel unsure about it having four sides if you answered like that...
In any case, it seems that this Requestor is at best inattentive to checking their work and too eager to reject Workers. At worst, they have no idea what they're doing, and put in attention checks that have to be answered in odd-ways that regular people wouldn't think of, or could be answered correctly in multiple ways, despite them having a "correct" answer in mind.
Edit: Now a week later, I still have yet to hear any response from them. I'm updating my review accordingly.
Advice to Requester
Really THINK about your attention checks before you put them in a study. Ask yourself "Is it possible to correctly answer this multiple ways?", and "Am I being unclear with the way this is written?".Also be more attentive with checking work. As it is, it seems you're probably rushing through and not doing a good job checking, which is very unfair to Workers. For some people, Mturk is their primary source of income, and to waste their time, take back the pay they were owed AND damage their ability to work in the future (by slapping them with a rejection) just because you were not careful is extremely, extremely unfair and callous.
Nov 9, 2022 | 4 workers found this helpful.
bmt Proficient Worker
Picture sorting study(~ 15 minutes) - $1.50 +0.50 bonus Confirmed!
Good
Unrated
Approved
$15.52 / hour
00:07:44 / completion time
Pros
Description: Look at a bunch of figures and decide which categories they belong in. Part 1 is a training round with answers. Part 2 has no answers and an additional bubble scale. There is a feedback form at the end.Possibility for a 50 cent bonus if you score high enough on Part 1. Bonus is disclosed at the end of the study.
Hourly is $11.64/hr without bonus
Cons
- Those faceless CGI marshmallow people freak me out.- No progress bar.
Sep 18, 2020
Hedgmog Careful Reader
Word similarity(~ 20 minutes) - $2.00
Underpaid
Unrated
Approved
$6.98 / hour
00:17:11 / completion time
Pros
Read instructions and complete the practice questions - drag each word that you are given towards the most similar word - there are several pages of these to work through with 4 sliders on each page - there is a short timer on each question so move quickly while working through this - progress bar is pretty accurateCons
Attention Checks included (pretty hard to miss these)
Jan 3, 2022 | 1 worker found this helpful.