C-SATS Mechanical Turk (Production) Ratings
C-SATS Mechanical Turk (Production) Wage History
Top Worker Reviews
ChrisTurk Fast Reader
Rate the skill of a surgeon shown on a video clip - $1.12
Low
Acceptable
Pending
$6.35 / hour
00:10:35 / completion time
Pros
They are consistent about uploading work multiple times a week.The work is interesting and very unique.
Its pretty passive work, you're just watching a video for 95% of the duration of the HIT then answering a few simple questions about your judgement on the surgeon's performance.
They use qualification blocks to prevent poor workers from completing the work, which is more than fair given the penchant for workers to multi-task the HITs.
I updated my review to mark communication as 'acceptable' because apparently they do respond, but only to messages sent to their e-mail address not through the actual mTurk communication portal. That's a bit confusing, especially for newer workers, but at least they do tend to respond sometimes.
Cons
The pay, by itself, is below US Federal minimum wage standards and that is pretty disappointing from a company who has built its business model around mTurk workers. To not even attempt paying minimum wage for the most common HIT type in the batch is, frankly, poor business practice when it is so reliant on the workers to function. At least from my POV.It ends up encouraging workers to look to multi-task the work (or at least helps them justify doing so), which degrades the quality of the work in many cases. Which, in turn, possibly puts the careers of surgeons we're judging or (far worse) the lives of patients at risk if the work is ever heavily relied upon to replace more standard surgeon review boards.
According to Crunchbase they have raised $5.8 million in funding. I hope the CEO, Derek Streat, and Chief Revenue Officer, Sean O'Connor, will look into allocating some of that funding back into the worker pool they have built their fledgling venture off of.
I, personally, have never gotten a reply back to any of the 3 or 4 messages I've sent them over the last year+. They have in the past reached out to worker communities but since I can't get my own personal questions answered I've rated them very negatively for communication - just my experience there and others will (hopefully) have reason to disagree.
Advice to Requester
As your business model matures if you continue to rely on mTurk for work please pay your reviewers a fair wage. $10/hour is my actual recommendation and I think it'd be more than fair if you aggressively monitored & removed workers from the pool who are not giving the work their full attention when this threshold is met.Girl Polar Bear Average Pace
Rate the skill of a surgeon shown on a video clip - $0.90
Unrated
Unrated
Approved
$6.15 / hour
00:08:47 / completion time
Pros
- Although the pay is low, these C-SATS, Inc HITs are great for me since I might be considered as a passive worker (does nothing but watches and listens stuff).- People may find these videos as disgusting or disturbing but they are same as preparing a steak dinner for me.
- Hi Grandma.
- The requester is consistent in posting every day for different batches, but one Hit per batch is allowed. Try to catch a real batch, with a generous pay.
Cons
Hedgmog Careful Reader
Rate the skill of a surgeon shown on a video clip - $1.07
Underpaid
Unrated
Approved
$3.33 / hour
00:19:16 / completion time
Pros
I don't mind doing these. It takes a bit of getting used to as the videos can be gory. This was one of those odd ones where you have to write a comment at certain stages of the video which ruins the hourly rate. The only plus with this is that you can do more than one, it tells you at the end how many you are allowed to do in this type of batch.Cons
Writing requiredAdvice to Requester
I do think with these kind of hits where writing is required you really need to increase the pay accordingly!