TurkerView
  • Requesters
  • Institutions
  • Scripts
  • Queuebicle
  • API
  • Qualifeye
  • Forum
  • Search
  • Login
  • Login
    • Action
    • Another action
    • Something else here
    • Separated link

Search TurkerView

  • Requesters
  • HITs
  • Scripts

Sorry, have to turn this off for a day to try and fix a query search bug!

SurveyComet

Is this your requester account?
Service Account
  • Overview
  • Reviews 6052
  • HITs 4312

SurveyComet Ratings


Workers feel this requester pays well

Good Communication

Approves Quickly

Rejections Reported

No Blocks
Sorry, your browser doesn't support canvas elements.

SurveyComet Wage History


Sorry, your browser doesn't support canvas elements.
Heads up! We'll never hide reviews unless they violate our Terms of Service.

Top Worker Reviews

  • More
    • Best
    • Newest
    • Rejected
    • Hourly (High)
    • Hourly (Low)
    • My Reviews

sarin Unreliably Fast
Reviews: 10,091
Points: 10,085
Ratings: 1,705
PLAY GAMES AND COMPLETE SURVEYS(≈ 100 minutes) - $10.00

Low

Unrated

Approved

$12.82 / hour

00:46:48 / completion time

Pros

Monash University

Play a bunch of IATs masquerading as games on Unity, and complete generic questionnaires pertaining to your life for $10.

The games can be visually interesting and engaging if you want them to be. Think Regan Mandryk (AEOONULLODQWX), but a bit more lame, as there is no general theme that encompasses the 8 or so games in this study.

The study didn't actually take 100 minutes, as it claimed several times in the title and description. They provided a more realistic estimate of 50 minutes in the description as well, however. With a 6 hour timer, as well as breaks provided to you within the games and survey itself, you can work on this in parts in the background if you wanted to.

The survey ends abruptly and gives you the code after completing the last game.

Cons

The games are a bore, as they are all done in Unity and are very repetitive IATs most of the time. The one game that isn't a generic IAT has a forced 8 minute timer. Some of the games don't even attempt to be games, and are just straight up IATs with no interface. All games either have annoying sound effects, annoying music, or both at the same time, so mute the tab if you want to save yourself the ear cancer.

There is no incentive to doing well in the games, and in some games doing well on them means you're going to be stuck doing them for longer. No bonuses for top performers is depressing, and really cuts into workers' motivation when trying to slog through this IAT-riddled study.

Because the games are hosted on Unity, they will pause whenever you remove your focus on the window. This makes it annoying to try to pause or multitask, as you have to devote your entire focus onto the boring IATs.

For the survey questionnaires theirselves, they are a bit personal. They also included several attention checks, and some of the survey pages are very bubbly. They're just as annoying as the games you're playing.

I would avoid this if you don't enjoy doing IATs for this long.
May 3, 2019 | 13 workers found this helpful.

sarin Unreliably Fast
Reviews: 10,091
Points: 10,085
Ratings: 1,705
Response to recent NYT MTurk Article_{Editing}(~ 40 minutes) - $15.00 +5.00 bonus Confirmed!

Generous

Unrated

Approved

$40.16 / hour

00:29:53 / completion time

Pros

I was tasked with editing and proofreading the crowdsourced response to the NYT MTurk article. The crowdsourced response was long, well-written for the most part, and covered pretty much every worker's possible gripe with the misleading article. Editing what other turkers wrote and helping release a crowdsourced article response to represent MTurk was pretty cool and unique.

The people behind this task seemed to know what they were doing, as they recruited writers and editors and spaced the HITs out so only one worker was working on the article at a time. The recruited workers potentially get to have a say on whether the article should be released or not, depending on what the article needs from them.

The pay itself was very generous, as the requester set the pay rate at $22.50/hr, which is one of the highest I've ever seen a HIT advertised for.

11/25 update: I got a $5 bonus for this???

Cons

The way the article was set up, it seemed a bit easy for other workers to potentially screw up and hinder the progress of the article's creation.

Although the article is well written, I am still not sure of how the article would be used, and how edited it would be before the final product.

It is a bit vague on how much work is expected of you before you submit the HIT, so I did a lot of extra work that may or may not have been necessary.
Nov 23, 2019 | 4 workers found this helpful.

SilenceOfTheClams Relaxed Pace
Reviews: 475
Points: 621
Ratings: 68
Individual follow-up: help test counterfactual scenarios. $60 + $40 bonus.(~ 240 minutes) - $60.00

Unrated

Unrated

Pending

$14.99 / hour

04:00:14 / completion time

Pros

It'll give your brain a good workout.

The pay is good, and there is a chance for a hefty bonus.

You don't have to wait for other people to catch up, or feel rushed if others finish faster than you. You can work at your own pace.

It's easier and much less confusing the second time around.

Interface is a simple survey interface and there are less questions to answer and less things to do than in the original task. There are no videos to watch or tutorials you have to go through.

You have upwards of 70 hours to work on it, and you can decide how to divide up your time as long as you submit it before the timer runs out. [I edited my time here to reflect the expected time because I worked on it in chunks and don't have a proper record of how long it took me. But when working with a group, if I remember correctly, it took less than the amount of time they estimated it would take.]

Cons

It does require effort that not everyone will want to or be able to put in.

It can be quite boring and frustrating for some people.

You can't consult other people on your answers.

It takes a good chunk of time.
Jan 19, 2021 | 9 workers found this helpful.

Want to see SurveyComet's full profile?

Create Your Account

or Login

SurveyComet


A3NC2P2SPK9QQ MTurk Search Contact Requester
Top Collaborating Institutions

Monash University Florida International University Yale University York University Hampden-Sydney College The University of British Columbia Southern Connecticut State University University of California, Davis University of Michigan George Washington University

Recently Reviewed HITs


"How do you gather new information?" Survey(≈ 3 minutes)
*New* Dyadic Romantic Relationship Study--Please very carefully read the instructions to this HIT.(~ 30 minutes)
10 minute survey!(~ 10 minutes)
10 Question Survey About Biosimilars(≈ 2 minutes)
15 minute task. Compensation $4.50 ($1.50 if the chat is full and the researcher removes you)(~ 15 minutes)

Ratings Legend

Wage Aggregates

Reward Sentiment

Communication Scores

Approval Tracking

Wage Aggregate Tracking

This is fairly straightforward: we take the completion time & the reward amount (where available) and calculate the average hourly rate for the task. We then apply that number to a simple range based on US minimum wage standards to color-code the data for easy to digest numerical data.

Color Pay Range (Hourly) Explanation
RED < $7.25 / hr Hourly averages below US Federal minimum wage
ORANGE $7.25 - $10.00 / hr Hourly averages between Federal & highest statewide (CA) minimum wages.
GREEN > $10.00 / hr Hourly averages above all US minimum wage standards

Reward Sentiment

Not all HITs are created equal. Sometimes an hourly wage doesn't convey the full story of a HIT's true worth, so we encourage workers to give their opinion on the overall pay of the task. Was it $8/hr to rate pictures of puppies? A worker could justifiably bump up the rating a bit for something so adorable. 10 hours locked in Inquisit? Even for $10/hr many workers would appreciate the heads up on such a task. The Pay Sentiment rating helps connect workers beyond the hard data.

Icon Rating Suggested Guidelines
Underpaid 1 / 5
  • Very low or no pay
  • Frustrating work experience
  • Inadequate instructions
Low 2 / 5
  • Below US min-wage ($7.25/hr)
  • No redeeming qualities to make up for pay
Fair 3 / 5
  • Minimum wages for task (consider SE taxes!)
  • Work experience offers nothing to tip the scales in a positive or negative direction
Good 4 / 5
  • Pay is above minimum wage, or compensates better than average for the level of effort required.
  • The overall work experience makes up for borderline wages
Generous 5 / 5
  • Pay is exceptional.
  • Interesting, engaging work or work environment
  • Concise instructions, well designed HIT.

Communication Ratings

Communication is an underrated aspect of mTurk. Clear, concise directions. A fast response to a clarification question or a resolution to a workflow suggestion can all be valuable aspects of interaction between Requesters & Workers and its worth keeping track of. Plus everyone enjoys the peace of mind knowing that if something does go wrong there will be an actual human getting back to you to solve the issue.

Icon Rating Suggested Guidelines
Unacceptable 1 / 5
  • No response at all
  • Rude response without a resolution
Poor 2 / 5
  • Responsive, but unhelpful
  • Required IRB or extra intervention
Acceptable 3 / 5
  • Responded in a reasonable timeframe
  • Resolves issues to a minimum level of satisfaction.
Good 4 / 5
  • Prompt Response
  • Positive resolution
Excellent 5 / 5
  • Prompt response time
  • Friendly & Professional
  • Helpful / Solved Issues
  • Interacts within the community

Approval Time Tracking

This rating is strictly for approval times. Let's face it, no one wants to mix approval time ratings with how fast a Requester rejects a HIT, so we've saved rejection flags for another category. This provides a more straightforward way to know about how long your HIT might sit pending before paying out. The default auto-approval for most MTurk tasks is 3 days, the maximum is 30 days. We've tried to base our ratings around those data-points.

Icon Rating Approval Time
Very Slow 1 / 5 Over 2 weeks
Slow 2 / 5 ~1 - 2 Weeks
Average 3 / 5 ~3 - 7 Days
Fast 4 / 5 ~1 - 3 Days
Very Fast 5 / 5 ~24 hours or less

Login

Login Failed! Please check your username/password and try again.
TurkerHub Member? Just use your normal TurkerHub credentials to log in to TurkerView.
Don't have an account? Register Here!

2025 TurkerView Privacy Terms Blog Contact