TurkerView
  • Requesters
  • Institutions
  • Scripts
  • Queuebicle
  • API
  • Qualifeye
  • Forum
  • Search
  • Login
  • Login
    • Action
    • Another action
    • Something else here
    • Separated link

Search TurkerView

  • Requesters
  • HITs
  • Scripts

Sorry, have to turn this off for a day to try and fix a query search bug!

ML Researcher

Is this your requester account?
No Institutional Affiliation
  • Overview
  • Reviews 198
  • HITs 461

ML Researcher Ratings


Workers feel this requester pays fairly

Poor Communication

Approves Quickly

Rejections Reported

No Blocks
Sorry, your browser doesn't support canvas elements.

ML Researcher Wage History


Sorry, your browser doesn't support canvas elements.
Heads up! We'll never hide reviews unless they violate our Terms of Service.

Top Worker Reviews

  • More
    • Best
    • Newest
    • Rejected
    • Hourly (High)
    • Hourly (Low)
    • My Reviews

dagodago11 Average Pace
Reviews: 69
Points: 245
Ratings: 41
Follow navigation instruction to the goal location - $0.50

Unrated

Poor

Rejected (Some)

$33.96 / hour

00:00:53 / completion time
  • HIT Rejected

Pros

They are pretty straightforward when the instructions are detailed and do have a good hourly rate.

Cons

Final Update: IRB got back to me on the situation. UCSB has a great IRB department. They were super nice and communicative on figuring out how to resolve this as the rejections were past the 30 day mark and I could no longer have them overturned. The IRB was basically the middleman as the requester would not respond to any messages still. The requester issued out a bonus to compensate for the time spent over the rejections and the bonuses they promised in the HIT for accurate answers. I fully believe the requester would not have sent any bonuses out or shown any concern if the IRB hadn't been involved. Would not work for them again.

Edit: Welp they rejected the HITs I've done but I'm giving them time to see *if* they respond but here's their IRB for reference, as they are a PhD student at UCSB. hsc@research.ucsb.edu

Update #2: Got into contact with their IRB (they responded quickly) and are currently investigating the matter and determining who exactly the requester is in order to rectify the situation. Hopefully this will hinder the requester from using the platform in the future and cease scamming other workers.

Rejected almost instantly with just "X". Cool. I'm assuming the instructions to navigate were not evaluated prior to releasing this batch because some are in broken English or the navigation is VERY, and I mean, VERY VAGUE. For example, some have short instructions like "go to the sink in the bathroom", okay, this house has 4 bathrooms. "Find the lobby" in a small apartment.

Sent them a lengthy email (judging by the past years worth of reviews, I probably won't get a response back) but if they don't respond within the week, I'll be contacting their University's IRB.

Advice to Requester

If you're going to threaten giving out rejections, make sure you're providing workers with a fair shot and QA your HITs before handing out unfair rejections. And respond to emails.
Feb 14, 2022 | 9 workers found this helpful.

StuffAlleySays Average Pace
Reviews: 528
Points: 948
Ratings: 114
Watch a 10-second interesting video and describe it in one sentence (5 per assignment)! - $0.30

Unrated

Unacceptable

Rejected (Some)

$8.57 / hour

00:02:06 / completion time
  • HIT Rejected

Pros

Simple, write description of video in at least ten words.

Cons

Some videos slower to load.
1 of 10 hits completed was rejected, the others were paid. Reason given was 1 did not meet requirements. While this is possible I did try to ensure each description met the 10 word minimum and was phrased according to the rules.

I have emailed the requester and will update with the results and rate communication once that has been completed.

I contacted the requester to inquire about the issue with the hit which was rejected. I was extrememly polite, I explained that knowing what went wrong with the hit would allow me to adjust my response to meet his/her needs more fully. I also offered to correct the error I made and all the typical rejection appeal tactics one would expect. It has been over 3 days and there has yet to be a response. I understand that requesters are not required to communicate with us, however, an unwillingness to reach out to the worker base when posting batch work is just a huge red flag to me. Given that I completed multiple hits and there was only an issue with 1 of them leaves me unable to complete further work if I don't understand where I went wrong.
Jan 17, 2019 | 22 workers found this helpful.

madcat2k Fast Reader
Reviews: 362
Points: 513
Ratings: 62
Follow navigation instruction to the goal location - $0.50

Good

Poor

Rejected

$36.00 / hour

00:00:50 / completion time
  • HIT Rejected

Pros

Good pay, IF it pays.

Cons

Awful requester. I've been burned by them before. Out of all my rejections, 15% comes from this requester alone over 10 years. Anyway, this task is SUBJECTIVE. It asks you to find a location, and you may think you've found it, but no, you're in the wrong place apparently and get insta rejected. 50% of my hits were rejected by this monster, even though I am sure that at least 95% were within 1-2 meters.
Feb 14, 2022 | 3 workers found this helpful.

Want to see ML Researcher's full profile?

Create Your Account

or Login

ML Researcher


A36SGL79NYZZS1 MTurk Search Contact Requester

Recently Reviewed HITs


annotate a subset of table based on a statement
Annotate the quality of text-to-image generation.
annotate the semantic meaning of a statement based on a table
annotate the semantic meaning of a statement based on a table - unique
Answer a survey about conspiracy theories

Ratings Legend

Wage Aggregates

Reward Sentiment

Communication Scores

Approval Tracking

Wage Aggregate Tracking

This is fairly straightforward: we take the completion time & the reward amount (where available) and calculate the average hourly rate for the task. We then apply that number to a simple range based on US minimum wage standards to color-code the data for easy to digest numerical data.

Color Pay Range (Hourly) Explanation
RED < $7.25 / hr Hourly averages below US Federal minimum wage
ORANGE $7.25 - $10.00 / hr Hourly averages between Federal & highest statewide (CA) minimum wages.
GREEN > $10.00 / hr Hourly averages above all US minimum wage standards

Reward Sentiment

Not all HITs are created equal. Sometimes an hourly wage doesn't convey the full story of a HIT's true worth, so we encourage workers to give their opinion on the overall pay of the task. Was it $8/hr to rate pictures of puppies? A worker could justifiably bump up the rating a bit for something so adorable. 10 hours locked in Inquisit? Even for $10/hr many workers would appreciate the heads up on such a task. The Pay Sentiment rating helps connect workers beyond the hard data.

Icon Rating Suggested Guidelines
Underpaid 1 / 5
  • Very low or no pay
  • Frustrating work experience
  • Inadequate instructions
Low 2 / 5
  • Below US min-wage ($7.25/hr)
  • No redeeming qualities to make up for pay
Fair 3 / 5
  • Minimum wages for task (consider SE taxes!)
  • Work experience offers nothing to tip the scales in a positive or negative direction
Good 4 / 5
  • Pay is above minimum wage, or compensates better than average for the level of effort required.
  • The overall work experience makes up for borderline wages
Generous 5 / 5
  • Pay is exceptional.
  • Interesting, engaging work or work environment
  • Concise instructions, well designed HIT.

Communication Ratings

Communication is an underrated aspect of mTurk. Clear, concise directions. A fast response to a clarification question or a resolution to a workflow suggestion can all be valuable aspects of interaction between Requesters & Workers and its worth keeping track of. Plus everyone enjoys the peace of mind knowing that if something does go wrong there will be an actual human getting back to you to solve the issue.

Icon Rating Suggested Guidelines
Unacceptable 1 / 5
  • No response at all
  • Rude response without a resolution
Poor 2 / 5
  • Responsive, but unhelpful
  • Required IRB or extra intervention
Acceptable 3 / 5
  • Responded in a reasonable timeframe
  • Resolves issues to a minimum level of satisfaction.
Good 4 / 5
  • Prompt Response
  • Positive resolution
Excellent 5 / 5
  • Prompt response time
  • Friendly & Professional
  • Helpful / Solved Issues
  • Interacts within the community

Approval Time Tracking

This rating is strictly for approval times. Let's face it, no one wants to mix approval time ratings with how fast a Requester rejects a HIT, so we've saved rejection flags for another category. This provides a more straightforward way to know about how long your HIT might sit pending before paying out. The default auto-approval for most MTurk tasks is 3 days, the maximum is 30 days. We've tried to base our ratings around those data-points.

Icon Rating Approval Time
Very Slow 1 / 5 Over 2 weeks
Slow 2 / 5 ~1 - 2 Weeks
Average 3 / 5 ~3 - 7 Days
Fast 4 / 5 ~1 - 3 Days
Very Fast 5 / 5 ~24 hours or less

Login

Login Failed! Please check your username/password and try again.
TurkerHub Member? Just use your normal TurkerHub credentials to log in to TurkerView.
Don't have an account? Register Here!

2025 TurkerView Privacy Terms Blog Contact