TurkerView
  • Requesters
  • Institutions
  • Scripts
  • Queuebicle
  • API
  • Qualifeye
  • Forum
  • Search
  • Login
  • Login
    • Action
    • Another action
    • Something else here
    • Separated link

Search TurkerView

  • Requesters
  • HITs
  • Scripts

Sorry, have to turn this off for a day to try and fix a query search bug!

Noah Turk

Is this your requester account?
No Institutional Affiliation
  • Overview
  • Reviews 1239
  • HITs 248

Noah Turk Ratings


Workers feel this requester pays generously

Poor Communication

Approves Quickly

Rejections Reported

No Blocks
Sorry, your browser doesn't support canvas elements.

Noah Turk Wage History


Sorry, your browser doesn't support canvas elements.
Heads up! We'll never hide reviews unless they violate our Terms of Service.

Top Worker Reviews

  • More
    • Best
    • Newest
    • Rejected
    • Hourly (High)
    • Hourly (Low)
    • My Reviews

Yoyo Average Pace
Reviews: 68
Points: 1,899
Ratings: 186
Describe the short video using the given characters - $0.27

Fair

Poor

Rejected (Some)

$5.72 / hour

00:02:50 / completion time
  • HIT Rejected

Pros

* Can be easy to do if you're quick enough.
* Good pay if you can knock out a bunch in a day.

Cons

* Can sometimes take a while to load.

* Not able to be done on mobile

* Can sometimes require a LOT of writing when there's many things happening at once.

* Rejections will come within hours, but approvals can sometimes take weeks to be paid out.

* Has recently become more rejection happy with these batch of HITs.

I've completed over 3000+ of these HITs, and within the past few days have received 6 rejections with the same reason, "We regrettably inform you that the description you submitted was identified to be too simple. Please be sure to write a detailed description that captures all events that happen in the video.", despite not doing anything different than I've done for months.

When reached out what I should do for the videos in which the character (Mugen) does nothing but runs to the right the entire time, or simply jumps in place once, I was told to describe the environment around the character, such as enemy and item placement and whatnot. However, this is not even always possible, as there are times when the character is around nothing else for the entire video.

So, the only solution is to pad out your writing with superfluous details ("Mugen walks extremely slowly to the right side of the platform it is currently on, never changing pace as it walks across it."), but the HIT warns against being overly descriptive (for example, it says don't write "gray gear" just write "gear"), leaving you in a bit of a bind.

Given that you're being required to write more and more but the pay has not changed, it makes the HIT less and less worth doing. Even while filling out the HITs with tons of extra detail now to avoid rejections, they are still coming in, showing that this HIT may eventually be not worth doing at all soon.

It could be that you simply must write down what every single object and item is doing at every frame in the video, which would mean this HIT is now massively underpaid for 27 cents per HIT if true.

To top all of this off, you are also only allowed to use 2 sentences per description, which creates long, run-on sentences that are practically unreadable. ESPECIALLY if you're required to describe every single object, item, character, on screen at all times as it now seems.

Edit: I've received an additional 4 rejections as of today, which makes me feel that the Requestor is no longer even looking at the work, as I've now taken to writing about every single object, item, and event that happens in the videos. An example of such a description I wrote that was rejected for being "too simple" is as follows:

"Mugen walks to the left, across a long platform, where to the far right the platform raises in the air, and above sits a platform with two boxes sitting side by side, which Mugen passes as it walks, protected by a bubble shield around itself, before coming upon a face also traveling in the same direction, which is passing by a stack of two boxes next to two more boxes lining side by side on the platform. Mugen then leaps to the left and lands upon the face, crushing it immediately, before heading further left and coming to a part of the platform which drops down, which Mugen walks to and does drop down to the lower section of the platform, before heading even further left, to the far left edge of the platform, which Mugen walks across slowly, before dropping off of entirely and falling leftwards towards the ground below where no enemies remain in sight."

Another example:

"Mugen stands on a crate, on a long platform with another crate to the right, and a coin and snail to the far right, with a ladder to the left of it, and a platform on the far left with a stack of crates on it, and a platform below it with another ladder and that connects to it, which a slime moves across, which has another platform below it with a dip on it, that a gear sits on, before Mugen then walks to the right, and drops off of the box it was standing on and falls onto the platform where it continues to keep moving to the right, before eventually picking up the coin as it trails behind the snail, and then leaps onto the snail and crushes it upon catching up with it. Mugen then continues heading forward, as another slime below heads to the right, on the same platform the gear sits, heading towards a coin, while Mugen walks right as well, slowing down as it reaches the edge of the platform it's on, and then walks off of it to drop down below, where it moves to the right as the slime follows it, revealing another dip in the platform to the right, before Mugen takes a few more steps and comes to a complete stop."

I'm almost convinced that the HITs are no longer human moderated, but are being run by some kind of bot, which either has some kind of character counter or word counter, and if you don't meet that specific vague number, your work will automatically be rejected for being too simple.

After doing a bit of math, I've realized that 6% of all the HITs submitted are now coming back as rejections, which is an alarmingly high number for batch work!

Advice to Requester

I would suggest raising the pay if you're going to expect more details, or being less strict with rejections.

It really doesn't feel fair to say that "Mugen walks to the left side of the platform it's on, before stopping and jumping twice in place." isn't descriptive enough when there's nothing around Mugen and it does nothing more. You're basically asking people to fluff up the work and make the descriptions less readable in order to fill out space to make it look like the text is more descriptive than it truly is.

If you're going to ask people to write detailed paragraphs, you also need to allow them to use more than two sentences to do so.

Please be fair more careful with your rejections! It really feels as if there is no one actually looking at the work that's being rejected! When you can spend 5 minutes writing down every detail about every nook and cranny in a video and still get a rejection, it really doesn't seem like there's any oversight at all anymore.
Nov 29, 2021 | 12 workers found this helpful.

nomichi21 New Reviewer
Reviews: 7
Points: 37
Ratings: 12
Describe the short video using the given characters - $0.27

Fair

Unacceptable

Rejected (Unfair)

$7.53 / hour

00:02:09 / completion time
  • HIT Rejected

Pros

Fast hits when they load

Cons

When these load........ I've done hundreds if not thousands of these with no issues but recently they have gone on a rejection spree and have given me 6 rejections in a row with no explanation. When I contact them(it took 4 emails for a reply) they just say my answer wasn't a quality answer... Which makes no sense how can 1000 over a month be ok and 6 out of 20 be bad in the same day.. Needless to say I will be blocking noah just to save my rejection rate. Which out of 10000 hits only 25 rejects and 6 were from noah in a single day.

Advice to Requester

reevaluate your rejection practices and try to actually communicate if something is wrong then work with that person especially when they have done good work for you.
Dec 2, 2021 | 1 worker found this helpful.

sarin Unreliably Fast
Reviews: 10,091
Points: 10,085
Ratings: 1,705
Touch-based Messages in Close `Long-Distance' Relationships - $8.00

Generous

Unrated

Pending

$230.40 / hour

00:02:05 / completion time

Pros

Oculus VR sponsored Qualtrics survey

Answer questions about long distance relationships and how you communicated, then answer questions about how you feel about touch-based messages, then receive code

Okay pay

Cons

Requester info in the survey is vague, as they say the data will be handled by a 'data custodian'

Uses an annoying Qualtrics layout where questions 'breathe' when you move over them

30 minute timer

wtf is this
Jul 23, 2019 | 1 worker found this helpful.

Want to see Noah Turk's full profile?

Create Your Account

or Login

Noah Turk


A35D7XHZ9ZZP5S MTurk Search Contact Requester

Recently Reviewed HITs


"Classify two short videos as same or different (~ 7min)"
"Classify two short videos as same or different (~ 9min)"
"Compare descriptions of two short videos (~ 12min) [0]"
"Compare descriptions of two short videos (~ 12min) [1]"
"Compare descriptions of two short videos (~ 12min) [2]"

Ratings Legend

Wage Aggregates

Reward Sentiment

Communication Scores

Approval Tracking

Wage Aggregate Tracking

This is fairly straightforward: we take the completion time & the reward amount (where available) and calculate the average hourly rate for the task. We then apply that number to a simple range based on US minimum wage standards to color-code the data for easy to digest numerical data.

Color Pay Range (Hourly) Explanation
RED < $7.25 / hr Hourly averages below US Federal minimum wage
ORANGE $7.25 - $10.00 / hr Hourly averages between Federal & highest statewide (CA) minimum wages.
GREEN > $10.00 / hr Hourly averages above all US minimum wage standards

Reward Sentiment

Not all HITs are created equal. Sometimes an hourly wage doesn't convey the full story of a HIT's true worth, so we encourage workers to give their opinion on the overall pay of the task. Was it $8/hr to rate pictures of puppies? A worker could justifiably bump up the rating a bit for something so adorable. 10 hours locked in Inquisit? Even for $10/hr many workers would appreciate the heads up on such a task. The Pay Sentiment rating helps connect workers beyond the hard data.

Icon Rating Suggested Guidelines
Underpaid 1 / 5
  • Very low or no pay
  • Frustrating work experience
  • Inadequate instructions
Low 2 / 5
  • Below US min-wage ($7.25/hr)
  • No redeeming qualities to make up for pay
Fair 3 / 5
  • Minimum wages for task (consider SE taxes!)
  • Work experience offers nothing to tip the scales in a positive or negative direction
Good 4 / 5
  • Pay is above minimum wage, or compensates better than average for the level of effort required.
  • The overall work experience makes up for borderline wages
Generous 5 / 5
  • Pay is exceptional.
  • Interesting, engaging work or work environment
  • Concise instructions, well designed HIT.

Communication Ratings

Communication is an underrated aspect of mTurk. Clear, concise directions. A fast response to a clarification question or a resolution to a workflow suggestion can all be valuable aspects of interaction between Requesters & Workers and its worth keeping track of. Plus everyone enjoys the peace of mind knowing that if something does go wrong there will be an actual human getting back to you to solve the issue.

Icon Rating Suggested Guidelines
Unacceptable 1 / 5
  • No response at all
  • Rude response without a resolution
Poor 2 / 5
  • Responsive, but unhelpful
  • Required IRB or extra intervention
Acceptable 3 / 5
  • Responded in a reasonable timeframe
  • Resolves issues to a minimum level of satisfaction.
Good 4 / 5
  • Prompt Response
  • Positive resolution
Excellent 5 / 5
  • Prompt response time
  • Friendly & Professional
  • Helpful / Solved Issues
  • Interacts within the community

Approval Time Tracking

This rating is strictly for approval times. Let's face it, no one wants to mix approval time ratings with how fast a Requester rejects a HIT, so we've saved rejection flags for another category. This provides a more straightforward way to know about how long your HIT might sit pending before paying out. The default auto-approval for most MTurk tasks is 3 days, the maximum is 30 days. We've tried to base our ratings around those data-points.

Icon Rating Approval Time
Very Slow 1 / 5 Over 2 weeks
Slow 2 / 5 ~1 - 2 Weeks
Average 3 / 5 ~3 - 7 Days
Fast 4 / 5 ~1 - 3 Days
Very Fast 5 / 5 ~24 hours or less

Login

Login Failed! Please check your username/password and try again.
TurkerHub Member? Just use your normal TurkerHub credentials to log in to TurkerView.
Don't have an account? Register Here!

2025 TurkerView Privacy Terms Blog Contact