TurkerView
  • Requesters
  • Institutions
  • Scripts
  • Queuebicle
  • API
  • Qualifeye
  • Forum
  • Search
  • Login
  • Login
    • Action
    • Another action
    • Something else here
    • Separated link

Search TurkerView

  • Requesters
  • HITs
  • Scripts

Sorry, have to turn this off for a day to try and fix a query search bug!

Noah Turk

Is this your requester account?
No Institutional Affiliation
  • Overview
  • Reviews 72
  • HITs 49

Noah Turk Ratings


Workers feel this requester pays generously

Unrated

Approves Quickly

Rejections Reported

No Blocks
Sorry, your browser doesn't support canvas elements.

Noah Turk Wage History


Sorry, your browser doesn't support canvas elements.
Heads up! We'll never hide reviews unless they violate our Terms of Service.

Top Worker Reviews

  • More
    • Best
    • Newest
    • Rejected
    • Hourly (High)
    • Hourly (Low)
    • My Reviews

Yoyo Average Pace
Reviews: 68
Points: 1,899
Ratings: 186
Please generate a question and answer pair using two given paragraphs. - $1.50

Good

Unrated

Rejected (Some)

$21.01 / hour

00:04:17 / completion time
  • HIT Rejected

Pros

These can sometimes be easy pay if you manage to get a good combination of paragraphs.

Can be done in only a few minutes sometimes. Meaning you can potentially make something like $18 an hour if all goes well.

Cons

The HITs sometimes do not load, or they take so long you don't have enough time to finish them.

The paragraphs generated don't often give you enough information to actually ask a question.

I've received feedback that the questions need to so specific that a person could not feasibly get any other answer, but this is very difficult to do when you have two snippets of paragraphs taken two entirely unrelated news stories from 2001.

Sometimes both paragraphs were just metadata that a web-crawler seemed to have copied from the website, and I had to form a question around that! It was nearly impossible, and of course, my work was rejected. I received feedback saying that in these cases, I should simply use the SKIP button to get a new paragraph pair. But I tried that while I was working on these HITs! The button does not work, much like the HIT itself half of the time!

I've had 9 of the 58 HITs I submitted rejected, which is just over a 15% rejection rate, and $15 and and an hour of work down the drain. While these HITs SEEM like easy money, there's way too much that can go wrong with them to be worth this much pay and risk of rejection.

If you feel that it's worth it to you, by all means, go ahead. But be sure to throw back any one of these you get that seems like it has the chance to be rejected - especially if it's just a bunch of credit and "written by" info from an old newspaper.

Advice to Requester

You've either got to pre-screen every single paragraph and combination of paragraphs before you send these HITs out, or you have to be much more lienent with the work people are doing, because they're being given impossible tasks and punished for failing to do them.

Also, fixing the HITs so that all of the buttons work would be nice as well! Perhaps making sure they load correctly and in a timely fashion, too?
Nov 12, 2021 | 5 workers found this helpful.

lanaaa Relaxed Pace
Reviews: 4,755
Points: 2,469
Ratings: 201
Please generate a question and answer pair using two given paragraphs. - $1.50

Unrated

Unrated

Rejected (All)

$10.76 / hour

00:08:22 / completion time
  • HIT Rejected

Pros

Cons

Most of the paragraphs make no sense as in they don't have anything to do with one another so it makes it difficult to incorporate both into the answer. Noah is already notoriously hit or miss in terms of even being able to complete any of their hits I should have known that the fact that this batch even loaded was too good to be true. It's just not worth it.

Advice to Requester

I know these are being manually reviewed, I think you should reconsider rejections on hits in which we we did our best with what was given to us. I understand that your instructions were clear but the examples given were way better than what was on the actual hit.
Nov 11, 2021 | 4 workers found this helpful.

meyop88 Relaxed Pace
Reviews: 13,719
Points: 6,207
Ratings: 538
Answer questions about objects in the yellow bounded box within each image - $0.25

Generous

Unrated

Approved

$31.03 / hour

00:00:29 / completion time

Pros

great pay.

Cons

Only 1 min timer. No instructions.
Recognize the object in the yellow box and list 3 properties of it.
Some objects were beyond any recognition.
Dec 11, 2020

Want to see Noah Turk's full profile?

Create Your Account

or Login

Noah Turk


A1U0RB1B8NL5Z2 MTurk Search Contact Requester

Recently Reviewed HITs


Answer questions about objects in the yellow bounded box within each image
Chat with a fellow conversationalist!
Describe 1-word properties about objects in the yellow bounded box within each image
Find objects and annotate them!
Is the question valid?

Ratings Legend

Wage Aggregates

Reward Sentiment

Communication Scores

Approval Tracking

Wage Aggregate Tracking

This is fairly straightforward: we take the completion time & the reward amount (where available) and calculate the average hourly rate for the task. We then apply that number to a simple range based on US minimum wage standards to color-code the data for easy to digest numerical data.

Color Pay Range (Hourly) Explanation
RED < $7.25 / hr Hourly averages below US Federal minimum wage
ORANGE $7.25 - $10.00 / hr Hourly averages between Federal & highest statewide (CA) minimum wages.
GREEN > $10.00 / hr Hourly averages above all US minimum wage standards

Reward Sentiment

Not all HITs are created equal. Sometimes an hourly wage doesn't convey the full story of a HIT's true worth, so we encourage workers to give their opinion on the overall pay of the task. Was it $8/hr to rate pictures of puppies? A worker could justifiably bump up the rating a bit for something so adorable. 10 hours locked in Inquisit? Even for $10/hr many workers would appreciate the heads up on such a task. The Pay Sentiment rating helps connect workers beyond the hard data.

Icon Rating Suggested Guidelines
Underpaid 1 / 5
  • Very low or no pay
  • Frustrating work experience
  • Inadequate instructions
Low 2 / 5
  • Below US min-wage ($7.25/hr)
  • No redeeming qualities to make up for pay
Fair 3 / 5
  • Minimum wages for task (consider SE taxes!)
  • Work experience offers nothing to tip the scales in a positive or negative direction
Good 4 / 5
  • Pay is above minimum wage, or compensates better than average for the level of effort required.
  • The overall work experience makes up for borderline wages
Generous 5 / 5
  • Pay is exceptional.
  • Interesting, engaging work or work environment
  • Concise instructions, well designed HIT.

Communication Ratings

Communication is an underrated aspect of mTurk. Clear, concise directions. A fast response to a clarification question or a resolution to a workflow suggestion can all be valuable aspects of interaction between Requesters & Workers and its worth keeping track of. Plus everyone enjoys the peace of mind knowing that if something does go wrong there will be an actual human getting back to you to solve the issue.

Icon Rating Suggested Guidelines
Unacceptable 1 / 5
  • No response at all
  • Rude response without a resolution
Poor 2 / 5
  • Responsive, but unhelpful
  • Required IRB or extra intervention
Acceptable 3 / 5
  • Responded in a reasonable timeframe
  • Resolves issues to a minimum level of satisfaction.
Good 4 / 5
  • Prompt Response
  • Positive resolution
Excellent 5 / 5
  • Prompt response time
  • Friendly & Professional
  • Helpful / Solved Issues
  • Interacts within the community

Approval Time Tracking

This rating is strictly for approval times. Let's face it, no one wants to mix approval time ratings with how fast a Requester rejects a HIT, so we've saved rejection flags for another category. This provides a more straightforward way to know about how long your HIT might sit pending before paying out. The default auto-approval for most MTurk tasks is 3 days, the maximum is 30 days. We've tried to base our ratings around those data-points.

Icon Rating Approval Time
Very Slow 1 / 5 Over 2 weeks
Slow 2 / 5 ~1 - 2 Weeks
Average 3 / 5 ~3 - 7 Days
Fast 4 / 5 ~1 - 3 Days
Very Fast 5 / 5 ~24 hours or less

Login

Login Failed! Please check your username/password and try again.
TurkerHub Member? Just use your normal TurkerHub credentials to log in to TurkerView.
Don't have an account? Register Here!

2025 TurkerView Privacy Terms Blog Contact