TurkerView
  • Requesters
  • Institutions
  • Scripts
  • Queuebicle
  • API
  • Qualifeye
  • Forum
  • Search
  • Login
  • Login
    • Action
    • Another action
    • Something else here
    • Separated link

Search TurkerView

  • Requesters
  • HITs
  • Scripts

Sorry, have to turn this off for a day to try and fix a query search bug!

Dynamic Decision Making Laboratory

Verified
Carnegie Mellon University
  • Overview
  • Reviews 841
  • HITs 598

Dynamic Decision Making Laboratory Ratings


Workers feel this requester pays well

Good Communication

Approves Quickly

No Rejections

No Blocks
Sorry, your browser doesn't support canvas elements.

Dynamic Decision Making Laboratory Wage History


Sorry, your browser doesn't support canvas elements.
Heads up! We'll never hide reviews unless they violate our Terms of Service.

Top Worker Reviews

  • More
    • Best
    • Newest
    • Rejected
    • Hourly (High)
    • Hourly (Low)
    • My Reviews

margarita Average Pace
Reviews: 1,015
Points: 2,014
Ratings: 136
Make decisions in pairs and earn money!(~ 35 minutes) - $0.50 +7.10 bonus Confirmed!

Good

Excellent

Approved

$11.10 / hour

00:41:05 / completion time

Pros

$1.50 bonus for completing the whole study plus a bonus based on your decisions.
Bonus paid within 2 days.
Requester was very prompt in replying to my email.
Bonus took this from being underpaid to "good".

Cons

Time may vary greatly based on your partner. My partner was obviously too busy doing something else and I kept getting the message to wait for them. The choices were simple and should not have taken any time at all. I emailed the requester while waiting for my partner as it was quite obvious I would run out of time before we finished the hit. They replied promptly and told me I could submit it with my worker ID. We finished just over 160 trials but I still did not have time to complete. Not sure if I will get the $1.50 bonus now.

Advice to Requester

Participants that do not answer within a certain amount of time should not be allowed to continue. I spent far too much time on this hit and still couldn't finish due to my partners inactivity.
Jul 9, 2019 | 2 workers found this helpful.

EFTree Average Pace
Reviews: 38
Points: 183
Ratings: 10
Make decisions and earn money!(~ 30 minutes) - $3.00

Fair

Unrated

Pending

$8.84 / hour

00:20:22 / completion time

Pros

Not very complicated. Easy to do, as long as you have cooperative teammates. Hopefully-good bonus, but we'll see. I got good teammates who were quick to respond and made the HIT seem to fly by.

Cons

Potential 10 minute wait time to get 2 other teammates (I only had to wait a minute). $0 bonus if either teammate disconnects for any reason. $0 payout (forced return) if you disconnect for any reason, but that's understandable enough.
One bad teammate can ruin it for you in multiple ways.
100 decisions needed, with 3 one-click answers per decision, with 30 seconds for each answer, which can go very quickly, or if you have to wait on your teammates for more than 5-10 seconds... can go VERY slowly.
Aug 28, 2020 | 1 worker found this helpful.

j0sh83 Average Pace
Reviews: 5,419
Points: 12,340
Ratings: 1,213
Make cyber security decisions! ​(~ 45 minutes) - $5.00 +11.75 bonus Confirmed!

Generous

Unrated

Approved

$31.26 / hour

00:32:09 / completion time

Pros

Instructions, followed by a brief comprehensive quiz. 60 trials in total, split into three sections: 10 uninformed, 40 informed, and 10 uninformed. Exit survey at the end.

Bonus, up to $15, but YMMV.

Edit: received an $11.75 bonus on 6/11.

Cons

Minimal writing. No progress bar.

No bonus tracking. Have to tally it on your own. Only 40 of the 60 trials are informed, leaving 20 trials to guess if you got it right or not.
Jun 6, 2024 | 5 workers found this helpful.

Want to see Dynamic Decision Making Laboratory's full profile?

Create Your Account

or Login

Dynamic Decision Making Laboratory


A3THLDS04Q4UJO MTurk Search Contact Requester

Recently Reviewed HITs


A fun game of decision making to help keep our systems safe!!(~ 15 minutes)
A fun game of decision making to help keep our systems safe!!(~ 20 minutes)
Be a defender in a cybersecurity game!(~ 45 minutes)
Compensation HIT - "Make binary choices in a Network with other Mturk participants."(~ 1 minutes)
Compensation HIT - "Make binary choices in a Network with other Mturk participants"(~ 1 minutes)

Ratings Legend

Wage Aggregates

Reward Sentiment

Communication Scores

Approval Tracking

Wage Aggregate Tracking

This is fairly straightforward: we take the completion time & the reward amount (where available) and calculate the average hourly rate for the task. We then apply that number to a simple range based on US minimum wage standards to color-code the data for easy to digest numerical data.

Color Pay Range (Hourly) Explanation
RED < $7.25 / hr Hourly averages below US Federal minimum wage
ORANGE $7.25 - $10.00 / hr Hourly averages between Federal & highest statewide (CA) minimum wages.
GREEN > $10.00 / hr Hourly averages above all US minimum wage standards

Reward Sentiment

Not all HITs are created equal. Sometimes an hourly wage doesn't convey the full story of a HIT's true worth, so we encourage workers to give their opinion on the overall pay of the task. Was it $8/hr to rate pictures of puppies? A worker could justifiably bump up the rating a bit for something so adorable. 10 hours locked in Inquisit? Even for $10/hr many workers would appreciate the heads up on such a task. The Pay Sentiment rating helps connect workers beyond the hard data.

Icon Rating Suggested Guidelines
Underpaid 1 / 5
  • Very low or no pay
  • Frustrating work experience
  • Inadequate instructions
Low 2 / 5
  • Below US min-wage ($7.25/hr)
  • No redeeming qualities to make up for pay
Fair 3 / 5
  • Minimum wages for task (consider SE taxes!)
  • Work experience offers nothing to tip the scales in a positive or negative direction
Good 4 / 5
  • Pay is above minimum wage, or compensates better than average for the level of effort required.
  • The overall work experience makes up for borderline wages
Generous 5 / 5
  • Pay is exceptional.
  • Interesting, engaging work or work environment
  • Concise instructions, well designed HIT.

Communication Ratings

Communication is an underrated aspect of mTurk. Clear, concise directions. A fast response to a clarification question or a resolution to a workflow suggestion can all be valuable aspects of interaction between Requesters & Workers and its worth keeping track of. Plus everyone enjoys the peace of mind knowing that if something does go wrong there will be an actual human getting back to you to solve the issue.

Icon Rating Suggested Guidelines
Unacceptable 1 / 5
  • No response at all
  • Rude response without a resolution
Poor 2 / 5
  • Responsive, but unhelpful
  • Required IRB or extra intervention
Acceptable 3 / 5
  • Responded in a reasonable timeframe
  • Resolves issues to a minimum level of satisfaction.
Good 4 / 5
  • Prompt Response
  • Positive resolution
Excellent 5 / 5
  • Prompt response time
  • Friendly & Professional
  • Helpful / Solved Issues
  • Interacts within the community

Approval Time Tracking

This rating is strictly for approval times. Let's face it, no one wants to mix approval time ratings with how fast a Requester rejects a HIT, so we've saved rejection flags for another category. This provides a more straightforward way to know about how long your HIT might sit pending before paying out. The default auto-approval for most MTurk tasks is 3 days, the maximum is 30 days. We've tried to base our ratings around those data-points.

Icon Rating Approval Time
Very Slow 1 / 5 Over 2 weeks
Slow 2 / 5 ~1 - 2 Weeks
Average 3 / 5 ~3 - 7 Days
Fast 4 / 5 ~1 - 3 Days
Very Fast 5 / 5 ~24 hours or less

Login

Login Failed! Please check your username/password and try again.
TurkerHub Member? Just use your normal TurkerHub credentials to log in to TurkerView.
Don't have an account? Register Here!

2025 TurkerView Privacy Terms Blog Contact