TurkerView
  • Requesters
  • Institutions
  • Scripts
  • Queuebicle
  • API
  • Qualifeye
  • Forum
  • Search
  • Login
  • Login
    • Action
    • Another action
    • Something else here
    • Separated link

Search TurkerView

  • Requesters
  • HITs
  • Scripts

Sorry, have to turn this off for a day to try and fix a query search bug!

Cassandra Cohen

Is this your requester account?
Carnegie Mellon University
  • Overview
  • Reviews 6
  • HITs 26

Cassandra Cohen Ratings


Workers feel this requester pays fairly

Unrated

Approves Quickly

No Rejections

No Blocks
Sorry, your browser doesn't support canvas elements.

Cassandra Cohen Wage History


Sorry, your browser doesn't support canvas elements.
Heads up! We'll never hide reviews unless they violate our Terms of Service.

Top Worker Reviews

  • More
    • Best
    • Newest
    • Rejected
    • Hourly (High)
    • Hourly (Low)
    • My Reviews

AfterDarkMark Average Pace
Reviews: 1,229
Points: 4,923
Ratings: 483
Chatbot User Experience Study - $4.00

Low

Unrated

Pending

$8.42 / hour

00:28:30 / completion time

Pros

Tough to review. If this was working properly (see cons), it could probably be done 10+ minutes faster. In it's current form, you might be able to do it 1-2 minutes faster, but most of it is timed pages, so there is not much room to do it faster, and it should pay better as it is now.

*Approved in 3-7 days, but isn't showing as approved yet. 1/25/25*

Cons

Newer requester/ 92% approval, which to be fair, is up from last week when I think it was way lower (like in the 60% range). I think the requester must have reversed a bunch of rejections possibly due to glitches in previous versions or just started approving more fairly.

Instructions say you can chat with the AI for 10-15 minutes, but when the timer hits 10 minutes, it adds more time occasionally, but ends up allowing you to end it right at 15 minutes. Likewise, the 'interview' after is supposed to be 5-10 minutes. The AI interviewer said we were done at 5 minutes, but I had to wait til ten to click finish.

So, that added up to about 10 minutes of wasted time + a little more for some confusion with the password issue and instructions. I think if it took sub 20 minutes it would be fair, but like I said before, I might stay away until this requester fixes the hit or whatnot. Someone that returned and reviewed couldn't get past a certain page, so that would have been even worse.

Mostly writing if that bothers you.

I messaged and emailed the researcher to let them know of the issues. If needed: Cassandra Cohen, Language Technology Institute, Carnegie Mellon University, cassie.a.cohen@gmail.com .
Jan 19, 2025 | 4 workers found this helpful.

AfterDarkMark Average Pace
Reviews: 1,229
Points: 4,923
Ratings: 483
Language Model UX Survey (Generative AI) - $6.00

Generous

Unrated

Approved

$13.09 / hour

00:27:30 / completion time

Pros

ymmv. Did their hit a week ago for $4 that was approved. Can be done faster (see 2nd paragraph in cons for details).

Cons

92% approval. ymmv. Similar to my $4 review, but a bit better pay. Almost all writing with AI bot, if that bothers you.

**I realized that the AI chat and Chatbot review portion will go an extra five minutes if you don't click the arrow to advance pages at almost exactly the time when the in chat timer expires. I missed it on the AI portion, so this took me 5 minutes longer than it could have. But I did click it at the right time on the review part, so that saved me 5 minutes. Effectively this could take 5 minutes less if you catch both timers and 5 minutes more if you miss both. Times will be in low 20s, or like mine, or in the low 30s depending on if you catch 0, 1, or both of the timers when they expire.

Messaged requester again to fix that.

Requester contact info if needed: Cassandra Cohen, Language Technology Institute, Carnegie Mellon University, cassie.a.cohen@gmail.com
Jan 24, 2025 | 2 workers found this helpful.

Raymond James Proficient Worker
Reviews: 5,403
Points: 2,907
Ratings: 110
Language Model UX Survey (Generative AI) - $5.00

Unrated

Unrated

Approved

$13.84 / hour

00:21:41 / completion time

Pros

Interesting Conversation with an AI chatbot.

Cons

Two 10 minute timed conversations required. The second conversation was finished in a few minutes but could not move forward until the timer allowed.
Feb 4, 2025 | 1 worker found this helpful.

Want to see Cassandra Cohen's full profile?

Create Your Account

or Login

Cassandra Cohen


A1RQE1JQK38G6N MTurk Search Contact Requester

Recently Reviewed HITs


Browsing URL Sequence Study - STUDY2025_00000079
Chatbot User Experience Study
Language Model UX Survey (Generative AI)

Ratings Legend

Wage Aggregates

Reward Sentiment

Communication Scores

Approval Tracking

Wage Aggregate Tracking

This is fairly straightforward: we take the completion time & the reward amount (where available) and calculate the average hourly rate for the task. We then apply that number to a simple range based on US minimum wage standards to color-code the data for easy to digest numerical data.

Color Pay Range (Hourly) Explanation
RED < $7.25 / hr Hourly averages below US Federal minimum wage
ORANGE $7.25 - $10.00 / hr Hourly averages between Federal & highest statewide (CA) minimum wages.
GREEN > $10.00 / hr Hourly averages above all US minimum wage standards

Reward Sentiment

Not all HITs are created equal. Sometimes an hourly wage doesn't convey the full story of a HIT's true worth, so we encourage workers to give their opinion on the overall pay of the task. Was it $8/hr to rate pictures of puppies? A worker could justifiably bump up the rating a bit for something so adorable. 10 hours locked in Inquisit? Even for $10/hr many workers would appreciate the heads up on such a task. The Pay Sentiment rating helps connect workers beyond the hard data.

Icon Rating Suggested Guidelines
Underpaid 1 / 5
  • Very low or no pay
  • Frustrating work experience
  • Inadequate instructions
Low 2 / 5
  • Below US min-wage ($7.25/hr)
  • No redeeming qualities to make up for pay
Fair 3 / 5
  • Minimum wages for task (consider SE taxes!)
  • Work experience offers nothing to tip the scales in a positive or negative direction
Good 4 / 5
  • Pay is above minimum wage, or compensates better than average for the level of effort required.
  • The overall work experience makes up for borderline wages
Generous 5 / 5
  • Pay is exceptional.
  • Interesting, engaging work or work environment
  • Concise instructions, well designed HIT.

Communication Ratings

Communication is an underrated aspect of mTurk. Clear, concise directions. A fast response to a clarification question or a resolution to a workflow suggestion can all be valuable aspects of interaction between Requesters & Workers and its worth keeping track of. Plus everyone enjoys the peace of mind knowing that if something does go wrong there will be an actual human getting back to you to solve the issue.

Icon Rating Suggested Guidelines
Unacceptable 1 / 5
  • No response at all
  • Rude response without a resolution
Poor 2 / 5
  • Responsive, but unhelpful
  • Required IRB or extra intervention
Acceptable 3 / 5
  • Responded in a reasonable timeframe
  • Resolves issues to a minimum level of satisfaction.
Good 4 / 5
  • Prompt Response
  • Positive resolution
Excellent 5 / 5
  • Prompt response time
  • Friendly & Professional
  • Helpful / Solved Issues
  • Interacts within the community

Approval Time Tracking

This rating is strictly for approval times. Let's face it, no one wants to mix approval time ratings with how fast a Requester rejects a HIT, so we've saved rejection flags for another category. This provides a more straightforward way to know about how long your HIT might sit pending before paying out. The default auto-approval for most MTurk tasks is 3 days, the maximum is 30 days. We've tried to base our ratings around those data-points.

Icon Rating Approval Time
Very Slow 1 / 5 Over 2 weeks
Slow 2 / 5 ~1 - 2 Weeks
Average 3 / 5 ~3 - 7 Days
Fast 4 / 5 ~1 - 3 Days
Very Fast 5 / 5 ~24 hours or less

Login

Login Failed! Please check your username/password and try again.
TurkerHub Member? Just use your normal TurkerHub credentials to log in to TurkerView.
Don't have an account? Register Here!

2025 TurkerView Privacy Terms Blog Contact