James Hennessey Ratings
James Hennessey Wage History
Top Worker Review
ChrisTurk Fast Reader
Segment and label objects in this image (All object classes) - $0.01
Underpaid
Unrated
Approved
$1.80 / hour
00:00:20 / completion time
Pros
You only have to annotate one object.Perhaps this penny will be distributed heads up so its lucky?
Approved in 2 days exactly.
Cons
Its image annotation at a penny, that's always going to be difficult to make worth it but the poor layout, design, and server resources behind the HIT make it pretty much impossible.The obvious issue with a penny HIT & images is that if the image loads slowly (which these did) you're already off to a rough start. Requester has them loaded on his crappy private server instead of allowing AWS to handle it for him & deliver content to workers quickly.
You'd think only having to annotate one object would make these somewhat okayish, even passable except that aside from the load times the images are also shared between all workers. So if you get an image that has all or most objects annotated, you're left twiddling your thumbs with nothing to really do or wasting time looking around for something to do. Some images are completely covered by annotation boxes and if you click one it throws an annoying dialog about how you're not allowed to edit someone else's work.
And to top it off the dropbox you have to use once closing in the object annotation to select what kind of object you're labeling is of course clunky and slows down the submission time considerably. It would be nice if the Requester split these up into "annotate doorways", "annotate mirrors" etc so that the dropdown wasn't necessary but that isn't the case for the HITs when I gave them a test run.