Computer Vision Turk Ratings
Workers feel this requester pays fairly
Approves Quickly
No Rejections
Blocks Reported
Computer Vision Turk Wage History
Top Worker Reviews
sarin Unreliably Fast
Answer Simple Question about Image - $0.12
Generous
Unrated
Approved
$39.27 / hour
00:00:11 / completion time
Pros
Actual hourly: $42.79/hr over 758 HITs (yes this is real)TL;DR: big brainless bountiful batch
This batch pays well for the dumbest reason. The requester is throwing all of their object names into each image and seeing which one applies, which results in 99% of the given objects not being in the image. This means that most of the time, you can comfortably select 'No' for all the objects in the image.
There is only one image in each HIT, and most of the images are typical everyday images. They are simple most of the time, and you can almost always figure out the setting of the image, which can make determining objects even easier.
They provide keybinds for the HIT, and you can rifle through the objects super quick with these keybinds. With multiple tabs and the provided keybinds, you can make this batch extremely lucrative.
The requester has consistently posted work around 10AM and 9PM CST every day. When they post work, they drop big batches and smaller batches for several hours at a time, which means it should be available for everyone.
All of the above make the batch pay as well as it does, and it makes for a good batch to increase your numbers on as well.
The requester uses a somewhat closed qual system. You're given a 'tutorial' HIT, then the HIT after that is what they use to screen for good workers. If you don't submit adequate work, you'll be locked out of the requester's HITs until they post a new HIT with [NEW BATCH]. This requester generally knows what they're doing and how to get the best data out of mturk.
Cons
TL;DR: minor annoyances, misleading pay, annoying keybindsThe hourly fluctuates a lot between images. Sometimes you're given really easy images with a few objects, other times you're given images of crowds or food with tens of objects in them, which requires more careful looking.
When you miss a keybind or don't answer, there will be an annoying fullscreen popup telling you that you didn't select an answer, which can ruin your flow.
The keybinds theirselves are very annoying and straining to use. The keybinds you'll use the most are Ctrl+N to go to the next object, and Ctrl+B to go back to an object. These keybinds require you to stretch out your hand and constantly press N or B, which strains your hand very fast. This can be worked around using macros, or by having a stack of coins or something similar to hold the Ctrl key down.
Every 20-25 HITs or so, you'll get the 'gentle reminder' that adds an unnecessary click to the HIT. This reminder doesn't really mean anything, as you can't be too careful on an image that you can spam 'No' on 95% of the time.
The instructions say you'll only have to answer 8 questions, but in reality you're answering 10 every time, so this HIT misleads you somewhat. This means they should be paying at a rate of about 1.5 cents/question, so in a perfect world they would pay 15 cents for each HIT.
Sometimes, the image will blur and move around in an annoying, nauseating way. According to some workers, this can be fixed by blocking an element that causes the blur.
Very rarely, you will come across an image with scantily clad women. This may be a pro if you're into that, but otherwise this is somewhat adult content that isn't disclosed by the requester.
Mar 5, 2019 | 20 workers found this helpful.
sarin Unreliably Fast
Spot All Objects of a Particular Type - $0.20
Good
Unrated
Approved
$16.00 / hour
00:00:45 / completion time
Pros
Actual hourly: $16.32/hr over 782 HITsThis batch is posted consistently around the morning and evening on weekdays
Thousands of HITs when they're posted, so you can grind them out for hours
Can reload instead of return to get a new keyword to label with if you don't want to hurt your return rate for some reason
Good interface, can usually locate what's labeled and zoom in feature can help you properly label objects
Usually fast to load pictures
Can go back and fix your work if you miss something
Get to laugh at idiot workers that label pizza as a book, for example
Easy keywords can boost your hourly
Same day approval
No qualifications needed apart from 98% approval rate
1 hour timer, so you can fill your queue with these
Good keyword examples:
laptop, monitor, keyboard, computer mouse, plate, toilet, any large animal
Cons
Instructions page adds an unnecessary click to start the HIT, and the 'gentle reminder' adds another clickPictures with large filesizes will kill your hourly as they take forever to load
Pictures load one at a time as you progress, which hurts the hourly somewhat
Pictures with large crowds of people, groups of objects, or small/thin objects are hard/tedious to label, and you're better off just F5'ing
Rarely get the 'Index of /' page, forcing you to F5 or return
Small pictures cause your spotting tool to place the spot away from where you click, which is annoying to get used to
The initial object label is red, which can blend into red objects easily, turning the HIT into the worst scavenger hunt
When labeling, your spots are blue, which also blends into blue objects, making it harder to verify your work and whether you're on the object or not
Only US turkers can work on this batch
When rejecting a photo for not having an object, it will sometimes not add to the 5 photo count for the HIT, which wastes time
Very rarely you will go through a softcore sexual image, but not explicit enough to require the adult worker classification
Hard keywords tank your hourly and kill your morale, and it's especially demotivating when you're forced to either label 20+ objects for the last photo or reload and waste the effort you put into the other 4 photos
Inconsistent on how many objects you need to label
Lots of horror stories about people getting softbanned after doing 2 HITs from this batch
Mind numbing after an hour
Hard keyword examples:
ski, ski pole, signpost, lightbulb, sunglasses, ANYTHING FRUIT/VEGETABLES, book, shoe, knob
Advice to Requester
Have the 'show hint' button for when you need to verify the initial label, as it will save workers a lot of headache trying to find the labels that blend into the object
Jan 9, 2019 | 12 workers found this helpful.
scoot412 Fast Reader
Spot Objects in Image - $0.15
Underpaid
Unrated
Pending
$2.25 / hour
00:04:00 / completion time
Pros
noneCons
The requester's statement that these HITs pay "well above an average mturk HIT" is absurd. I did a handful of these when they first posted (and no items had been marked yet). For starters, images take too long to load. It was nearly impossible to get them done in under two minutes, which makes the pay rate less than $5/hour. Out of curiosity, I tried two later on (after many items had been marked)...between having to skip images because there was nothing left to mark and looking for obsolete things that could be marked, the two I did took me roughly 7 minutes each. Total garbage made worse by the requester touting how well he pays.I've adjusted time as an average and, frankly, am probably being generous.
Advice to Requester
You should test these HITs yourself and then explain how they're so well paid. Images often take seconds to load (on a fast, wired internet connection). Waiting for ten separate images to load takes too long and makes the pay not worth it. Factor in the typing and tagging (x10) and this is some of the most poorly paid batch work on mTurk.
Dec 15, 2018 | 10 workers found this helpful.