Angel Chang Ratings
Angel Chang Wage History
Top Worker Reviews
Yoyo Average Pace
Annotate words or phrases in sentences with 3d object labels - $2.00
Underpaid
Unrated
Approved
$4.52 / hour
00:26:34 / completion time
Pros
Cons
It actually took well over half an hour to complete. I did not accept the HIT immediately, because I took the time to read all of the instructions first. When including that, this was extremely underpaid.The interface is very bad. The 3D areas where you annotate objects is sluggish to move around and hard to navigate without it jumping around at random.
Some objects are also not selectable, making the work impossible to complete properly.
An example of this there might be a sentence the reads something like "The orange sofa with a cushion on it sits next to the coffee table. It also sits next to a chair on the left."
In that case you would highlight "The orange sofa" and the two instances of "it" and connect them to the 3D render of the sofa. You would also take the the phrase "the chair" and link it to the chair sitting next to it, by highlighting the text then double clicking the 3D object.
Seems simple enough, but you would also be required to highlight "a cushion" and select it...but the cushion may not be a 3D object you can select. You can search for all objects in the environment from a sidebar as well, so you can know for sure if the object is selectable or not. If it's not...you're at risk.
Even worse is when the text mentions objects that weren't in there. One example was that I had to highlight a bed...in what looked like a kitchen. There was no bed, so I had to skip that entirely, even though, of course, that puts you at risk of rejection. (I left them feedback explaining all of this, of course.)
They're VERY specific this work, despite paying so low for it. The instructions say that even if you get one or two things wrong they will reject your work. So I was very careful to not make any mistakes and highlight any instances of an object, the word "it" or "that" or whatnot, which could refer to a noun. (You also have to make sure you highlight descriptors like "the long table", but not descriptors that come after like "the table that is long", which would just be highlight as "the table" instead. Or selecting "green chair" would be incorrect, but "a green chair" is acceptable. That's how specific they are.)
Still, whatever, I finished the HIT. It was annoying to use, underpaid, and broken, but whatever, I finished it. A day later I get a threatening email. It told me that of the 10 scenes I annotated, only 4 were acceptable to them. They said I did not read the instructions, I did not link objects correctly, I did not highlight determiners and pronouns such as "the northmost one", "the leftmost one", "the one", "another", "this", and so on. (This was very odd, as none of the sentences I encountered use phrases like this, but were usually very straightforward, reading more along the lines of "The rectangular end table is to the left of the door." instead.)
They explained that normally they don't reject work, but mine was so bad they don't have a choice. They hate to do it, but I was just awful, you see.
"Luckily", they went on to give me a forum I could fill out, where I would agree to complete another round of the task for free, and they wouldn't reject me. So long as I agreed to annotate AT LEAST another 10 rooms at minimum, they may reconsider. However, if I did not agree within 24 hours they would reject me without argument.
Now, obviously, this screams blackmail, and sounds insane...But it gets weirder. 2 minutes later they sent me another email saying they approved my work. What. I didn't even know I was at risk of getting rejected or that any of this was going on until about 12 hours later when I saw both emails!
I have no idea if that email was meant for another Worker and was sent to me by mistake, or if I was approved by mistake, or what, but the fact that they're trying to coerce free, additional work out of people does not sit well with me.
Please, please avoid this Requestor for your own sake.
Advice to Requester
1. Don't blackmail your Workers to get extra work. Seriously. That shouldn't even need to be said.2. Better communication. I have no idea if these emails were even meant for me, but they came off as crazy. And again, giving someone 24 hours to respond to your threat is not good communication even what you were asking was reasonable (which it was not)!
3. Clearer instructions. If you feel that these instructions are so difficult for people to follow, then that's on you for not making them clear enough. It takes over 10 minutes just to get through them, then another 30 minutes to do the task, and you're still going to blame the Worker, despite underpaying them by a ton.
4. Pay people a fair wage! If a job takes 30+ minutes to complete, you think it's complex, AND you still want quality work, then you have to pay for it! This should pay at least twice what it does at minimum.
5. Fix the interface. Part of the reason the HIT is so frustrating to use is how slow everything runs, and how difficult it is to navigate. Everything from highlighting the texts to selecting objects to moving around is more difficult than it needs to be, and often results in errors that need to be fixed before moving on, further slowing things down.
6. Check your HITs before you submit them for Workers to work on. If you're asking people to annotate a room and match the text to the 3D objects, then you'd better be certain those objects are selectable or are ACTUALLY in the room.
Jul 28, 2022
jclark19 Average Pace
Annotate words or phrases in sentences with 3d object labels - $2.00
Low
Good
Approved
$7.21 / hour
00:16:38 / completion time
Pros
It's different and fairly easy to do.Cons
Update: Got an email from the requester stating that while my work was "good" I had missed a few things to annotate. Like "the leftmost one"...and then threatens to reject future submissions if any annotations are left out. Okay...this is underpaid anyway, so I won't be working on these anymore.Underpaid for the amount of work should pay at least $3.00 to make it a little more fair pay. I can only do two or three before I have to stop and give my wrist a break.
Advice to Requester
Up the pay a bit or make the hit shorter, don't threaten good workers.
Jun 29, 2022
fjleon Fast Reader
Annotate words or phrases in sentences with 3d object labels - $2.00
Underpaid
Unrated
Approved
$5.04 / hour
00:23:48 / completion time
Pros
quick approval. unique, interesting taskCons
takes too long, interface is hard to navigate to the correct angle, underpaid, threatens to reject in the future, even with an 8/10 score which is what i gotAdvice to Requester
this should pay 6 dollars
Nov 2, 2021 | 4 workers found this helpful.