Our Rejection Review system is meant to provide workers a more full form dispute system for getting rejections overturned while removing some of the hassle and frustration from the process.
In doing so, we hope requesters can quickly learn from and recover from typical mistakes made when choosing to approve or reject work on the platform.
Further launch information can be found in our blog post.
In addition to all of TurkerView's existing Terms, Policies, and Agreements all parties utilizing this system should follow MTurk's participation agreement, acceptable use policy, and other terms. Most importantly, all parties must communicate in a polite, professional manner. We are not affiliated or sponsored by Amazon, but since this system acts on their underlying system their policies should be followed.
To protect worker privacy after 90 days disputes will close for outside viewing and may only be accessed by the worker who submitted the dispute.
We built this to enhance MTurk's internal messaging system for the express purpose of getting rejections overturned. With our tool you're able to generate professionally formatted messages and attach proof of proper HIT completion (such as screenshots of the HIT, survey codes, etc).
Moreover, we're currently working on a number of pre-built responses to the most common unfair rejection scenarios on the platform to help workers save time & frustration.
Using this system also allows workers a built in way to elevate a rejection to another party (such as an IRB) without having to duplicate effort. Simply share the case link and you can get back to work!
Most importantly: the system offers requesters a super fast, easy way to immediately overturn your rejection with full documentation and personalized resources to make sure they approve your work.
On top of the information you manually submit, we collect the Worker Id, Assignment Id, and HIT Id to pass onto the requester as well as meta data (requester name/hit info) about the HIT. These fields are required for processing an approval, bonus, or message on the requester's end.
The short answer is: yes. We hide your TurkerView account information from the requester (including in messages back/forth through our system) to prevent third parties from linking your TurkerView account & worker id.
Previously published research showed worker ids could be tied to your Amazon.com profile. This is no longer the case ca. 2018, and we do not believe there is harm in using worker ids for system services. All information shared through this system is information the requester or worker would have access to to begin with.
After submitting a dispute TurkerView will generate a case file & key lock. We then forward the worker to MTurk's internal messaging system and generate a message to the requester with the link included.
The link itself should never be shared with anyone but the requester, or affiliated parties (such as an IRB) as it contains secure information used to validate the case and generate the view.
No. Nor will reviewing a rejected HIT generate a case report. They are totally different systems, sandboxed from each other to ensure privacy & worker security. However, workers are always welcome to submit both a review and a rejection dispute.
We've built this system to make the process easier (and hopefully less contentious) for all parties. Included in that is a specific focus on providing resources and tools to requesters to make the process fast and hassle free. Our 1 minute instructional video can show you how to overturn a rejection with our system with no coding or technical expertise required.
Not necessarily, no, but in many cases we do recommend it. If you're ever unsure feel free to reach out to us through email or reply to the worker directly through our system to ask for more details.
We don't mediate these disputes (as we cannot generally see a lot of pertinent information, like the data submitted to you through the HITs) but can give general advice in many cases.
We require all participants to use this system in accordance with MTurk's AUP & TOS, including polite, professional contact. If you feel a worker has violated that guideline please email us the full dispute link to hello@turkerview.com and we'll take a look.