Document Reviewers: Evaluate AI-Generated Sentences

We're running a paid study on reading comprehension and machine-generated text accuracy. The goal is to evaluate whether short sentences written by a computer accurately reflect the information found in brief business documents. This work helps improve how automated systems process and summarize professional text.

You will review eight short, fictional business document excerpts during an independent remote session. For each excerpt, you will read a single computer-generated sentence that describes the text. You will then decide whether the document supports the sentence, contradicts it, or does not provide enough information to tell. The entire task focuses on reading comprehension and requires careful attention to the provided details.

We welcome data annotators, document reviewers, and professionals with strong reading comprehension skills. Candidates should be comfortable quickly reading business text and making definitive judgments based solely on the provided excerpts. Prior experience in proofreading, data annotation, or quality assurance is highly relevant.

• Read eight short, fictional business document excerpts carefully
• Evaluate a single computer-generated sentence for each excerpt
• Determine if the sentence is supported, contradicted, or unsupported by the text
• Base all decisions strictly on the provided document excerpts without using outside knowledge

• Strong reading comprehension in English
• Ability to evaluate text for logical consistency and accuracy
• Comfortable working independently on a focused reading task
• Attention to detail when comparing source documents to summary sentences

• You will be engaged as an independent contractor.
• This is a fully remote opportunity that can be completed on your own schedule.
• Opportunities can be extended, shortened, or concluded early depending on needs and performance.
• Your participation will not involve access to confidential or proprietary information from any employer, client, or institution.
• Payment is issued as soon as your work is approved.
• We are unable to support H1-B or STEM OPT candidates at this time.