Content Reviewers: Evaluation of Conversation Summaries

We're running a paid study on the clarity and effectiveness of text summarization. The goal is to determine how well different approaches capture the main points of a conversation without losing important context. Your feedback directly helps us refine how these text summaries are presented to end users.

You will log into our remote platform to complete a series of text-evaluation tasks. For each task, you will read a transcript of a short conversation and two corresponding summaries. You will then compare the summaries side-by-side and select the one that is clearer and more accurate. Finally, you will briefly explain the reasoning behind your choice.

We are looking for fluent English speakers who possess strong reading comprehension skills. We welcome professional editors, content moderators, copywriters, and avid readers who can easily spot clarity issues in written text. Detail-oriented individuals with a knack for quickly digesting conversational dialogue are ideal for this study.

• Read short transcripts of conversations
• Review two distinct summaries for each provided conversation
• Select the summary that offers the clearest and most accurate representation of the original text
• Provide brief explanations detailing why one summary is superior to the other

• Strong reading comprehension and attention to detail
• Comfortable reading and analyzing conversational dialogue
• Ability to clearly articulate why a specific piece of text is easier to read
• Access to a computer with a reliable internet connection

• You will be engaged as an independent contractor.
• This is a fully remote opportunity that can be completed on your own schedule.
• Opportunities can be extended, shortened, or concluded early depending on needs and performance.
• Your participation will not involve access to confidential or proprietary information from any employer, client, or institution.
• Payments are processed weekly based on services rendered.
• We are unable to support H1-B or STEM OPT candidates at this time.