QA Testers and Developers: Evaluate Automated Website Tests

We are running a paid study on the accuracy and reliability of automated website testing. Evaluating real-world test outputs helps us refine how these systems detect and report visual or functional errors. Your feedback will directly influence how automated testing frameworks flag potential issues for engineering teams.

You will review evidence from an automated test run on a public website, completely remotely. We will provide you with the test's expected outcome, the observed results, and two screenshots for context. For each of the three provided cases, you will analyze the discrepancies and document whether it represents a real failure. Finally, you will assess and rate the severity of any confirmed issues based on the provided evidence.

We are looking for quality assurance professionals, software engineers, and web developers familiar with automated testing. You should be comfortable interpreting test logs, expected versus observed outcomes, and visual UI discrepancies. We welcome QA engineers, frontend developers, SDETs, and manual web testers who understand typical web application behavior.

• Review expected versus observed outcomes from an automated website test.
• Analyze two provided screenshots to verify potential visual or functional errors.
• Determine if the reported discrepancy constitutes a genuine test failure.
• Assess and document the severity of the identified issues across three test cases.

• Professional experience in software quality assurance, web development, or automated testing.
• Familiarity with interpreting expected and observed test results.
• Comfortable evaluating web UI issues through provided screenshots and logs.

• You will be engaged as an independent contractor.
• This is a fully remote opportunity that can be completed on your own schedule.
• Opportunities can be extended, shortened, or concluded early depending on needs and performance.
• Your participation will not involve access to confidential or proprietary information from any employer, client, or institution.
• Payment is issued as soon as your work is approved.
• We are unable to support H1-B or STEM OPT candidates at this time.