QA Professionals: Evaluating Automated Bug Report Prioritization

We're running a paid study on how automated QA tools prioritize bug reports for development teams. Our goal is to determine if human verification steps genuinely improve the usefulness of an automated vulnerability scan. Your feedback directly measures the effectiveness of our current ranking algorithms.

You will review two ranked bug reports side by side, both describing the same automated test of a public website. Without knowing which list has been previously verified by humans, you will evaluate them based on their utility for a team with limited time to fix issues. You will then select the report that provides better prioritization from the top down. Finally, you will provide a brief one-line explanation detailing why you chose that specific ranking.

We are looking for QA engineers, software developers, and technical leads who regularly work with bug reports. You should be familiar with issue triaging and understanding how development teams prioritize fixes. We welcome manual QA testers, automation engineers, and site reliability engineers.

• Review two ranked bug reports from an automated QA scan side by side.
• Evaluate which list provides a more useful prioritization of software issues.
• Select the report that best helps a team fix problems from the top down.
• Write a brief explanation justifying your selection.

• Professional experience in software quality assurance or development
• Familiar with reading and triaging automated bug reports
• Comfortable assessing issue severity and prioritization logic

• You will be engaged as an independent contractor.
• This is a fully remote opportunity that can be completed on your own schedule.
• Opportunities can be extended, shortened, or concluded early depending on needs and performance.
• Your participation will not involve access to confidential or proprietary information from any employer, client, or institution.
• Payment is issued as soon as your work is approved.
• We are unable to support H1-B or STEM OPT candidates at this time.