Tech Innovators: AI Task Creation

We are looking for senior software engineers with strong experience in production systems to develop and refine high-quality tasks that will be used to evaluate and train AI models.

Your expertise in real-world systems, debugging, and engineering workflows will ensure the accuracy, rigor, and practical relevance of these tasks.

You will create and evaluate tasks and responses that simulate real-world engineering scenarios, ensuring technical correctness while capturing structured reasoning, decision-making, and trade-offs.

Job Details

• Design realistic, constrained software engineering tasks covering debugging, system behavior, APIs, databases, and performance trade-offs.
• Define clear evaluation standards and success criteria for engineering solutions.

Compensation

• $240 per approved task
• ~4–6 hours per task (~$60–$40/hour effective rate)
• Minimum of 2 tasks per week; ~8–12 hours minimum
• Payment for all approved tasks will be issued as soon as the study ends
• Async and remote — work on your own schedule

Minimum Qualifications:

• 3+ years of professional software engineering experience in production environments
• Proficiency in at least one major programming language (e.g., Python, JavaScript/TypeScript, Go, Java, etc.)

Strong experience with:

• Debugging complex systems
• Working with APIs, databases, and real-world application workflows
• Identifying and resolving performance or reliability issues
• Analyze problems with structured reasoning
• Design test cases or validation approaches for engineering systems
• Strong problem-solving skills, clear written English communication, and the ability to work independently to meet deadlines

• Design comprehensive technical scenarios for AI evaluation
• Develop structured expected responses and correct solutions
• Evaluate the clarity and technical accuracy of existing tasks
• Provide constructive feedback to enhance task rigor and relevance

• Individuals with a keen interest in advanced technological systems
• Professionals who enjoy solving complex technical challenges
• Thinkers adept at structured analysis and logical reasoning
• Communicators who can articulate technical concepts clearly
• Self-motivated individuals capable of independent work

• You will be engaged as an independent contractor.
• This is a fully remote opportunity that can be completed on your own schedule.
• Opportunities can be extended, shortened, or concluded early depending on needs and performance.
• Your participation will not involve access to confidential or proprietary information from any employer, client, or institution.
• Payments are processed weekly based on services rendered.
• We are unable to support H1-B or STEM OPT candidates at this time.