Advanced Computing Professionals: Task Development

We are looking for senior AI/ML experts with strong experience in production systems to develop and refine high-quality reasoning tasks that evaluate and train AI models.

Your expertise in machine learning systems, pipelines, and real-world debugging will ensure the accuracy, rigor, and practical relevance of these tasks.

You will create and evaluate prompts and responses that simulate real-world ML workflows, ensuring technical correctness while capturing structured reasoning, decision-making, and trade-offs.

Job Details

• Design realistic, constrained AI/ML tasks covering model debugging, data pipelines, and performance trade-offs.
• Define clear evaluation standards and success criteria for ML solutions.

Compensation

• $240 per approved task
• ~4-6 hours per task (~$60-$40/hour effective rate)
• Minimum of 2 tasks per week; ~8-12 hours minimum.
• Payment for all approved tasks will be issued as soon as the study ends.
• Async and remote — work on your own schedule

Minimum Qualifications:

• 3+ years of professional AI/ML engineering experience in production environments.
• Proficiency in Python and core ML frameworks, with strong expertise in end-to-end ML pipelines and data preprocessing.
• Proven ability to debug model behavior, troubleshoot performance issues, and design benchmarks or test cases for ML systems.
• Strong structured problem-solving skills, clear written English communication, and the ability to work independently to meet deadlines.

• Design realistic tasks for assessing advanced computational systems
• Create evaluation scenarios simulating operational challenges
• Define clear criteria for successful computational outcomes
• Refine prompts to capture system logic and performance

• Individuals passionate about the precision and rigor of advanced computing
• Professionals who enjoy defining high standards for technical performance
• Experts with a deep understanding of complex software operations
• People who value developing clear and effective evaluation methods

• You will be engaged as an independent contractor.
• This is a fully remote opportunity that can be completed on your own schedule.
• Opportunities can be extended, shortened, or concluded early depending on needs and performance.
• Your participation will not involve access to confidential or proprietary information from any employer, client, or institution.
• Payments are processed weekly based on services rendered.
• We are unable to support H1-B or STEM OPT candidates at this time.