Experienced Designers: Design Judgment for AI Research

We're running a paid study on how expert designers evaluate and critique creative work. The goal is to translate intuitive design judgment into structured tasks and clear evaluation rubrics. This work directly supports the development of AI models that can better understand and analyze visual design.

You will participate in a remote session to review various design artifacts and provide structured feedback. We will ask you to break down your creative decision-making process and explain how you evaluate quality. You will then help us draft evaluation rubrics based on those expert critiques. The session involves screen-sharing and walking us through your analytical workflow.

We are hiring experienced designers and creative professionals with a strong background in visual critique. We welcome UX/UI designers, graphic designers, art directors, and creative leads. Candidates should have a proven track record of evaluating creative work and building design systems or guidelines.

• Review and critique various visual design artifacts
• Break down intuitive design judgment into structured, repeatable tasks
• Draft clear evaluation rubrics for assessing design quality
• Walk us through your creative decision-making process during a remote call

• Professional experience as a designer, art director, or creative lead
• Strong background in providing visual critique and actionable design feedback
• Comfortable articulating the reasoning behind creative decisions
• Ability to translate subjective design quality into objective rubrics

• You will be engaged as an independent contractor.
• This is a fully remote opportunity that can be completed on your own schedule.
• Opportunities can be extended, shortened, or concluded early depending on needs and performance.
• Your participation will not involve access to confidential or proprietary information from any employer, client, or institution.
• Payments are processed weekly based on services rendered.
• We are unable to support H1-B or STEM OPT candidates at this time.