Design Expert — AI Grading & Evaluation | Remote
Descrição da Oferta
Job Title: Design Expert
Type: Independent Contractor / Hourly Contract
Compensation: $80-$150 per hour
Location: Remote
Commitment: Flexible, own schedule
Role Overview
Mercor is partnering with a leading AI research organization to engage experienced designers for a project focused on evaluating how well AI systems perform real-world design work. Rather than producing deliverables yourself, you will define what excellent work looks like: designing task-specific grading criteria and scoring completed work samples with rigorous, well-reasoned written justifications.
Key Responsibilities
Design precise, task-specific grading criteria for real-world design deliverables (brand identity systems and guidelines, campaign and marketing visuals, presentation and layout design, packaging concepts, digital and social assets)
Score AI-generated and human work samples against those criteria, with detailed written justifications for every score
Apply consistent, evidence-based judgment so that scores are reproducible and defensible
Incorporate structured feedback from senior reviewers and iterate quickly on your work
Ideal Qualifications
5+ years of professional experience in graphic, brand, or visual design
Background at world-class design studios or creative agencies, or in senior design roles at leading consumer or technology brands
Deep fluency in the day-to-day craft: typography, layout and visual hierarchy, color, composition, brand systems, and articulating critique the way a design lead would in a review
Exceptionally strong written communication, with the ability to explain exactly why a piece of work does or does not meet the bar
Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers
Prior experience with AI training, evaluation, or human-data projects is a strong plus
Application Process
Submit your resume, portfolio, or relevant professional background to get started
Qualified applicants may be asked to complete a brief assessment or submit additional information
Restrictions
We are unable to support H1-B or STEM OPT candidates at this time.
Contract and Payment Terms
You will be engaged as an independent contractor.
This is a fully remote role that can be completed on your own schedule.
Projects can be extended, shortened, or concluded early depending on needs and performance.
Your work at Mercor will not involve access to confidential or proprietary information from any employer, client, or institution.
Payments are weekly on Stripe or Wise based on services rendered.
Work Location: Remote
Como Candidatar-se
Para se candidatar a esta oferta através de plataforma externa, faça login para aceder ao link.