AI Evaluation & Quality Ambassador

Are you passionate about AI, research, and helping improve the quality of next-generation technology?

We're looking for an AI Evaluation & Quality Ambassador to play a critical role in training and improving artificial intelligence systems. In this position, you'll evaluate AI-generated responses, conduct research, provide detailed feedback, and help develop the guidelines that drive consistent, high-quality outcomes.

This role is ideal for someone who enjoys critical thinking, analyzing information, identifying patterns, and delivering clear, actionable feedback. You'll work closely with internal teams to ensure evaluation standards are accurate, scalable, and aligned with project goals while supporting quality assurance initiatives across multiple AI-focused programs.

What You'll Do: AI Evaluation & Rating

• Evaluate AI-generated content across various formats, including text, images, audio, and video.

• Assess outputs using established rating frameworks and quality standards.

• Provide clear, detailed rationale for scoring decisions and recommendations.

• Identify strengths, weaknesses, and trends in AI performance to support model improvement.

• Participate in calibration sessions to ensure evaluation consistency across reviewers.

• Compare multiple AI responses and determine which best meets quality, accuracy, relevance, and safety requirements.

Research & Guideline Development

• Conduct web-based and topic-specific research to validate information and support evaluation decisions.

• Review complex topics and translate findings into clear, actionable feedback.

• Contribute to the creation, refinement, and documentation of evaluation rubrics, rating criteria, and reviewer guidelines.

• Help maintain consistency by identifying ambiguous guidelines and proposing improvements.

• Stay current on emerging AI trends, content standards, and best practices.

Quality Assurance & Auditing

• Perform QA reviews of completed evaluations to ensure adherence to project standards.

• Audit reviewer feedback for accuracy, completeness, and consistency.

• Identify root causes of quality issues and recommend corrective actions.

• Track quality metrics and contribute insights that improve team performance and operational effectiveness.

• Partner with Leads and Managers to continuously enhance quality processes and workflows.

What You'll Bring

• Strong analytical and critical-thinking skills with exceptional attention to detail.

• Experience evaluating AI content, conducting research, reviewing data, or applying quality standards.

• Ability to provide objective, evidence-based feedback and justify decisions clearly.

• Excellent written communication skills with the ability to document findings and recommendations effectively.

• Experience interpreting and applying complex guidelines consistently.

• Strong organizational skills and the ability to manage multiple projects in a fast-paced environment.

• Curiosity about AI technologies and a desire to contribute to their continuous improvement.

• Experience in auditing, content moderation, data annotation, research, or AI evaluation.

Why Join Us?

• Help shape the performance of cutting-edge AI technologies used around the world.

• Work on meaningful projects that directly influence model quality and user experience.

• Collaborate with a talented team focused on innovation, research, and continuous improvement.

• Gain hands-on experience in the rapidly growing field of AI evaluation and quality management.

• Grow your expertise in content analysis, research, and emerging technologies.

Additional Information

• This is a 100% on-site role based in Alpharetta, GA.

• Candidates must be willing and able to work from the office Monday through Friday.

• Remote and hybrid work options are not available for this position.

• This is a full time hourly role.

Activus Connect is unable to provide employer sponsorship for this role.