Portuguese Audio Evaluations Specialist - Freelance AI Trainer Project

Accountabilities:

You will independently create evaluation scenarios, assess conversational AI performance, and produce structured data that helps improve the reliability and quality of advanced audio models.

• Design and conduct realistic role-play scenarios that simulate complex customer support interactions in travel, finance, and technical support.
• Evaluate AI-generated audio conversations against standardized qualitative and quantitative criteria.
• Assess task completion accuracy, conversational naturalness, audio comprehension, and the relevance of responses.
• Review the model's basic programming literacy, including its understanding of JSON structures, functions, methods, and simple logic in customer support contexts.
• Generate diverse, high-quality audio evaluation datasets that reflect real-world expectations for clarity, efficiency, and natural conversation.
• Follow detailed prompts, evaluation rubrics, and technical guidelines to ensure consistent and reliable results.
• Identify weaknesses in model performance and provide structured evaluation outputs to support improvements in conversational AI.

Requirements:

The ideal candidate has strong Portuguese language skills, professional experience in customer-facing or technical support environments, and the ability to evaluate complex conversations systematically. You should be comfortable working independently and following precise technical instructions.

• Native or bilingual proficiency in Portuguese, with strong reading, listening, writing, and speaking skills.
• Professional experience in complex customer support, technical troubleshooting, or conversational AI evaluation.
• Strong analytical abilities and verbal communication skills, including the ability to perform realistic customer support role-plays.
• Basic programming literacy, including familiarity with JSON structures, functions, methods, and simple logic.
• Excellent attention to detail when working with structured prompts, evaluation frameworks, and technical requirements.
• Access to a high-quality microphone to ensure clear and reliable audio input during evaluations.
• A secure computer and high-speed internet connection suitable for remote work.
• Ability to work autonomously as a freelance or independent contractor.

Benefits:

• Compensation ranging from USD 6 to USD 65 per hour, depending on experience, expertise, and geographic location. The final rate may vary from the advertised range.
• Fully remote work arrangement.
• Freelance/independent contractor engagement.
• Opportunity to contribute to the evaluation and improvement of advanced conversational AI models.
• Flexible project-based work environment, subject to project requirements.
• Contractors must provide their own computer and high-speed internet.
• Health insurance and paid time off are not included in this independent contractor engagement.