Portuguese Generalist Evaluator
Posted 9d ago
Posted by Karokan
karokan.ai
€70–110/hr
0 of 3 steps completed · 0%
Submit your resume or equivalent profile to start. We review background, communication quality, and evidence of relevant execution experience before moving forward.
ⓘ Application steps are reused across roles — you never upload your resume or take the same interview twice.
Role Overview
Review Portuguese instruction following, reasoning accuracy, and localization fidelity for generalist frontier systems.
Karokan is working with AI labs and deployment teams across Europe to contract high-judgment specialists who can improve model quality through reliable human input. This role is designed for experts who can translate nuance into structured outputs, work with clear evaluation rules, and contribute directly to the performance of production AI systems.
You will operate in a fully remote setting, collaborate asynchronously, and help shape datasets, reviews, and decision layers that support the next generation of AI products. The work is intentionally rigorous: accuracy, consistency, and written reasoning matter more than generic throughput.
Key Responsibilities
- Evaluate model outputs in Portuguese across a range of task types
- Score instruction-following quality and reasoning accuracy
- Flag localization failures and cultural mismatches
Ideal Qualifications
- Native or C2 Portuguese proficiency
- Strong analytical skills and attention to detail