Annotation Engineer at Propio

Description

Propio is on a mission to make communication accessible to everyone. As a leader in real-time interpretation and multilingual language services, we connect people with the information they need across language, culture, and modality. We’re committed to building AI-powered tools to enhance interpreter workflows, automate multilingual insights, and scale communication quality across industries.

We are hiring an Annotation Engineer will oversee the strategy, execution, and quality of data annotation processes critical to Propio's AI development. This role is particularly important for annotating low-resource languages, domain-specific interpretation data, and agentic AI training require high-quality, specialized annotations. The role balances automation, tooling, and human quality control to scale annotation operations efficiently. 

Key Responsibilities:

• Lead annotation projects across translation, speech, and agentic AI, setting guidelines, standards, and timelines tailored to each domain
• Manage and train annotation teams across multiple languages and domains, including low-diffusion languages where expert linguists are scarce
• Collaborate with ML engineers and research teams to define annotation schemas, quality rubrics, and training data requirements
• Implement and maintain QA processes to ensure annotation consistency, accuracy, and compliance with linguistic and domain standards
• Optimize annotation workflows by identifying bottlenecks, exploring automation opportunities (e.g., weak supervision, active learning), and managing tooling
• Manage annotation tooling and infrastructure (labeling platforms, workflow orchestration) to support scaling
• Build relationships with annotation vendors, linguists, and subject matter experts, particularly for low-resource language support
• Monitor data quality metrics and iterate on processes to improve both quality and throughput
• Ensure compliance with data security, privacy, and regulatory standards across all annotation activities

Requirements

Qualifications:

• Bachelor's Degree in Computer Science, Linguistics, Data Science or related field, or equivalent professional experience
• 3+ years of experience in annotation, data labeling, or data operations roles, ideally in ML or AI contexts
• Strong understanding of data quality principles, annotation best practices, and linguistic/domain-specific labeling requirements 
• Experience with labeling platforms and workflow management (Labelbox, Scale, Prodigy) and comfort with custom tooling
• Excellent organizational, communication, and cross-functional collaboration skills
• Familiarity with NLP, speech, translation, or domain-specific data a plus; experience with low-resource language annotations especially valuable

#LI-JS1