We are hiring Quality Control (QC) evaluators for a project that spans both Search and Linguistic tasks. You will perform quality checks on initial ratings produced by evaluators—validating user intent assessment, query annotation, text classification, and multimedia (video, image, audio) reviews for relevance, accuracy, and guideline adherence. The ideal candidate combines strong language skills with sharp analytical judgment, excellent documentation and feedback skills, and familiarity with short-form video culture
What you will do
Audit samples of initial ratings for relevance, intent alignment, taxonomy compliance, and linguistic quality.
Re-rate items (double-scoring) to verify labels; resolve discrepancies and document decisions.
Perform linguistic quality checks (grammar, tone, clarity, local relevance) and media comprehension reviews.
Classify and track errors using an agreed error taxonomy; surface trends and edge cases.
Provide clear, actionable feedback to evaluators; contribute to guideline clarifications and updates.
Participate in and lead calibration sessions to drive inter-rater agreement.
Track and report QC metrics (e.g., agreement rates, accuracy, error trends) and meet QC SLAs.
Triage escalations, handle ambiguous cases, and ensure data integrity and compliance.
Use internal tools to complete, track, and submit QC tasks accurately.
Project Details
Engagement Type: Freelance
Rate: USD 28/hour
Estimated Hours: 15-30 hours/week
Requirement
English at C1 level or higher.
Native or near-native speaker level in German language with strong reading, writing, and listening comprehension.
Excellent grammar, writing, and proofreading skills.
Strong video and image comprehension; good hearing ability for audio tasks.
Solid understanding of search engines, user intent, and web content.
High attention to detail, consistency, and guideline adherence.
Ability to deliver clear written feedback and rationale.
Preferred qualifications
Experience in QC/QA for text classification, query annotation, data labeling, or search quality evaluation.
Familiarity with short dramas and local short-drama culture/platforms.
Experience with calibrations, sampling, scorecards, and root-cause analysis.
Comfortable working with productivity and quality targets; proficient with spreadsheets/QA tools.
Background in linguistics, communications, media studies, information science, or related field.
These cookies are necessary for the website to function and cannot be turned off in our systems. You can set your browser to block these cookies, but then some parts of the website might not work.
Security
User experience
Target group oriented cookies
These cookies are set through our website by our advertising partners. They may be used by these companies to profile your interests and show you relevant advertising elsewhere.
Google Analytics
Google Ads
We use cookies
🍪
Our website uses cookies and similar technologies to personalize content, optimize the user experience and to indvidualize and evaluate advertising. By clicking Okay or activating an option in the cookie settings, you agree to this.
The best remote jobs via email
Join 5'000+ people getting weekly alerts with remote jobs!