Europe, Middle East and AfricaPosition Title: QA EngineerEurope, Middle East and Africa

Europe, Middle East and AfricaReports to: QA Lead & Senior QA Automation Engineer

Europe, Middle East and AfricaLocation: Ireland (remote)Europe, Middle East and Africa

Europe, Middle East and AfricaAbout us:Europe, Middle East and Africa

Europe, Middle East and AfricaCompliance & Risks is the leading provider of product and regulatory compliance SaaS solutions. The combination of our enterprise-grade platform, C2P, extensive global regulatory content, and a team of subject matter experts enables global companies across multiple sectors (consumer electronics, household appliances, apparel, medical devices, and more) to build safe, sustainable products in a world full of change.Europe, Middle East and Africa

Europe, Middle East and AfricaThe company serves 300+ global enterprise customers, including GE, Google, Nike, Amazon, Ikea, Bose, Tesla, Vaillant, Unisys, Samsung and Fujitsu.Europe, Middle East and Africa

Europe, Middle East and AfricaWhat makes C&R a great place to work?Europe, Middle East and Africa

• Europe, Middle East and AfricaWe have an award-winning, remote-first, flexible workplaceEurope, Middle East and Africa
• Europe, Middle East and AfricaWe work with the biggest companies in the world, helping them to comply with regulations and achieve their Environmental, Social, and Governance goalsEurope, Middle East and Africa
• Europe, Middle East and AfricaWe won the Best Health & Wellbeing Strategy Award at the 2023 HR Leadership and Management AwardsEurope, Middle East and Africa
• Europe, Middle East and AfricaOur regulatory experts are at the center of EU policy on AI and contributing to the evolving AI landscapeEurope, Middle East and Africa
• Europe, Middle East and AfricaWe own the world’s most comprehensive database of legislative information, which drives insights and actions, to help customers bring products to market faster with lower risk and ensure ongoing complianceEurope, Middle East and Africa
• Europe, Middle East and AfricaWe strive to continually innovate and invest in the latest technologies so that we solve the job-to-be-done of our customersEurope, Middle East and Africa

Europe, Middle East and AfricaPurpose:Europe, Middle East and Africa

Europe, Middle East and AfricaWe are looking for a highly detail-oriented and experienced QA Engineer to support our generative AI initiatives. The ideal candidate will have a strong technical background, preferably with experience in financial services, regulatory services, or working with large language models. A technical mindset and familiarity with test automation tools are essential for this role. Additionally, the successful candidate will assist with the general QA backlog, including automation tasks, during downtime between AI-related work.Europe, Middle East and Africa

Europe, Middle East and AfricaResponsibilities:Europe, Middle East and Africa

• Europe, Middle East and AfricaDevelop, implement, and maintain comprehensive test plans and test cases for generative AI projects.Europe, Middle East and Africa
• Europe, Middle East and AfricaPerform detailed and thorough testing of AI models, ensuring they meet quality and performance standards.Europe, Middle East and Africa
• Europe, Middle East and AfricaCollaborate with AI developers and Product Owners to understand project requirements and objectives.Europe, Middle East and Africa
• Europe, Middle East and AfricaAgile/Scrum experience with a focus on shift-left QA.Europe, Middle East and Africa
• Europe, Middle East and AfricaUse and maintain test automation frameworks (Cypress, Selenium, pyTest) to streamline the testing process.Europe, Middle East and Africa
• Europe, Middle East and AfricaIdentify, document, and track bugs, and work closely with the development team to resolve issues using bug management and test management systems.Europe, Middle East and Africa
• Europe, Middle East and AfricaConduct performance testing, load testing, and stress testing to ensure robustness of AI models.Europe, Middle East and Africa
• Europe, Middle East and AfricaStay up-to-date with the latest industry trends, tools, and technologies in AI and quality assurance.Europe, Middle East and Africa
• Europe, Middle East and AfricaDevelop tests to verify the accuracy of categorical outputs from AI models, ensuring they correctly identify legal text categorizations (e.g. product categories, topics) from regulatory texts.Europe, Middle East and Africa
• Europe, Middle East and AfricaImplement heuristic checks for free-text outputs, such as PDF summaries, to ensure they are reasonable and contextually accurate.Europe, Middle East and Africa
• Europe, Middle East and AfricaDesign and execute tests to detect AI model hallucinations, ensuring outputs are based on the provided inputs and are not fabricated.Europe, Middle East and Africa
• Europe, Middle East and AfricaCollaborate with domain experts for human evaluation of AI outputs, both categorical and free-text, to identify and rectify any discrepancies or errors.Europe, Middle East and Africa
• Europe, Middle East and AfricaConduct thorough analysis of errors identified during testing to determine if they stem from incorrect labels or issues within the AI model or prompts.Europe, Middle East and Africa
• Europe, Middle East and AfricaAssist with the general QA backlog, including automation tasks and other quality assurance activities, during downtime between AI-related work.Europe, Middle East and Africa

Europe, Middle East and AfricaRequirements:Europe, Middle East and Africa

• Europe, Middle East and AfricaBachelor’s degree in Computer Science, Engineering, or a related technical field.Europe, Middle East and Africa
• Europe, Middle East and AfricaProven experience in a QA role, specifically testing complex technical projects.Europe, Middle East and Africa
• Europe, Middle East and AfricaStrong analytical skills and attention to detail.Europe, Middle East and Africa
• Europe, Middle East and AfricaTechnical background with hands-on experience in test automation tools such as Cypress, Selenium, or pyTest.Europe, Middle East and Africa
• Europe, Middle East and AfricaExperience working with large language models or in financial/regulatory services is highly desirable.Europe, Middle East and Africa
• Europe, Middle East and AfricaExperience testing on data analytic projects using PowerBI or Tableau.Europe, Middle East and Africa
• Europe, Middle East and AfricaKnowledge of scripting and programming languages (e.g., Python, Java).Europe, Middle East and Africa
• Europe, Middle East and AfricaUnderstanding of software development methodologies, including Agile and Scrum.Europe, Middle East and Africa
• Europe, Middle East and AfricaExcellent problem-solving skills and the ability to troubleshoot complex issues.Europe, Middle East and Africa
• Europe, Middle East and AfricaStrong communication skills, both written and verbal, to effectively collaborate with cross-functional teams.Europe, Middle East and Africa

Europe, Middle East and AfricaPreferred Qualifications:Europe, Middle East and Africa

• Europe, Middle East and AfricaExperience with performance, load, and stress testing of AI models.Europe, Middle East and Africa
• Europe, Middle East and AfricaFamiliarity with AI model debugging and inspection tools, such as those provided by LangSmith.Europe, Middle East and Africa
• Europe, Middle East and AfricaFamiliarity with calling AI models for inference (preferably calling LLMs inference APIs) and analysing their outputs is desirable.Europe, Middle East and Africa
• Europe, Middle East and AfricaUnderstanding of the basic AI terms for the purpose of providing more efficient feedback on the bugs in the AI systems and communication with the ML engineers is desirable.Europe, Middle East and Africa

Europe, Middle East and AfricaWhy Join Us:Europe, Middle East and Africa

• Europe, Middle East and AfricaOpportunity to work on cutting-edge AI projects and contribute to shaping the future of technology.Europe, Middle East and Africa
• Europe, Middle East and AfricaCollaborative and inclusive work environment that encourages innovation, creativity, and professional growth.Europe, Middle East and Africa
• Europe, Middle East and AfricaCompetitive compensation package with comprehensive benefits, including health insurance, retirement plans, and opportunities for career development and advancement.Europe, Middle East and Africa

Europe, Middle East and AfricaIf you are passionate about AI and quality assurance, with a desire to ensure the reliability and performance of AI solutions, we invite you to apply for this exciting opportunity! Join us in advancing AI technologies and delivering impactful solutions to our customers.Europe, Middle East and Africa

Europe, Middle East and AfricaWork Location:Europe, Middle East and Africa

Europe, Middle East and AfricaWhile your team will be predominantly distributed in Ireland, if you live near our Cork office you can use the office any time you wish. Also, you may be expected to travel there 2-3 times per year for team and company gatherings.Europe, Middle East and Africa

Europe, Middle East and AfricaCompany HighlightsEurope, Middle East and Africa

• Europe, Middle East and Africa20-30% YoY revenue growth since 2017Europe, Middle East and Africa
• Europe, Middle East and AfricaEstablished global officesEurope, Middle East and Africa
• Europe, Middle East and AfricaTop private equity sponsorship from Luminate Capital PartnersEurope, Middle East and Africa
• Europe, Middle East and Africa90,000+ regulations and standards on the platformEurope, Middle East and Africa
• Europe, Middle East and AfricaA market-leading retention rate over 95%Europe, Middle East and Africa

Europe, Middle East and AfricaWe are a diverse team in Compliance & Risks and we are committed to building and promoting an inclusive place to work for everyone. We strive to attract and retain a diverse range of people into our organization. We aim to increase the diversity of our employee base by growing our diverse talent pipeline, including partnerships with organizations like Resilient Coders, Women who code, Women in Tech. We are committed to equality of opportunity for all employees, by promoting a work environment free from bullying, discrimination or harassment. Compliance & Risks is an equal opportunities employer.Europe, Middle East and Africa