Homeoffice SDET - AI presso Resilinc

About The RoleAt Resilinc, we build intelligent systems that safeguard the global supply chain. As a pioneer in supply chain risk management, we’re pushing the boundaries of resilience with AI-powered platforms. We are building a team of forward-thinking Agent Hackers (AI SDETs) to join our mission.What’s an Agent Hacker? It’s not just a title — it’s a mindset. You’re the kind of engineer who goes beyond traditional QA, probing the limits of autonomous agents, reverse-engineering their behavior, and designing smart, self-evolving test frameworks. In this role, you’ll be at the forefront of testing cutting-edge technologies, including Large Language Models (LLMs), AI agents, and Generative AI systems. You’ll play a critical role in validating the performance, reliability, fairness, and transparency of AI-powered applications—ensuring they meet high standards for both quality and responsible use.If you think like a tester, code like a developer, and break systems like a hacker — Resilinc is your proving ground.

What You Will Do

Develop and implement QA strategies for AI-powered applications, focusing on accuracy, bias, fairness, robustness, and performance. 

Design and execute automated and manual test cases to validate AI Agents/LLM models, APIs, and data pipelines and good understanding of data integrity, data models, etc 

Assess AI models using quality metrics such as precision/recall and hallucination detection. 

Test AI models for bias, fairness, explainability (XAI), drift, and adversarial robustness. 

Validate prompt engineering, fine-tuning techniques, and model-generated responses for accuracy and ethical AI considerations. 

Service/tool development.

Conduct scalability, latency, and performance testing for AI-driven applications. 

Collaborate with data engineers to validate data pipelines, feature engineering processes, and model outputs. 

Design, develop, and maintain automation scripts using Selenium and Playwright for API and web testing 

Work closely with cross-functional teams to integrate automation best practices into the development lifecycle.

Identify, document, and track bugs while conducting detailed regression testing to ensure product quality. 

What You Will Bring

Proven expertise in testing AI models, LLMs, and Generative AI applications, with hands-on experience in AI evaluation metrics and testing tools like Arize, MAIHEM, and LangTest. 

Strong proficiency in Python for writing test scripts and automating model validation, along with a deep understanding of AI bias detection, adversarial testing, model explainability (XAI), and AI robustness. 

Demonstrate strong SQL expertise for validating data integrity and backend processes, particularly in PostgreSQL and MySQL. 

Strong analytical and problem-solving skills with keen attention to detail, along with excellent communication and documentation abilities to convey complex testing processes and results. 

Why You Will Love It Here

Next-Level QA – Go beyond traditional testing to challenge AI agents, LLMs, and GenAI systems with intelligent, self-evolving test strategies

Agentic AI Frontier – Be at the forefront of validating autonomous, ethical AI in high-impact applications trusted by global enterprises

Full-Stack Test Engineering – Combine Python, SQL, and tools like LangTest, Arize, Selenium & Playwright to test everything from APIs to AI fairness

Purpose-Driven Mission – Join a remote-first team that protects critical supply chains — ensuring vital products reach people when they need them most

Candidarsi ora