Applied AI Scientist at Pieces

At Pieces, one of our core value statements is that our customer’s mission is a sacred mission… and it's a hard mission. Our hope is to apply advanced AI to make the work of our customers – patient care – easier in as many ways as possible. We use cutting-edge approaches in AI such as agentic AI with clinician-in-the-loop, to help hospitals and healthcare providers reduce documentation and administrative burden, improve communication efficiency, capture revenue, and improve patient outcomes. 

Responsibilities

As an Applied AI Scientist, you will be pivotal in advancing the responsible AI development, deployment, and optimization of our healthcare AI products. The role demands full-stack AI responsibilities and a proactive collaboration with various teams to develop and manage solutions that incorporate a holistic approach to AI system architecture, key generative AI tools, effective data representation, advanced modeling, AI evaluation, adversarial AI strategies, clinical knowledge graphs, and clinician-in-the-loop AI-user interaction. You'll play a vital role in ensuring that our AI systems enhance outcomes for both hospital systems and patients, and uphold our commitment to responsible innovation in healthcare.

Duties and responsibilities include but not limited to:

• Develop the AI evaluation modules under the large language model operations (LLMOps), which includes the components of LLM observability, benchmark datasets, standardization of metrics, evaluation of complex LLM workflow, knowledge graph, etc  

• Implement strategies of AI safety for adversarial detection AI, comprehensive model evaluation, and error analysis, incorporating human feedback for continuous AI model improvement

• Maintain and continuously improve existing data models and AI Engine pipelines, including monitoring performance, resolving production issues, optimizing for scalability, and ensuring robust dataflows across the AI/ML and application stack.

• Apply LLM observability tools, such as LangFuse, Arize Phoenix, Braintrust, etc, for LLM traces, latency and cost awareness, evaluation, and prompt management/deployment.

• Develop data pipelines in AI engine to support a generic data store and data representation, including a meta-data layer for clinical semantics and a vector database for downstream applications

• Develop generative and predictive AI modules and necessary data transformation modules in AI engine alongside agentic AI systems

• Support agentic AI systems development using LangGraph and/or other agentic AI frameworks for the use cases such as AI assistants in both internal applications (e.g. SafeRead) and external ones (e.g. SmarterNotes)

• Collaborate with clinical domain experts and product management teams to translate clinical guidelines into AI modules, ensuring that the developed products align with clinical needs and user requirements.

• Stay updated with the latest AI advancements in the generative AI era, integrating new knowledge into practical applications and contributing to the AI community through professional engagements.

Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

Requirements

We’re looking for an Applied AI Scientist  who’s passionate about using technology to help the most vulnerable. You’re someone who believes the right data can help build better one-to-one relationships with communities in need of extra support. You have expertise in the following areas:

• Bachelor, Master's or Ph.D. in Computer Science, Data Science, Physics, Mathematics, Engineering, Informatics, or a related field

• 3+ years of experience in data analytics and statistical/ML/NLP modeling, with a focus on healthcare applications

• Proven experience with cloud infrastructure and services, particularly in the deployment of AI/ML models

• Expertise in programming with Python and familiarity with AI/ML tools and frameworks

• Familiarity with vibe coding tools, such as Claude Code, Codex, Cursor, Replit, etc

• Demonstrated ability in the development and management of large-scale AI systems

• Proficiency in cloud services (AWS, Azure) and familiarity with EKS clusters, Docker, Kubernetes, and MLOps practices

• Strong background in generative AI, NLP, machine learning, and data science with a passion for innovation in healthcare AI

• Exceptional problem-solving abilities and a commitment to quality and ethical AI practices

• Excellent communication skills, capable of translating complex technical concepts to diverse stakeholders

• Leadership and project management skills, with an ability to drive projects to completion in a fast-paced environment

We offer competitive salaries as well as the following benefits: 

• Shared premiums: medical, dental and vision, plus access to FSA and HSA

• 401K and life insurance

• Flexible vacation and holiday policies

• Flexible work hours, with work-from-home options

• Paid maternity/paternity leave

• A comprehensive tech setup