AI Infrastructure Engineer bei Distyl AI

About Distyl AI

Distyl AI develops AI native technologies for humans & AI to collaborate to power the operations of the Global Fortune 1000.

In just 24 months, we’ve rapidly grown to partner with some of the world’s largest enterprises—including F100 telecom, healthcare, manufacturing, insurance, and retail companies—delivering multiple AI deployments with $100M+ impact. Our platform, Distillery, along with our team of AI Engineers, Researchers, and Strategists, is pioneering AI-native systems of work, solving the most complex, high-stakes challenges at scale.

Distyl is founded and led by proven leaders from companies like Palantir, Apple, and top national laboratories. We work in deep partnership with OpenAI, jointly going-to-market at the largest enterprises and collaborating, evaluating, and testing the latest models. Backed by Lightspeed, Khosla, Coatue, industry leaders like Nat Friedman (former GitHub CEO), and board members of over 20+ F500s, Distyl is building the future of AI-powered enterprise

What We Are Looking For

As an experienced AI Infrastructure Engineer, you will play a pivotal role in shaping the foundation of Distyl AI’s platform development. This is a hands-on role for an engineer with both the breadth and depth to build secure, scalable, and easily deployable infrastructure. Your work will ensure our AI platform, Distillery, is reliable across diverse customer-hosted cloud and on-prem environments.

You’ll be responsible for more than just keeping systems running—you’ll architect and evolve the core infrastructure and pipelines that enables our AI-native applications to be delivered to Fortune 500 companies. The ideal candidate is an opinionated, pragmatic engineer energized by the opportunity to define how cutting-edge AI applications are deployed in production at a global scale. Strong communication skills and a demonstrated ability to take ownership are essential.

Key Responsibilities

• Design & Operate Cloud-Native Infrastructure: Architect and manage resilient, scalable deployments across cloud and hybrid environments, leveraging Kubernetes, serverless frameworks, and modern microservices architectures with the infrastructure that powers them.

• Evolve Infrastructure as Code: Drive the development of modular Terraform and GitOps configurations that ensure consistency, repeatability, and speed across multi-cloud environments.

• Advance Automation & CI/CD: Drive our automation strategy by building and refining CI/CD pipelines that enable rapid, reliable deployments. You'll apply modern practices like GitOps and work with a variety of build and deployment tools, such as Gradle, Bazel, Flux, Helm, and GitHub Actions, to reduce operational overhead.

• Embed Security & Compliance: Integrate IAM, secrets management, and secure service-to-service communication into every layer of the infrastructure.

• Drive Observability & Reliability: Establish robust monitoring, logging, and alerting practices with tools like Datadog Prometheus, Grafana, and OpenTelemetry to ensure our systems are performant, secure, and enterprise-ready.

• AgentOps & AI Tooling: Design and build the critical infrastructure for our advanced AI systems. This includes architecting AI toolchains, handling complex agent integrations and agent deployments.

Qualifications

• 6+ years of professional experience in infrastructure, DevOps, or systems engineering roles, with a proven track record of delivering production-grade systems.

• Deep expertise in cloud platforms (Azure, AWS, or GCP) and container orchestration with Kubernetes.

• Strong experience with Infrastructure as Code tools (Terraform, Pulumi, etc.) and GitOps workflows.

• Hands-on experience with CI/CD systems (Flux, ArgoCD, Helm, GitHub Actions, GitLab CI).

• Proficiency in Python and Linux for automation and tooling.

• Solid knowledge of microservices architecture, distributed systems design, networking, security, IAM, and secrets management.

• Familiarity with modern observability stacks (Prometheus, Grafana, OpenTelemetry, DataDog).

• Experience with serverless frameworks and event-driven architectures.

• A demonstrated ownership mindset—able to take initiative, make informed decisions, and drive projects forward.

• Bachelor’s degree in Computer Science, Engineering, or equivalent practical experience.

What We Offer

• The opportunity to shape AI infrastructure for Fortune 500 companies.

• A role at the intersection of cloud, AI, and automation, working alongside elite engineers and AI researchers.

• Competitive salary, benefits, and equity in a high-growth startup.

• Hybrid work environment – 3 days a week in our NYC office.

If you’re passionate about scalable infrastructure, automation, and making AI systems deployable, we’d love to hear from you. Apply now and help define the future of AI-powered enterprise infrastructure!

Note: Distyl is a hybrid working environment and requires in office collaboration 3 days a week. This role will be based in our office in New York City.