Job Posted: 11/14/2024Location: WORLD (limited to where we can hire from as a company. Here are a few countries we can't presently hire from.)Hi there!Are you passionate about leveraging data to transform software products? We’re excited to invite you to join the Zapier Data team as a Senior Data Engineer! In this role, you’ll play a crucial part in shaping the future of data infrastructure at Zapier, developing and implementing technical strategies that drive impactful, scalable, and reliable data solutions across the organization.As a Senior Data Engineer, you’ll lead the creation and optimization of data systems to support Zapier’s growth, collaborating with cross-functional teams to ensure data is trustworthy, timely, and accessible, powering strategic decision-making and user-facing features. About You - Experienced in Data Engineering: You bring 6+ years of experience as a Data Engineer, with a demonstrated ability to lead complex, large-scale data projects in cloud environments. You’re well-versed in modern data platforms and best practices for scalability, performance, and maintainability.
- Strategic Mindset: You connect your team’s data systems to the broader company strategy, proactively identifying opportunities to add value. You’re skilled at planning future-focused projects that enhance stakeholder outcomes and align with organizational goals.
- Technical Leadership: You are an expert in technical direction, including architecture, performance optimization, and improving technical processes. You make high-impact technical decisions that influence architecture and data pipeline strategy across zones, not just within your team.
- Data Pipeline Expertise: You design, build, and optimize complex, scalable data pipelines that drive critical analytics and product use cases. You ensure data assets are robust, reliable, and continuously monitored for performance.
- Proficient in Cloud and Distributed Systems: You have extensive hands-on experience with cloud ecosystems like AWS, GCP, or Azure and deep expertise with Databricks, Spark, or similar distributed platforms, enabling efficient and cost-effective large-scale data processing.
- Advanced Software Lifecycle Management: You take responsibility for every stage of the data solution lifecycle, from design and development to deployment and continuous improvement, and support others in doing the same.
- Programming Mastery: You’re highly skilled in Python or other data-centric languages and have advanced SQL capabilities for complex data transformation and querying.
- Data Quality Advocate: You prioritize data integrity, using observability, testing, and monitoring to ensure quality and accountability in data pipelines. You excel in creating and maintaining frameworks that uphold these standards.
- You are a skilled written communicator. Zapier is a 100% remote team and writing is our primary means of communication. You communicate complex technical topics clearly and in an approachable way.
- Mentorship and Development: You elevate the team’s impact by mentoring and coaching others, sharing best practices, and fostering a culture of learning and continuous improvement. You help other team members achieve their goals and influence growth across teams.
- Innovation. You embrace innovation and continuous improvement, refine processes, streamline workflows, and embrace change as an opportunity for growth
- You understand that perfect is the enemy of good. You will default to action by initially shipping solutions that simply work and work simply while iterating as needed.
Things You’ll Do - Drive Data Pipeline Strategy: Design, develop, and oversee robust ETL/ELT pipelines using Databricks, Airflow, and cloud-native tools, supporting both product and machine learning use cases with a focus on scalability and reliability.
- Lead Data Architecture Efforts: Define and refine data architecture in partnership with engineering and analytics teams, optimizing workflows, storage, and schema design to support secure and scalable data systems.
- Ensure Data Quality and Observability: Develop and implement automated testing, monitoring, and validation frameworks to guarantee data integrity and detect issues proactively. You will participate in on-call rotation for data-owned services.
- Optimize System Performance: Continuously tune, maintain, and optimize the performance of data workflows, leading efforts to resolve bottlenecks in data ingestion, transformation, and storage.
- Build Scalable Data Platform Tools: Design reusable data platform tools and frameworks to empower other teams, establishing self-service capabilities that enhance data accessibility and usability across workflows.
- Collaborate Cross-Functionally: Work closely with Product, Analytics, and Machine Learning teams to support their data needs, helping them achieve impactful outcomes through reliable, timely data.
- Mentor and Develop Team Talent: Act as a key resource for both junior and senior team members, providing guidance, feedback, and support to foster expertise and drive a culture of continuous learning.
How To ApplyAt Zapier, we believe that diverse perspectives and experiences make us better, which is why we have a non-standard application process designed to promote inclusion and equity. We're looking for the best fit for each of our roles, regardless of the type of companies in your background, so we encourage you to apply even if your skills and experiences don’t exactly match the job description. All we ask is that you answer a few in-depth questions in our application that would typically be asked at the start of an interview process. This helps speed things up by letting us get to know you and your skillset a bit better right out of the gate. Please be sure to answer each question; the resume and CV fields are optional.Education is not a requirement for our roles; however, if you receive an offer, you will need to include your most recent educational experience as part of our background check process.After you apply, you are going to hear back from us—even if we don’t see an immediate fit with our team. In fact, throughout the process, we strive to never go more than seven days without letting you know the status of your application. We know we’ll make mistakes from time to time, so if you ever have questions about where you stand or about the process, just ask your recruiter!Zapier is an equal-opportunity employer and we're excited to work with talented and empathetic people of all identities. Zapier does not discriminate based on someone's identity in any aspect of hiring or employment as required by law and in line with our commitment to Diversity, Inclusion, Belonging and Equity. Our code of conduct provides a beacon for the kind of company we strive to be, and we celebrate our differences because those differences are what allow us to make a product that serves a global user base. Zapier will consider all qualified applicants, including those with criminal histories, consistent with applicable laws.Zapier is committed to inclusion. As part of this commitment, Zapier welcomes applications from individuals with disabilities and will work to provide reasonable accommodations. If reasonable accommodations are needed to participate in the job application or interview process, please contact [email protected].Application DeadlineThe anticipated application window is 30 days from the date job is posted, unless the number of applicants requires it to close sooner or later, or if the position is filled.Even though we’re an all-remote company, we still need to be thoughtful about where we have Zapiens working. Check out this resource for a list of countries where we currently cannot have Zapiens permanently working.
