Python Empregos à distância e ao domicílio em nan

Hybrid Data Engineer Data Engineer with verification

Zapier · Nigeria · Hybrid

About the job

Job Posted: 11/14/2024Location: WORLD (limited to where we can hire as a company. Here are a few countries we can't presently hire from.)Hi there!Are you passionate about leveraging data to transform software products? We’re excited to invite you to join the Zapier Data team as a Data Engineer! In this role, you’ll help shape the future of data infrastructure at Zapier, working with our modern tech stack to build robust pipelines, enhance data reliability, and drive impactful outcomes across the organization.As a Data Engineer on our team, you’ll focus on creating and optimizing data systems to support Zapier’s growth, collaborating closely with cross-functional teams to ensure our data is trustworthy, timely, and accessible for powering our decision-making and user-facing features.

About You
  • Experienced in Data Engineering: You have 4+ years of experience as a Data Engineer, with a proven track record of building and managing data pipelines and infrastructure in cloud environments. You’re familiar with the intricacies of modern data platforms and the best practices for scalability and performance.
  • Proficient in Data Pipeline Development: You are skilled at building reliable, scalable data pipelines that move, transform, and prepare data across environments, ensuring it’s accessible and actionable for analytics and product use cases.
  • Cloud and Big Data Expertise: You are comfortable working in cloud ecosystems like AWS, GCP, or Azure and have hands-on experience with cloud storage, data warehouses, and big data processing tools.
  • Skilled in Databricks and Distributed Processing: You have in-depth experience with Databricks, Spark, or other distributed processing platforms, using them to process large datasets efficiently and cost-effectively.
  • Software Development Lifecycle This role encompasses the full software lifecycle, including design, development, deployment, monitoring, and continuous improvement of data solutions. You’ll be responsible for every stage of data pipeline and platform development, ensuring robust and scalable systems that meet business needs.
  • Programming Proficiency: You’re highly skilled in Python or another data-centric language, and you have strong SQL capabilities for data transformation and querying. You are comfortable writing efficient, reusable, and maintainable code that adheres to industry best practices.
  • Commitment to Data Quality and Observability: You value data integrity and implement solutions to monitor data quality, observability, and lineage. You use testing, monitoring, and alerting practices to ensure data reliability throughout the pipeline.
  • You are a skilled written communicator. Zapier is a 100% remote team and writing is our primary means of communication. You communicate complex technical topics clearly and in an approachable way.
  • You enjoy collaboration and knowledge sharing. You appreciate our team’s values of eagerness to collaborate with teammates with any level of technical knowledge, iterating over your deliverables, and being curious.
  • Innovation. You embrace innovation and continuous improvement, refine processes, streamline workflows, and embrace change as an opportunity for growth
  • You understand that perfect is the enemy of good. You will default to action by initially shipping solutions that simply work and work simply while iterating as needed.
Things You’ll Do
  • Build and Optimize Data Pipelines: Design, develop, and maintain efficient ETL/ELT pipelines using Databricks, Airflow, and cloud-native tools to support product and machine learning use cases.
  • Collaborate on Data Architecture: Partner with engineering and analytics teams to optimize data storage, processing workflows, and database schemas, ensuring data accessibility, security, and scalability.
  • Manage Data Quality and Integrity: Develop automated testing, monitoring, and validation frameworks to uphold data quality and integrity, implementing best practices in observability and issue detection.
  • Performance Tuning, Maintenance and Optimization: Continuously monitor and optimize the performance of data workflows, identifying and resolving bottlenecks in data ingestion, transformation, and storage. You will participate in on-call rotation for data-owned services.
  • Build Data Platform and Tooling: Design and develop reusable data platform tools, frameworks, and self-service capabilities to empower other teams to efficiently access, analyze, and utilize data within their workflows.
  • Support Cross-Functional Projects: Work closely with Product, Analytics, and Machine Learning teams to support their data needs, helping them achieve their goals through reliable and insightful data.
  • Mentor and Share Knowledge: Act as a resource for junior team members, offering guidance and knowledge-sharing to elevate team expertise and contribute to a culture of learning.
How To ApplyAt Zapier, we believe that diverse perspectives and experiences make us better, which is why we have a non-standard application process designed to promote inclusion and equity. We're looking for the best fit for each of our roles, regardless of the type of companies in your background, so we encourage you to apply even if your skills and experiences don’t exactly match the job description. All we ask is that you answer a few in-depth questions in our application that would typically be asked at the start of an interview process. This helps speed things up by letting us get to know you and your skillset a bit better right out of the gate. Please be sure to answer each question; the resume and CV fields are optional.Education is not a requirement for our roles; however, if you receive an offer, you will need to include your most recent educational experience as part of our background check process.After you apply, you are going to hear back from us—even if we don’t see an immediate fit with our team. In fact, throughout the process, we strive to never go more than seven days without letting you know the status of your application. We know we’ll make mistakes from time to time, so if you ever have questions about where you stand or about the process, just ask your recruiter!Zapier is an equal-opportunity employer and we're excited to work with talented and empathetic people of all identities. Zapier does not discriminate based on someone's identity in any aspect of hiring or employment as required by law and in line with our commitment to Diversity, Inclusion, Belonging and Equity. Our code of conduct provides a beacon for the kind of company we strive to be, and we celebrate our differences because those differences are what allow us to make a product that serves a global user base. Zapier will consider all qualified applicants, including those with criminal histories, consistent with applicable laws.Zapier is committed to inclusion. As part of this commitment, Zapier welcomes applications from individuals with disabilities and will work to provide reasonable accommodations. If reasonable accommodations are needed to participate in the job application or interview process, please contact [email protected].Application DeadlineThe anticipated application window is 30 days from the date job is posted, unless the number of applicants requires it to close sooner or later, or if the position is filled.Even though we’re an all-remote company, we still need to be thoughtful about where we have Zapiens working. Check out this resource for a list of countries where we currently cannot have Zapiens permanently working.