Postuler maintenant

About the Role

We are looking for an experienced Data Engineer with strong expertise in building and maintaining robust data pipelines, optimizing data workflows, and ensuring the availability of high-quality data for business insights and real-time systems (RTS). The ideal candidate will have hands-on experience with modern data engineering tools, cloud platforms, and big data ecosystems.

Requirements

Key Responsibilities

  • Design, build, and maintain scalable data pipelines and ETL/ELT processes.
  • Work with structured and unstructured datasets to ensure data quality, accuracy, and availability.
  • Collaborate with data scientists, analysts, and business stakeholders to deliver reliable datasets for analytics and reporting.
  • Optimize query performance and ensure real-time/near-real-time data processing for RTS.
  • Implement data security, governance, and compliance standards.
  • Troubleshoot data-related issues and ensure system reliability and scalability.
  • Stay updated with emerging tools and best practices in big data and cloud-based data engineering.

Required Skills & Experience

  • 5–8 years of proven experience as a Data Engineer or in a similar role.
  • Strong proficiency in SQL, Python, or Scala.
  • Hands-on experience with big data technologies (Hadoop, Spark, Kafka, Hive, etc.).
  • Experience with cloud platforms (AWS, Azure, or GCP) and their data services (e.g., Redshift, Snowflake, BigQuery, Data Lake).
  • Strong understanding of ETL/ELT frameworks, data warehousing, and data modeling.
  • Experience with real-time data streaming and processing frameworks.
  • Good knowledge of CI/CD, version control (Git), and DevOps practices.
  • Excellent problem-solving and communication skills.

Nice-to-Have

  • Experience in containerization and orchestration (Docker, Kubernetes, Airflow, etc.).
  • Knowledge of data governance and security best practices.
  • Familiarity with machine learning pipelines.

Education

  • Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field.
Postuler maintenant

Plus d'emplois