Hybrid Data Engineer - Data Platform - Spain (Remote in Spain) Data Engineer - Data Platform - Spain (Remote in Spain)
OLX · nan, · Hybrid
About the job
- Reporting to the Data Platform Engineering Manager, within the Data Platform and Services team
- Collaborate with analytics, data science, and data product management to support our shared Data mission: "We harness data to drive intelligent decisions and deliver products our customers love."
- Contribute to strategic goals and initiatives, taking responsibility for specific results that support the technical and product roadmap.
- Assist in architecting and developing scalable data platform solutions and architectures that support various domains utilizing the data platform, addressing stakeholders' needs.
- Support and collaborate with domain-oriented data teams, ensuring they have the necessary toolkits and processes to operate effectively within the larger Data Mesh framework.
- Participate in identifying and suggesting improvements based on error fixing, debugging, bug fixes, and performance tuning.
- Assist in researching, recommending, testing, and adopting new (big) data technologies and techniques to enhance our data ecosystem.
- Support monitoring of our data ecosystem, identifying inefficiencies, and assisting in automation or fine-tuning of data products to optimize their performance and usability.
- Contribute to enhancing and enforcing governance frameworks and processes to ensure the security and compliance of our data ecosystem.
- Provide support and guidance to less experienced staff members, fostering a collaborative and learning-focused environment.
- 3-5 years of experience creating and maintaining data platforms, implementing complex data pipelines, and working with both technical and business stakeholders.
- Demonstrated experience in designing governed and scalable data architectures and platforms, with a focus on storage and performance optimisation.
- Experience with at least one major cloud data technology (AWS, GCP, or Azure Cloud), with practical experience in architecting solutions within the AWS ecosystem.
- Proficient in Python and SQL, capable of writing efficient, easy-to-read, and clear code, with some experience in Spark and/or Scala.
- Experience working with Redshift, Presto/Trino, Hive/Glue, Kafka and Athena.
- Experience working with AWS services, including S3, DynamoDB, SQS, EC2 Auto Scaling, Kinesis, Lambda, EMR, and general AWS APIs.
- Hands-on experience with CI/CD tools (e.g., GitLab), infrastructure as code (Terraform), containerisation (Docker), and container orchestration (Kubernetes).
- Relevant knowledge of collaborative analytics and orchestration tools (e.g., Airflow, dbt) and open table formats (e.g., Apache Iceberg, Apache Hudi, Delta Lake).
- Relevant knowledge of metadata concepts and tools (e.g. DataHub, OpenMetadata, Marquez).
- Knowledge of the Data Mesh paradigm.
- Excellent written and verbal proficiency in English.
- This role is based in Spain
- Work from home allowance
- Health & dental insurance
- Flexible retribution plan (up to 30% of your salary in products/services such as restaurant ticket, transportation ticket, nursery check)
- Gym membership Language courses (English + Spanish)
- Employee Assistance program - service managed by ComPsych which provides confidential support, resources and information for personal and work-life matters
- Tax declaration assistance - fiscal advisory