Lead Data Engineer (m/f/d) (Madrid, ES) presso BASF – United States

ABOUT US

At BASF Digital Hub Madrid we develop innovative digital solutions for BASF, create new exciting customer experiences and business growth, and drive efficiencies in processes, helping to strengthen BASF´s position as the digital leader in the chemical industry. We believe the right path is through creativity, trial and error and great people working and learning together. Become part of our team and develop the future with us - in a global team that embraces diversity and equal opportunities.

We believe the right path is through creativity, trial and error and great people working and learning together. Become part of our team and develop the future with us - in a global team that embraces diversity and equal opportunities. We are committed to fostering an inclusive workplace and strongly encourage applications from individuals with disabilities. We value diversity and believe that varied perspectives enhance our team's effectiveness. Our hiring practices are designed to ensure equal opportunity for all candidates. 

WHAT YOU CAN EXPECT

At BASF Digital Hub Madrid we develop innovative digital solutions for BASF, create new exciting customer experiences and business growth, and drive efficiencies in processes, helping to strengthen BASF´s position as the digital leader in the chemical industry. We believe the right path is through creativity, trial and error and great people working and learning together. Become part of our team and develop the future with us - in a global team that embraces diversity and equal opportunities.

We are currently seeking a talented Lead Data Engineer to join our team at BASF's Agricultural Solutions department Digital Factory. 

RESPONSIBILITIES

• Design, develop, and maintain data models that support analytical needs across various business domains. 
• Create domain entities to ensure data is organized and accessible for analysis, reporting, and business intelligence with normalized data model
• Collaborate with data analysts, data scientists, and other stakeholders to understand data requirements and translate them into effective data solutions.
• Implement data integration processes using Azure Data Factory, Azure Databricks, and other ETL tools.
• Utilize your deep Python expertise for data manipulation, transformation, and analysis within Azure Databricks. Optimize data storage solutions in Azure, ensuring efficient retrieval and performance.
• Monitor and troubleshoot data ingestion and transformation pipelines and processes to ensure data quality and integrity.
• Maintain documentation of data models, architecture, and processes for reference and compliance.
• Stay updated with the latest trends and technologies in data engineering and Azure services to continuously improve data solutions. 

REQUIREMENTS OF THE POSITION

• Bachelor’s degree preferably in computer science, Information Technology, or a related field. 
• 5+ years of (proven) experience as a Data Engineer in an enterprise context, preferably in an Azure environment.
• Create data pipelines integrating data from a variety of sources including REST APIs, static documents and relational and NOSQL databases
• Experience with data validation and data quality assessment at scale with clear remediation measures
• Expertise in performance optimization of data pipelines (queries, execution etc)
• Strong proficiency in Azure services, including Azure SQL Database, Azure Data Lake, Azure Data Factory, Azure Data Factory and Azure Synapse Analytics.
• Expert Experience with data modelling techniques and methodologies.
• Proficiency in Python for data processing and analysis.
• Expert level knowledge of data processing languages such as SQL and PySpark
• Knowledge of data warehousing concepts and best practices.
• Excellent problem-solving skills
• Strong communication and collaboration skills to work effectively with cross-functional teams and global teams
• Knowledge of data governance and compliance frameworks. 

WHAT WE OFFER

• A secure work environment because your health, safety and wellbeing is always our top priority.
• Flexible work schedule and Home-office options, so that you can balance your working life and private life.
• Learning and development opportunities
• 23 holiday days per year
• 5 additional days (readjustment)
• 2 cultural days
• A collaborative, trustful and innovative work environment
• Being part of an international team and work in global projects
• Relocation assistance to Madrid provided

HOW TO REACH US

If you're interested in the position or know someone who might be and need support on how to take next steps, please send an email to [email protected]