- Senior
- Optionales Büro in Bangalore
Onebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly skilled Azure Databricks Data Engineer to join our innovative and dynamic team.
Candidates are ideally located in Bangalore or Pune, with flexibility to consider other major metros such as Hyderabad or Chennai. This role requires working onsite two days per week.
Azure Databricks Data Engineer | About You
As an Azure Databricks Data Engineer, you are responsible for designing and building scalable data pipelines and analytics solutions using Azure cloud services and the Databricks platform. You thrive in data-rich environments and enjoy solving complex challenges related to data ingestion, transformation, and performance optimization. You bring a strong understanding of distributed computing and cloud-native data engineering practices. You’re a collaborative problem-solver who works well across teams and is passionate about delivering clean, reliable, and actionable data.
Azure Databricks Data Engineer | Day-to-Day
- Design and develop data pipelines using Azure Databricks, Spark, and other Azure services to support analytics, reporting, and machine learning use cases.
- Build scalable ETL/ELT workflows that ingest, transform, and load data from various sources into cloud-based data lakes and warehouses.
- Optimize performance and reliability of data processing jobs, ensuring efficient resource usage and minimal latency.
- Collaborate with data architects, analysts, and business stakeholders to understand data requirements and deliver high-quality solutions.
- Implement data quality checks, monitoring, and alerting to ensure accuracy and consistency across datasets.
- Support deployment and automation using CI/CD pipelines, version control (Git), and infrastructure-as-code tools.
Azure Databricks Data Engineer | Skills & Experience
- 5+ years of experience in data engineering or related roles, with a strong focus on cloud-based data platforms and large-scale data processing.
- Hands-on experience with Azure Databricks and Apache Spark, including building and optimizing distributed data pipelines.
- Proficiency in Python, SQL, and data transformation techniques.
- Experience with Azure services such as Data Lake Storage, Data Factory, and Synapse Analytics, and how they integrate within modern data architectures.
- Familiarity with CI/CD tools, Git, and DevOps practices in cloud environments.
- Strong understanding of data modeling and performance tuning, with the ability to troubleshoot and optimize complex data workflows.
