Lead Data Engineer(8+ Years of Exp) bei 3Pillar Global
3Pillar Global · India · Remote
Skills Set
- 7+ years of experience in Data Engineering or related field, including 2+ years in a lead role.
- Expert-level proficiency with AWS data services (e.g., Glue, EMR, Lambda, Redshift, S3, Kinesis, Step Functions).
- Strong Python skills for data processing, automation, and pipeline development.
- Experience building batch and streaming pipelines (Spark, PySpark, Kafka, Kinesis, etc.).
- Strong SQL expertise and experience with relational and NoSQL databases.
- Hands-on experience with IaC (Terraform, CloudFormation, CDK).
- Familiarity with DevOps tools for CI/CD (e.g., GitHub Actions, GitLab CI, Jenkins).
- Understanding of data modeling, data warehousing concepts, and distributed systems.