About the job
Company Overview
SAPGM Solutions is a growing leader and an expert in RPO, Staffing, Consulting, Trainings & Background Verification services. With 51-200 employees and headquartered in Ameerpet, Telangana, we belong to the IT Services and IT Consulting industry.
Job Overview
We are looking for a Senior Data Engineer to join our dynamic team. This mid-level position offers a range of employment types including remote, contract-to-hire, contract, or freelance, and is available in multiple locations: Hyderabad, Bangalore, Chennai, Pune, Kolkata, Noida, and Gurgaon. The ideal candidate should have a strong background in data engineering, data modeling, and ETL development.
Qualifications And Skills
- Proven experience in data modeling (Mandatory skill) with a solid understanding of database design principles and best practices.
- Expertise in ETL development (Mandatory skill) including experience with extract, transform, and load processes.
- Proficiency in Python (Mandatory skill) for data manipulation, automation, and scripting tasks.
- Experience with big data technologies such as Hadoop, Spark, or Flink for handling large datasets.
- Solid understanding of data warehousing concepts and architecture, including schema design and data integration techniques.
- Strong skills in SQL for querying, creating, and managing databases.
- Experience in managing data pipelines including data ingestion, transformation, and distribution.
- Familiarity with cloud platforms like AWS, Azure, or Google Cloud for deploying and managing data solutions.
- Design, develop, and maintain scalable data models that support reporting and analytics needs.
- Create and manage robust ETL processes to ensure the accurate and efficient movement of data across systems.
- Utilize Python to automate data extraction, transformation, and loading tasks.
- Implement and optimize big data solutions to handle large-scale data processing.
- Develop and maintain data warehouses, ensuring data integrity and consistency.
- Write efficient SQL queries to support data analysis and reporting requirements.
- Oversee the creation, scheduling, and monitoring of data pipelines for continuous data flow.
- Work with cloud platforms to deploy, manage, and monitor data engineering solutions.
- Collaborate with cross-functional teams to understand and fulfill data requirements.