- Professional
- Office in Tamil Nadu
Job Title: Python Developer
Job Summary:
We are seeking a skilled Python Developer with expertise in data technologies to join our team. The ideal candidate will have a proven ability to design and implement processes for moving and transforming data across systems in both batch and real-time environments. This role requires advanced proficiency in Python, SQL, and JSON, along with hands-on experience in PySpark technologies and Azure cloud services.
Responsibilities:
- Design, develop, and implement scalable data pipelines for batch and real-time processing.
- Collaborate with data engineering and analytics teams to understand data requirements and deliver effective solutions.
- Optimize ETL/ELT workflows using Python and PySpark to handle large-scale datasets.
- Write advanced SQL queries to process, transform, and analyze data efficiently.
- Handle JSON data for integration, serialization, and deserialization in distributed systems.
- Utilize Azure cloud services to deploy, manage, and maintain data solutions.
- Troubleshoot and resolve issues in data pipelines and workflows.
Requirements:
- Proven experience in designing and implementing data integration processes.
- Advanced proficiency in Python, SQL, and JSON.
- Hands-on experience with PySpark technologies and distributed computing frameworks.
- Practical expertise in Azure cloud services (e.g., Azure Data Lake, Azure Synapse etc.).
- Strong problem-solving and analytical skills.
- Ability to work independently and collaboratively in a fast-paced environment.
Preferred Qualifications:
- Familiarity with additional cloud platforms (GCP or AWS) is a plus.
- Experience with CI/CD tools and data versioning.
- Knowledge of data modeling and big data technologies
