- Ufficio in Atlanta
Description
Responsibilities
- Work directly with clients to understand business goals, data challenges, and technical requirements.
- Lead or support discovery sessions, requirements workshops, architecture discussions, and solution reviews.
- Develop and optimize batch and streaming data ingestion pipelines from enterprise applications, databases, APIs, and file-based sources.
- Implement medallion/lakehouse architectures, dimensional models, and data transformation workflows to support analytics and reporting use cases.
- Engineer solutions using technologies such as PySpark, Spark SQL, SQL, Python, Delta Lake, and orchestration tools within Azure and Databricks.
- Recommend best practices for data modeling, governance, lineage, monitoring, DevOps, and security.
Minimum Requirements
- Bachelor’s degree in computer science or related field
- 6+ years of experience in data engineering, data platform development, or cloud data solutions
- 3+ years of hands-on experience with Azure Databricks, Apache Spark, or similar distributed data processing technologies
- Expertise with Microsoft Azure infrastructure and data resources, including Fabric, Azure Data Factory, Synapse Data Analytics, Power BI, Azure SQL, Azure Cosmos DB, and Azure Database for PostgreSQL
- Expertise with Databricks, specifically the ability to design enterprise-level strategy and architecture including Unity Catalog, data warehousing, data sharing, and Mosaic AI .
- DevOps for data, GitHub, automated testing, and working with containers (AKS, Docker, registries, etc.)
- Excellent communication skills, ability to clearly explain concepts to teammates and customers, and quickly learn new concepts and technologies
Preferred Qualifications
- Experience working directly with clients, business stakeholders, or cross-functional teams in a consulting or professional services environment.
- Experience building data agents, including NLQ, Databricks Genie, and Fabric Data Agents
- Experience with data management, including data governance, data security, master data management, and familiarity with different industry security requirements
- Broad experience with data/reporting tools, architectures, cloud vendors, and data/AI concepts other than Microsoft