Design and maintain enterprise-scale data pipelines using AWS cloud services, handling schema evolution in data feeds and delivering analytics-ready datasets to BI platforms. This role requires hands-on expertise with the full AWS data stack and proven ability to build enterprise-grade data solutions that scale.
Requirements
Essential Functions
Build and orchestrate ETL/ELT workflows using Apache Airflow for complex data pipeline management
Develop serverless data processing with AWS Lambda and EventBridge for real-time transformations
Create scalable ETL jobs using AWS Glue with automated schema discovery and catalog management
Execute database migrations and continuous replication using AWS DMS
Design and optimize Amazon Redshift data warehouses and Amazon Athena federated queries
Implement streaming data pipelines with Apache Kafka for real-time ingestion
Manage schema changes in data feeds with automated detection and pipeline adaptation
Create data feeds for Tableau and BusinessObjects reporting platforms
Supervisory Responsibilities
No supervisory responsibilities
Required Skills/Abilities
Airflow: DAG development, custom operators, workflow orchestration, production deployment
Tableau: Data source optimization, extract management, connection configuration
BusinessObjects: Universe design, report development, data feed creation
Tableau: Design and Code rewrite
Education and Experience
5+ years AWS data platform development
3+ years production Airflow experience with complex workflow orchestration
Proven experience managing high-volume data feeds (TB+ daily) with schema evolution
Database migration expertise using DMS for enterprise-scale projects
BI integration experience with Tableau and BusinessObjects platforms
Tableau: 2 plus year
Key Competencies
Design fault-tolerant data pipelines with automated error handling and recovery
Handle schema changes in real-time and batch data feeds without pipeline disruption
Optimize performance across streaming and batch processing architectures
Implement data quality validation and monitoring frameworks
Coordinate cross-platform data synchronization and lineage tracking
Preferred Qualifications
AWS Data Analytics Specialty or Solutions Architect Professional certification
Experience with Infrastructure as Code (Terraform, CloudFormation)
Knowledge of DataOps practices and CI/CD for data pipelines
Containerization experience (Docker, ECS, EKS) for data workloads
Working Conditions
Work is generally performed within an indoor office environment utilizing standard office equipment.
General office environment requires frequent sitting; dexterity of hands and fingers to operate a computer keyboard and mouse; walking and standing for long periods of time; and lifting of less than 20 pounds.
Ces cookies sont nécessaires au fonctionnement du site web et ne peuvent pas être désactivés dans nos systèmes. Vous pouvez configurer votre navigateur pour qu'il bloque ces cookies, mais certaines parties du site risquent alors de ne pas fonctionner.
Sécurité
Expérience utilisateur
Cookies ciblés
Ces cookies sont placés par nos partenaires publicitaires via notre site web. Ils peuvent être utilisés par ces entreprises pour créer un profil de vos intérêts et vous montrer des publicités pertinentes ailleurs.
Google Analytics
Google Ads
Nous utilisons des cookies
🍪
Notre site web utilise des cookies et des technologies similaires pour personnaliser le contenu, optimiser l'expérience de l'utilisateur, individualiser et évaluer la publicité. En cliquant sur OK ou en activant une option dans les paramètres des cookies, vous acceptez cela.
Les meilleurs emplois à distance par courriel
Rejoins 5'000+ personnes qui reçoivent des alertes hebdomadaires avec des emplois à distance!