Tech Lead AWS na Timestamp Group

Timestamp Group aggregates several leading Portuguese IT solutions and services companies around the concepts of excellence and knowledge sharing. We are committed to technological leadership, based on the quality of our service and technological solutions, supported by continuous training and certification. 

Role: Tech Lead AWS

Main Tasks:

·      Utilise expert knowledge of AWS services like Lambda, Glue, and Step Functions to design, implement, and maintain scalable data solutions.

·      Develop robust solution architectures considering scalability, performance, security, and cost optimisation.

·      Demonstrate proficiency in cloud networking, including VPCs, subnets, security groups, and routing tables.

·      Design efficient data models for optimal query performance.

·      Write and optimise SQL queries and identify performance bottlenecks.

·      Knowledge to manage ETL processes and data integration into Redshift, MySQL, and PostgreSQL

·      Create documentation and provide training to team members.

·      Set up and manage logging and tracing mechanisms in AWS using services like AWS CloudTrail and AWS X-Ray.

·      Implement orchestration solutions using Apache Airflow and AWS Step Functions.

·      Utilise Athena for interactive query analysis of large datasets in Amazon S3.

·      Provide technical leadership and guidance, acting as a subject matter expert in AWS and data engineering technologies.

·      Write comprehensive solution documents and technical documentation.

·      Stay updated on emerging technologies and industry trends.

·      Challenge business requirements and propose innovative solutions for efficiency and performance improvement.

Technical Skills:

·      BS/MS degree in Computer Science, Engineering or equivalent working experience

·      Expertise in AWS: Extensive experience with AWS services, including Lambda, Glue, Step Functions, CloudFormation, and CloudWatch.

·      Strong Solution Architecture Knowledge: Ability to design scalable and efficient data solutions on AWS, adhering to best practices for cloud architecture and infrastructure.

·      Proficiency in Python and Databases: Strong programming skills in Python and experience with relational databases (MySQL, PostgreSQL, Redshift) and NoSQL databases.

·      Orchestration and Workflow Management: Experience with orchestration tools such as Apache Airflow and AWS Step Functions for automating and managing data workflows.

·      ETL Tools and Big Data Experience: Knowledge of ETL tools and experience working with large volumes of data, with a preference for experience with Kafka.

·      Experience with Iceberg Tables: Familiarity with Iceberg tables for managing large datasets efficiently, ensuring data consistency, and supporting ACID transactions.

·      Production Awareness and Troubleshooting: Proactive approach to production monitoring and troubleshooting, with the ability to anticipate and mitigate potential issues.

·      Technical Leadership and Communication: Capability to evolve into a technical lead role, with excellent communication and teamwork skills for effective collaboration with cross-functional teams.

·      Strong Analytical and Problem-Solving Skills: Ability to analyse requirements, define technical approaches, and propose innovative solutions to complex problems.

·      Documentation and Requirements Analysis: Experience in writing solution documents and technical documentation, with the ability to challenge and refine business requirements.

·      Exposure to Azure Databricks: Familiarity with Databricks for data engineering and analytics tasks.

Nice to have:

·      Knowledge in Apache Flink, Kafka, and other streaming data technologies.

·      Experience with cloud-native architectures and serverless computing.

·      Certification in AWS, Azure or relevant technologies.

Language Skills:

·      English (B2 or higher level)

Place:  Porto (hybrid)

Start date:  Immediate