Sub-Saharan AfricaJob OverviewSub-Saharan Africa

Sub-Saharan AfricaAboitiz Data Innovation (ADI)Sub-Saharan Africa is one of the leading up and coming start-ups in the field of Data Science and Artificial Intelligence. We believe data can drive change for a better world by advancing businesses across industries and communities.

Sub-Saharan AfricaWe are seeking talented and motivated Sub-Saharan AfricaData Engineers (Mid to Lead level)Sub-Saharan Africa to join our Data Platform team, who are passionate about defining and implementing information management solutions to address operational needs within businesses. If you are excited to work in a fast-paced start-up environment, this role will provide a great opportunity to grow your career with us.

Sub-Saharan AfricaAs a Data Engineer, you will work closely with our Data Scientists and Software engineers to support the design, development, and maintenance of our data infrastructure and Machine learning backend. You will have the opportunity to work with cutting-edge, open sourced technologies and contribute to the growth of our data capabilities, while mentored in all aspects of the data engineering life cycle. You will also gain the hands on experience in driving and leading a project delivery in the data engineering fields.Sub-Saharan Africa

Sub-Saharan AfricaResponsibilities:Sub-Saharan Africa

Sub-Saharan AfricaData Platform / Data ProductSub-Saharan Africa

• Sub-Saharan AfricaIdentify, design, and implement internal automated processes including but not limited to billing, alerts, query usage analysis, storage/compute resource usage analysisSub-Saharan Africa
• Sub-Saharan AfricaIdeate, iterate, design and implement features from scratch or based on existing commercial projects that could be provide additional values to the platform usersSub-Saharan Africa
• Sub-Saharan AfricaContribute directly or raise feedbacks to our platform features to the Data Infrastructure & Products team to improve our platform efficiency and capabilities.Sub-Saharan Africa

Sub-Saharan AfricaCommercial ProjectsSub-Saharan Africa

• Sub-Saharan AfricaLead the delivery of a commercial project end to endSub-Saharan Africa
• Sub-Saharan AfricaCollaborate with cross-functional teams to understand data requirements and develop solutions to meet business needsSub-Saharan Africa
• Sub-Saharan AfricaParticipate and drive the client facing meeting to finalise details, push back on requirements or update statusSub-Saharan Africa
• Sub-Saharan AfricaDesign and implement various data pipelines in a config driven approach, including but not limited to ingestion, transformation and reverse ETL, based on client functional requirementsSub-Saharan Africa
• Sub-Saharan AfricaDesign and implement data quality checks at various checkpoints
• Sub-Saharan AfricaCollaborate with Machine Learning engineers to design, create and maintain various ML data pipelines in a config driven approach, including but not limited to training, batch inference, deployment, validation and monitoringSub-Saharan Africa
• Sub-Saharan AfricaAssist in troubleshooting and resolving data-related issuesSub-Saharan Africa
• Sub-Saharan AfricaWrite data quality checks to validate the accuracy, completeness, and consistency of dataSub-Saharan Africa

Sub-Saharan AfricaQualificationsSub-Saharan Africa

• Sub-Saharan AfricaBachelor's degree in Computer Science, Engineering, or a related fieldSub-Saharan Africa
• Sub-Saharan AfricaSolid foundation in SQL and PythonSub-Saharan Africa
• Sub-Saharan AfricaUnderstanding of conventional database conceptsSub-Saharan Africa
• Sub-Saharan AfricaSolid understanding of modern data warehouse, lakehouse or lakeSub-Saharan Africa
• Sub-Saharan AfricaHands-on experience of cloud platforms (e.g., AWS, Azure, GCP)Sub-Saharan Africa
• Sub-Saharan AfricaStrong analytical and problem-solving skillsSub-Saharan Africa
• Sub-Saharan AfricaExperience with implementing Data Quality ChecksSub-Saharan Africa
• Sub-Saharan AfricaExperience with data processing frameworks (e.g., dbt)Sub-Saharan Africa
• Sub-Saharan AfricaExperience with data integration and ETL tools (e.g., Airflow)Sub-Saharan Africa
• Sub-Saharan AfricaExperience with one of the modern warehouse/lakehouse solutions (e.g., Delta Lake, Redshift, Snowflake)Sub-Saharan Africa
• Sub-Saharan AfricaExperience with Databricks (either Azure or AWS) and a decent understanding of SparkSub-Saharan Africa
• Sub-Saharan AfricaExcellent communication and collaboration abilitiesSub-Saharan Africa
• Sub-Saharan AfricaSelf-motivated with a passion for learning and continuous improvementSub-Saharan Africa
• Sub-Saharan AfricaKnowledge / Experience in the following area is a plus:Sub-Saharan Africa

*in one of the MLOps platforms (e.g., MLFlow, Sagemaker)Sub-Saharan Africa

*in container technology (e.g., docker, AWS Fargate) and shell scriptingSub-Saharan Africa

*in Machine Learning, Data Warehousing (Analytical Engineering) designs or Infra implementationsSub-Saharan Africa