- Office in Wiesbaden
Description
At Uni Systems, we are working towards turning digital visions into reality. We are continuously growing and we are looking for a Data Engineer to join our UniQue team.
What will you be doing in this role?
- Designs and implements data pipelines and data stores to acquire and prepare data.
- Applies data engineering standards and tools to create and maintain data pipelines and extract, transform and load data.
- Carries out routine data quality checks and remediation Programming/software development.
- Designs, codes, verifies, tests, documents, amends and refactors moderately complex programs/scripts.
- Applies agreed standards and tools to achieve a well-engineered result.
- Proposes practical solutions to resolve issues.
- Collaborates in reviews of work with others as appropriate.
- Defines the software modules needed for an integration build and produces a build definition for each generation of the software.
- Assesses the integrity of data from multiple sources.
- Provides advice on the transformation of data from one format/medium to another.
- Enables the availability, integrity and search ability of information through the application of formal data and metadata structures and protection measures.
- Applies standard data modelling and design techniques based upon a detailed understanding of requirements.
- Establishes, modifies and maintains data structures and associated components.
- Communicates the details of data structures and associated components to others using the data structures and associated components
Requirements
What will you be bringing to the team?
- Have at least a high school certificate.
- Ability to design, build and manage data pipelines for data structures encompassing data transformation, data models, schemas, metadata and workload management in an on premise environment.
- At least 4 years' experience planning and maintaining data lakes, databases and pipeline processes, both batch-wise and (near) real-time.
- Experience in working with large, heterogeneous datasets in building and optimizing data pipelines, pipeline architectures and integrated datasets using data integration technologies on premise.
- Experience in using of data engineering tools to support data science, data analytics and data visualization (KNIME, SQL Server, Power BI is the preferred toolset).
- Familiarity with KNIME Analytics Platform and Server is preferred
- Experience with state-of-the-art data engineering, analytics, data integration and pipeline tools/programming language (Python).
- Solid understanding of data security best practices, including data encryption, access controls, authentication/authorization mechanisms, and compliance requirements.
- Experience with monitoring and logging tools to ensure the reliability and performance of data pipelines.
- Familiarity with containerization and orchestration tools such as Docker and Kubernetes is a plus.
- Knowledge of best practice of software development. E.g. CI/CD pipelines, unit/functional testing, following styling guides is a plus.
- Experience working within NCIA or similar defence-related environments is considered an advantage.
- Knowledge of NATO Communication and Information Systems Infrastructure is considered an advantage.
- Prior experience working in an international environment comprising both military and civilian elements is considered an advantage.
- Proficiency in English language a a C1 level.