
Designlab – Torne-se um designer com cursos práticos e orientação.
Patrocinado por DesignlabETL Tester
Key Responsibilities:
- Extensive experience in validating ETL processes, ensuring accurate data extraction, transformation, and loading across multiple environments.
- Proficient in Java programming, with the ability to understand and write Java code when required.
- Advanced skills in SQL for data validation, querying databases, and ensuring data consistency and integrity throughout the ETL process.
- Expertise in utilizing Unix commands to manage test environments, handle file systems, and execute system-level tasks.
- Proficient in creating shell scripts to automate testing processes, enhancing productivity and reducing manual intervention.
- Ensuring that data transformations and loads are accurate, with strong attention to identifying and resolving discrepancies in the ETL process.
- Focused on automating repetitive tasks and optimizing testing workflows to increase overall testing efficiency.
- Write and execute automated test scripts using Java to ensure the quality and functionality of ETL solutions.
- Utilize Unix commands and shell scripting to automate repetitive tasks and manage system processes.
- Collaborate with cross-functional teams, including data engineers, developers, and business analysts, to ensure the ETL processes meet business requirements.
- Ensure that data transformations, integrations, and pipelines are robust, secure, and efficient.
- Troubleshoot data discrepancies and perform root cause analysis for failed data loads.
- Create comprehensive test cases, execute them, and document test results for all data flows.
- Actively participate in the continuous improvement of ETL testing processes and methodologies.
- Experience with version control systems (e.g., Git) and integrating testing into CI/CD pipelines.
Tools & Technologies (Good to Have): - Experience with Hadoop ecosystem tools such as HDFS, MapReduce, Hive, and Spark for handling large-scale data processing and storage.
- Knowledge of NiFi for automating data flows, transforming data, and integrating different systems seamlessly.
- Experience with tools like Postman, SoapUI, or RestAssured to validate REST and SOAP APIs, ensuring correct data exchange and handling of errors.
Candidatar-se agora