Senior Data Engineer chez Rising Tides Solutions, LLC

About Us: 

Welcome to RTS, the innovation lab where data meets discovery! As a premier AI, Data, and Software consulting firm, we specialize in harnessing the power of data to brew up groundbreaking solutions that drive businesses forward. If you’re a data wizard with a passion for experimentation and innovation, we want you in our lab! Join us as our new Sr Data Engineer and help us turn raw data into powerful insights.

Job Summary: 

As a Senior Data Engineer in the Lab, you will perform cutting-edge data "experiments," synthesizing raw data into valuable insights for our clients. With your toolbox of advanced technologies, you’ll design robust data workflows and pipelines, ensuring smooth and scalable data operations in the cloud.

Key Responsibilities:

Data Extraction and Transformation:

• Design and implement efficient data extraction, transformation, and loading (ETL) processes to collect data from various sources and transform it into a usable format.
• Work with large datasets to ensure data quality and integrity.

Data Pipeline Construction:

• Develop and maintain scalable and reliable data pipelines that process and analyze data in real-time or batch modes.
• Optimize and troubleshoot existing data pipelines to enhance performance and efficiency.

Database Management:

• Design and manage data warehouses and databases, ensuring they are optimized for performance and scalability.
• Implement data storage solutions that meet the needs of our clients.

Collaboration and Integration:

• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet their needs.
• Integrate data from various sources, including APIs, databases, and external systems.

Data Security and Compliance:

• Implement data security best practices to protect sensitive information.
• Ensure compliance with data governance and regulatory requirements.

Innovation and Experimentation:

• Continuously explore new data engineering tools, technologies, and best practices to improve our data infrastructure.
• Experiment with cutting-edge data technologies to find the best solutions for our clients.
• End-to-end responsibility on projects of increasing complexity

Documentation and Reporting:

• Maintain comprehensive documentation of data pipelines, processes, and systems.
• Provide regular reports on data pipeline performance and project status to stakeholders.

Qualifications:

• Bachelor’s degree in Computer Science, Information Technology, or a related field. A background in data science or a love for lab work is a bonus!
• 5+ years of experience in data engineering or a related role.
• Experience in programming languages such as Python, Java, or Scala.
• Exposure to working with ETL tools and frameworks (e.g., Apache Airflow, ADF, AWS Glue, Informatica).
• 4-5 years of strong SQL experience, with a proven ability to write complex queries and optimize performance across large datasets.
• Hands-on experience with Snowflake for data warehousing and analytics.
• Proficiency with dbt (data build tool) for managing data transformation workflows and analytics engineering
• Familiarity with big data technologies (e.g., Hadoop, Spark) and cloud platforms (e.g., AWS, Azure, Google Cloud).
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration abilities.

What We Offer:

• Do you prefer Mac or PC? Either way, you get to choose with us 
• 40 hours a year for professional development to use how you choose 
• Flexible PTO 
• Company values that we actually implement (https://rtslabs.com/culture/) 
• Family first approach, no micro-management 

RTS Labs is committed to providing a safe and inclusive environment for all employees, contractors, vendors, and clients; where all people are honored and respected, and differences are celebrated. Proud to be an Equal Opportunity Employer, RTS Labs does not discriminate based upon race, religion, color, national origin, gender, gender identity, gender expression, sexual orientation, age, status as a protected veteran, or status as an individual with a disability.