Hybrid Senior Data Engineer (Onsite, South San Francisco) at Quantori
Quantori · South San Francisco, United States Of America · Hybrid
- Professional
- Office in South San Francisco
Quantori is seeking a Data Engineer to support the Small Molecule Lab-in-the-Loop initiative within the client’s Data Ecosystem program. This role involves data migration, system integration, and enhancing visualization capabilities. You’ll collaborate closely with cross-functional teams, including colleagues in Europe. It's an onsite role, requiring 2–3 days' visits per week to the client's office in South San Francisco.
Responsibilities:
- Build data systems and pipelines
- Migrate assay and compound data from legacy systems; develop robust ETL pipelines to ensure efficient and secure integration from multiple sources.
- Design end-to-end data pipelines within a hybrid big data architecture, using Cloud Native AWS, Python, SQL, etc.
- Design, develop, and optimize scalable relational databases (Oracle, PostgreSQL) to support experimental and predictive data.
- Collaborate on integrating data into visualization tools and develop or enhance plugins to support interactive scientific insights.
- Work with scientists, developers, and global teams to align goals, define requirements, and deliver user-centric solutions.
- Organize and analyze data, handling structured, semi-structured, unstructured, and image-based data.
What we expect:
- Proven experience with relational databases (Oracle, PostgreSQL) in terms of design, optimization, and migration.
- Strong Python skills for backend and data engineering; Java is a plus.
- Solid ETL development experience, particularly with assay and compound data .
- Familiarity with integrating data into visualization tools or building modular plugins.
- Effective communication and collaboration skills across globally distributed teams.
- Strong analytical and problem-solving mindset.
- Ability to work independently and manage multiple priorities in a dynamic environment.
- Experience with data pipelines, modeling, and cloud platforms (AWS/GCP).
Nice to have:
- Familiarity with tools like Vortex or D360.
- Domain knowledge in lab workflows, assay, or compound data.
- Experience in plugin/API/SDK development for visualization tools.
- Familiarity with Docker, Kubernetes, or CI/CD pipelines to streamline development and deployment.
We offer:
- Highly competitive compensation
- Office work
- Flexible working hours
- Strong management and technical expertise
- Contract until the end of the year, with possible extension based on project needs and performance