Senior Software Engineer II (Data Pipelines)
Wpromote · Remote, Vereinigte Staaten Von Amerika · Remote
10000 Remote- und Homeoffice-Jobs online
Wpromote · Remote, Vereinigte Staaten Von Amerika · Remote
Rover · Seattle, Vereinigte Staaten Von Amerika · Hybrid
PlayStation Global · United States, Kanada · Remote
CHAOS Industries · El Segundo, Vereinigte Staaten Von Amerika · Remote
Scout Motors · Fremont, Vereinigte Staaten Von Amerika · Remote
Scout Motors · Fremont, Vereinigte Staaten Von Amerika · Remote
RF-SMART · Jacksonville, Vereinigte Staaten Von Amerika · Remote
Roblox · San Mateo, Vereinigte Staaten Von Amerika · Remote
Anduril Industries · Seattle, Vereinigte Staaten Von Amerika · Remote
Anduril Industries · Washington, Vereinigte Staaten Von Amerika · Remote
Anduril Industries · Costa Mesa, Vereinigte Staaten Von Amerika · Remote
Wpromote · Remote, Vereinigte Staaten Von Amerika · Remote
As a Senior Engineer, you will play a crucial role in the development, optimization, and automation of our data pipelines. You will lead complex data projects, architect technical initiatives, and ensure the scalability and performance of our data solutions. Your role will involve strategic planning, collaboration with senior management, and mentoring other engineers. You will be responsible for pushing the delivery speed and quality of our data ELT, leading the implementation of innovative tooling and architecture patterns, and fostering a culture of data engineering excellence.
At Wpromote, we're developing something special called Polaris, a modern data and marketing intelligence platform that gives our clients a serious edge over their competition. Polaris enables and empowers our marketing teams to work together seamlessly, using a comprehensive marketing data foundation with apps that deliver new insights and performance gains for our clients. Polaris also gives Wpromote an operational edge, doubling as our company CRM and integrated source of truth for operations data, making our lives easier and our decisions smarter.
Minimum 7+ years of experience in software development, with extensive experience in Python, SQL, and data pipelines.
Expertise in building and automating ETL/ELT pipelines using Airflow and DAG-based workflow management software. Airbyte for data ingestion is a plus, but not required.
Deep experience managing dbt models using macros and dbt tests.
Mastery of Python or comparable scripting language, API integrations, and software architecture.
Deep experience with databases like PostgreSQL and BigQuery, including query optimization for performance and cost.
Good understanding of business intelligence tools like Looker or comparable alternatives.
Experience with Google Cloud Platform, Kubernetes, and managing infrastructure as code using Terraform.
Proficiency with advanced data formats (Parquet, Avro, Hive, JSONL) and data integration techniques.
Experience with monitoring and logging tools (e.g., Prometheus, Grafana) is a plus.
Familiarity with version control systems and CI/CD tools like GitHub Actions.
Strong command of agile methodologies, continuous integration, and test-driven development.
Exceptional problem-solving skills and technical leadership.
Ability to influence and guide cross-functional teams and projects.