Lead Data Engineer

About RENEWCAST

Founded in 2020, RENEWCAST builds precision wind & solar forecasting software using cutting-edge ML to deliver accurate, scalable, and cost-efficient predictions. After recent investments rounds, we’re expanding our senior technical team to establish the discipline heads who will anchor our growth.

At Renewcast, we value clarity, alignment, and smooth collaboration across technical and business teams— everyone understands not just what we build, but why. We work in a single shared planning cycle and priorities, trade-offs, and progress are transparent. Seniors are hands-on contributors today while setting the standards juniors grow into tomorrow.

Your Role

Own the data foundation that powers our forecasts. Design, orchestrate, and optimize reliable pipelines with a strong focus on performance, cost efficiency, observability, and reproducibility. You'll Mentor/manage a small team and collaborate closely with Data Science, Meteorology, MLOps, Client Data Ingestion, and DevOps.

What You Will Do

  • Own the data foundation: from client weather/production data to  curated, production-ready features.

  • Orchestrate workflows: Airflow (v3 preferred), Dagster, Prefect.

  • Batch ELT across multiple data sources and schedules, real-time ingestion when needed.

  • Alongside classic pipelines you will set up and maintain tensor-first pipelines: xarray, Zarr, Dask

  • Observability & performance: metrics, logs, p50/p95 latency; cost/latency trade-offs.

  • Resilience: restartable and idempotent workflows, safe reruns/ backfills, schema evolution tracking, lineage.

  • Mentor & manage: delegate well, coach where needed, stay hands-on when it matters.

  • Collaborate across functions to align features, architecture, SLAs.

What we are looking for — Must-Have

  • 7–10+ yrs in  Data Engineering with leadership/mentorship experience.

  • Strong orchestration experience with a preference for asset-first, event-driven workflows as supported in modern orchestrators.

  • Cloud Data Engineering (Azure/AWS/GCP), CI/CD, containerisation, version/config control.

  • Strong track record in building and optimising scalable batch ELT/ETL workflows with state-of-the-art frameworks and distributed processing engines

  • Experience with observability & performance optimisation (metrics, alerts, cost awareness).

  • Building resilient pipelines (failures, reruns, safe and tracked schema evolution, lineage tools).

Bonus Points

  • Tensorial stack (xarray, Zarr, Dask) or scientific formats (NetCDF, GRIB).

  • Kubernetes/Terraform familiarity.

  • Data governance, lineage, metadata tools.

  • Streaming systems (Kafka, Pulsar).

  • Familiarity with modern product oriented delivery methods (e.g., Shape Up).

How We work

We prize autonomy, ownership, and crisp communication. Priorities and decisions are transparent across DS, Engineering, and Commercial so teams move together, not in silos.

What Success Looks like
  • Clear, reliable data flows that are easier to reason about and improve. 
  • Faster, more cost-efficient pipelines with robust monitoring/ alerting.
  • A resilient orchestration layer and  reproducible environments.
  • Juniors growing under your mentorship and delivering confidently. 
What We Offer
  • Strategic ownership with direct leadership visibility to leadership.
  • Competitive compensation + ESOP.
  • Flexible hybrid work; offices in Tallinn  and Rome. 
  • Growth into discipline lead for Data Engineering. 

How to Apply
Send your resume to recruiting@renewcast.com
or Click below to apply.

 
Apply Now!