Job VC
Senior Data Engineer (Python / GCP / Data Pipelines)
We are looking for an experienced
Senior Data Engineer
to help build and maintain a modern data processing platform for a global product ecosystem. You will work on automating complex data transformations, improving data quality, and building reliable pipelines that deliver trusted data to downstream systems.
The role focuses on designing scalable
ETL/data pipeline frameworks, migrating existing Talend solutions, and creating a single source of truth for transformed data versions
.
Core Competence:
5+ years of professional experience in Python development
, with a strong focus on data engineering, ETL processes, and automation.
Strong experience designing, building, and maintaining
data pipelines
for large-scale data processing.
Hands-on experience with
GCP data technologies
, including:
BigQuery
— data warehousing, optimization, and analytical workloads.
Dataform
— data transformation workflows and data modeling.
Cloud Composer
— workflow orchestration and pipeline automation.
Experience developing and optimizing
ETL/ELT frameworks
and migrating legacy data processing solutions.
Strong understanding of
data transformation processes
, data modeling, and maintaining reliable data flows between systems.
Experience working with data quality challenges, including:
Data validation and profiling.
Identifying inconsistencies and anomalies.
Building data quality reporting mechanisms for external suppliers.
Experience implementing versioned data storage approaches to maintain a
single source of truth
across business systems.
Knowledge of
Terraform
for infrastructure as code and cloud environment management.
Ability to design scalable, maintainable, and production-ready data architectures.
Preferred Qualifications:
Experience migrating from traditional ETL tools such as
Talend
to modern cloud-based data platforms.
Familiarity with supplier/product data ecosystems and handling multiple data formats from various sources.
Experience working with cloud-native data platforms and distributed processing architectures.
Strong SQL skills and experience optimizing analytical queries.
Understanding of data governance, metadata management, and data lifecycle principles.
Experience working in Agile teams and collaborating with business stakeholders to improve data processes.
What We Offer You:
Modern Data Platform Challenges:
Work on automating complex data workflows and building reliable data infrastructure.
Technical Ownership:
Design core data frameworks and influence architecture decisions.
Cloud-Native Environment:
Work with modern GCP technologies and infrastructure-as-code practices.
Business Impact:
Improve data quality and reliability for systems used across the organization.
Professional Growth:
Expand expertise in data engineering, cloud technologies, and scalable pipeline design.
Flexible Work Environment:
Collaborate with an international team using modern engineering practices.