Job VC

Senior Data Engineer

Launch & Scale · djinni · Senior · $$$$ · Тільки віддалено Країни Європи та Україна
Open original ↗
On behalf of our client, we are looking for a
Senior Data Engineer.

About the Project
A global platform managing over 700,000 hotel rooms across 124 countries, helping clients generate billions in revenue.

Responsibilities:

- Implement scaling of the case detection process (scanner)
- Split API into multiple API services
- Emulate pubsub/cloud run locally
- Extract and process data using PySpark + S3
- Work with Kafka/Kinesis data streams
- Write and optimize SQL queries on PostgreSQL/Redshift
- Use DynamoDB as a data source/sink
- Run and debug ETL jobs on Glue or EMR
- Monitor jobs via AWS console and Spark UI

Requirements:

- 5+ years of experience in Data Engineering
- 3+ years of experience with AWS (1+ year in the latest project)
- 2+ years of experience with Spark / PySpark (1+ year in the latest project)
- Strong experience with AWS S3
- Experience with Kafka or Kinesis
- Experience with DynamoDB
- Experience with PostgreSQL or MySQL
- Experience with AWS ECS Fargate

Nice to Have:

- AWS Glue
- EMR
- AWS Batch
- Flink
- Beam
- Cassandra / ScyllaDB
- AWS Step Functions

Company offers:

- Long-term employment with possibilities for professional growth
- Fully remote work
- Reasonably flexible schedule
- 15 days of paid vacation
- Regular performance reviews