Senior Data Engineer (Data Unification)
๐ง Tech Level: Senior
๐งพ Employment type: Full time
๐ Candidate Location: EU, Georgia, Uzbekistan
๐ Start: ASAP
โ๏ธ Project Phase: Ongoing
๐ฅ Customer Description:
The client is an experienced marketplace that brings people more ways to get the most out of their city or wherever they may be. By enabling real-time mobile commerce across local businesses, live events, and travel destinations, the platform helps people find and discover experiences that make for a full, fun, and rewarding life. With thousands of employees spread across multiple continents, the company maintains a culture that inspires innovation, rewards risk-taking, and celebrates success.
๐งฉ Project Description:
The Data team is at the heart of all things data, working on defining and building the next-generation cloud-based solutions to ingest and curate petabytes of data into a data lake and data warehouse. The mission is to empower data analysts and data scientists across all business units to make informed business decisions. This role offers a unique combination of skills in distributed systems, big data, and scalable high-performance production systems.
๐ก Hard Skills / Must Have:
BS/MS in Computer Science with 10+ years of experience in distributed systems, data engineering, or software engineering.
Strong coding skills in Python, Java, or Scala.
Experience with SQL and NoSQL databases (BigQuery, Teradata, MySQL, Postgres, Cassandra).
Experience with big data technologies: Hadoop, Hive, Apache Spark.
Experience with Airflow or any other orchestration tool.
In-depth experience with ETL, data lineage, data quality issues, backfills โ ability to drive independent resolution and communication.
Experience with batch and streaming data pipelines.
Experience with GCP or AWS cloud technologies, particularly related to data processing at scale.
Experience designing, implementing, and supporting production services with tight SLAs.
Experience with central logging, metrics, monitoring, and alerting tools (Elasticsearch, Wavefront).
Clear understanding of testing methodologies, CI/CD, and industry best practices.
โจ Hard Skills / Nice to Have:
Strong coding skills in Python.
Experience with Google Data Streams, Google Dataproc.
Experience with Change Data Capture (CDC) technologies.
Experience with modern data warehouse technology such as Delta Lake.
๐ Responsibilities:
Design and develop high-volume batch and streaming data ingestion pipelines spanning AWS and GCP data platforms.
Conceive, code, and launch the next-generation data ingestion and curation platforms.
Participate in defining requirements and system and data architectural discussions.
Technically lead and mentor junior engineers on best practices in software development and data engineering lifecycle.
Collaborate with cross-functional agile teams of software engineers, data engineers, ML experts, and data analysts in building new product features.
๐งช Technology Stack:
Cloud: GCP, AWS.
Big Data: Apache Spark, Hadoop, Hive.
Databases: BigQuery, Teradata, MySQL, Postgres, Cassandra.
Orchestration: Apache Airflow.
Monitoring & Logging: Elasticsearch, Wavefront.
CI/CD: industry-standard tools and practices.
๐ฉ Ready to Join?
We look forward to receiving your application and welcoming you to our team!
- Department
- Data Engineering
- Locations
- Poland, Romania, Spain, Uzbekistan
- Remote status
- Fully Remote
About Bonapolia
For job seekers, BONAPOLIA offers a gateway to exciting career prospects and the chance to thrive in a fulfilling work environment. We believe that the right job can transform lives, and we are committed to making that happen for you.