Data Engineer

Execute request for ingestion, creation and preparation of data sources

Integrate data from multiple internal and external sources to the Analytics environment, to be used for Analytics models and solutions

Deliver data sourcing approach and datasets for analysis, with activities including data staging, ETL, data quality and archiving

Implement data quality standard and metrics

Improve processes and methodologies to ensure all data-driven use cases can be delivered, can create value, and is sustainable according to the highest level of quality

Collaborate with analytics analyst to understand, communicate, and implement Analytics and process best practices
Bachelor Degree in Statistics, Mathematics, Computer Science or equivalent

Having at least 3-5 years experience as Data Engineer

Hands on experience developing and managing cloud data infrastructure (GCP preferred)

Familiarity in Pyspark / Scala data lake & data warehouse development

Experience in Advanced SQL DB design

Good understanding in developing data pipelines & scheduler (Airflow / Beam, etc)

Familiar with Hadoop & Hive Table cluster