Senior Data Engineer

**Description**:- 1. Gather business requirement to support Data Office Project- 2. Explore existing and new data sources and facilitate the integration to the Data Warehouse- 3. Design and develop Data Quality Framework across Data Platform- 4. Design, implement Data Model for enterprise data warehouse- 5. Classifying data based Data Governance policy and Data Access Framework- 6. Develop data definition and metrics and maintain the consistency across Data team**Job Requirements**- Proficiency in traditional RDBMS with an emphasis on Postgres, and MySQL.- General understanding of ETL/ELT frameworks, error handling techniques, data quality techniques and their overall operation- Generally proficient in performing data transformations via scripting, stored procedures, or an ETL framework.- Proficient in developing and supporting all aspects of a big data cluster: Ingestion, Processing, integration (Python, Spark, Scala), data cleansing, workflow management (OOZIE and ActiveBatch, Airflow), and querying (SQL).- Proficiency in at least one of the following programming languages: Java, Python, Go and Scala.- Experience in writing Apache Spark or Apache Beam including an understanding of optimization techniques.- Proficient in Unix and Linux operating systems- Capable of navigating and working effectively in a DevOps model including leveraging related technologies: Jenkins, GitLab, Git etc...**IMPORTANT**: