Design, develop and maintain an infrastructure for streaming, processing and storage of data. Build tools for effective maintenance and monitoring of the data infrastructure.
- Contribute to key data pipeline architecture decisions and lead the implementation of major initiatives.
- Building Collaborate with cross-functional teams to understand data requirements and design data architectures that meet business needs.
- Develop, construct, test, and maintain data architectures, databases, and large-scale processing systems.
- Design and implement ETL (Extract, Transform, Load) processes to ingest data from various sources and transform it into usable formats.
- Optimize and enhance existing data pipelines for improved performance and reliability.
- Ensure data quality, integrity, and security throughout the data lifecycle.
- Collaborate with Data Scientists and Analysts to provide them with the necessary data resources for analysis and reporting.
- Implement and manage data warehousing solutions for efficient storage and retrieval of data.
- Stay up-to-date with emerging technologies and industry trends in data engineering.
JOB REQUIREMENTS
- 3-5 years of experience working as a data engineer
- Experience in Banking Industry is preferred.
- Strong programming skills in languages such as Python, Java, Scala, or similar.
- Experience with distributed computing frameworks like Hadoop, Spark, or Flink.
- Proficiency in designing and maintaining databases (SQL and NoSQL).
- Familiarity with data warehousing solutions and concepts.
- Working knowledge of cloud platforms such as AWS, Azure, or Google Cloud.
- Experience with data modeling, schema design, and optimization techniques.
- Solid understanding of data management best practices and data governance.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration abilities.
Pay: Rp1,500,000,000 - Rp1,600,000,000 per month
**Experience**:
- Banking: 3 years (preferred)