Job Summary:
We are seeking a skilled Data Engineer to join our team. The ideal candidate will have a strong technical background in designing and developing data pipelines, integrating and managing data systems, and collaborating with various stakeholders to deliver high-quality data solutions. This role is vital to ensuring our data infrastructure is robust, scalable, and optimized to meet the business’s evolving needs.
Location: Bali, Indonesia (in office)
Key Responsibilities:
Design and Develop Data Pipelines:
- Create and maintain optimal data pipeline architecture.
- Assemble large, complex data sets that meet functional and non-functional business requirements.
Data Integration and ETL:
- Build the infrastructure required for the optimal extraction, transformation, and loading (ETL) of data from various data sources.
- Develop processes and tools to monitor and analyze data pipeline performance.
Database Management:
- Work with data and analytics experts to strive for greater functionality in our data systems.
- Implement, maintain, and optimize database solutions, including both SQL and NoSQL databases.
Collaboration and Communication:
- Collaborate with data scientists, business analysts, and other stakeholders to understand data needs and provide technical solutions.
- Communicate project progress, issues, and solutions effectively to the team and management.
Data Quality and Governance:
- Ensure data quality and data governance standards are maintained.
- Implement data security measures and compliance policies.
Qualifications:
Education and Experience:
- Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field.
- Proven experience as a Data Engineer or in a similar role.
Technical Skills:
- Proficient in SQL and experienced with relational databases.
- Experience with big data tools such as Hadoop, Spark, or Kafka.
- Knowledge of data pipeline and workflow management tools like Airflow or Luigi.
- Experience with cloud services (AWS, Azure, GCP) and containerization technologies (Docker, Kubernetes).
Programming Skills:
- Strong programming skills in Python, Java, Scala, or similar languages.
Soft Skills:
- Strong problem-solving skills and attention to detail.
- Excellent communication and teamwork abilities.
- Ability to work in a fast-paced, dynamic environment.
Preferred Qualifications:
- Experience with machine learning and data mining techniques.
- Familiarity with data visualization tools such as Tableau or Power BI.
- Knowledge of data privacy regulations and best practices.
Why Join Us?
This is an exciting opportunity to contribute to the development and optimization of our data infrastructure, working with a team of talented professionals in a fast-paced and innovative environment. If you are passionate about data and have the technical skills to match, we encourage you to apply.