Cari Kerja? Senior Data Engineer - PT. Dealls (YC W22) – Online Shop Populer

Dealls is Indonesia's largest job portal & mentoring platform. We help people easily find jobs to top Indonesian companies for internship and full-time roles.

As you might have already heard about us, we are revolutionizing how Indonesian engage with employers. Many Indonesian students are talented, ambitious, but never found a better opportunity for themselves. Our team is driven by the vision to democratize information and knowledge, thus opportunities. We think what we build will allow Indonesian students to have a chance to self develop and have a better future.

Our founder is a Harvard graduate, and has gathered a strong team with burning passion to help Indonesian discover opportunities they deserve! 🚀 In 1 year, we amassed 2mio+ users, got funded by YCombinator, and awarded the Best App of 2021 by GooglePlay, beating 3 unicorns and tens of others.

We are looking for passionate and committed individuals who look forward to working in a fast-paced entrepreneurial environment. Join us to have the opportunity to make decisions to drive a huge difference and impact for Indonesia youths! Here in Dealls, you’ll work closely with our board members. We are preferably looking for applicants who are proficient in both Bahasa and English.

Dealls is seeking a passionate and experienced Data Engineer to join our fast-growing team. In this role, you will play a pivotal role in building and maintaining our data infrastructure, ensuring the efficient and scalable collection, transformation, and analysis of data that drives our business decisions.

You will be the first Data Engineer in our team – so if you're someone who enjoys challenges & wants to be the pioneer of our data infrastructure, we will be eagerly waiting for your application!

Responsibilities:

• Design, develop, and implement scalable data pipelines using technologies like Python, SQL, Spark, and cloud platforms (e.g., AWS, GCP).
• Extract, transform, and load (ETL) data from various sources including databases, APIs, and log files.
• Implement data quality checks and monitoring systems to ensure data accuracy and consistency.
• Optimize data pipelines for performance and efficiency.
• Develop and maintain data models and data warehouses.
• Collaborate with data analysts and scientists to understand their data needs and translate them into technical requirements.
• Document data pipelines and processes for clarity and maintainability.
• Stay up-to-date with the latest trends and technologies in data engineering.

• Bachelor’s Degree (S1) in Computer Science or related field.
• Min. of 2+ yrs of experience in a data engineering / data architect / software engineering role. 
• Strong hands-on experience in java, python is required. Must have shipped multiple projects with a major hands-on contribution to each project.
• Experience in Big data technologies: Hadoop ecosystem (map-reduce, spark, Kafka)
• Experience in different storage technologies: OLTP like Postgres, OLAP like Redshift, Google BigQuery, NoSQL like Redis, HBase, Kafka
• Familiarity with machine learning algorithms and concepts (gradient descent, logistic regression) and software libraries like pandas, TensorFlow, etc.