Data Engineer - Processing & Analysis

Shopee logo

Shopee

View Salaries, Reviews, and more  

Job Summary


Salary
S$7,833 - S$15,000 / Monthly EST

Job Type
Permanent

Seniority
Mid Junior

Years of Experience
At least 2 years

Tech Stacks
RDS Spark NoSQL Flink Scala Hadoop Python Java

Job Description

  • Design, build and maintain the ingestion system to support various types of data(e.g. User behavior, RDS, NoSQL db and others) to be ingested to the data warehouse more timely and accurately
  • Translate data requirements into scalable technical data service with low latency and high concurrency
  • Design, build and maintain the batch or real time data pipeline in production using Hadoop big data technology
  • Analyse and improve efficiency, scalability, and stability of the system
  • Define and manage service level agreement and data quality for all data sets in allocated areas of ownership

Requirements

  • Bachelor Degree in Computer Science or a related technical field
  • 2+ years of working experience in programming languages,such as Java,Scala,Python
  • Familiar with Hadoop, Spark and Flink data processing, experience of TB data processing experience is a plus
  • Familiar designing and operating of a robust distributed system is a plus
  • Understand data mining or machine learning
  • Excited to work intimately with data
  • Passionate, self-motivated, and takes ownership


banner icon
Interested in common interview questions?
Let's prepare for potential interview questions tailored to your job description and work experience.
Get Started!

Achieve your dream job with our top-notch tools!

Resume Checker Illustration

Resume Checker

Our free resume checker analyzes the job description and identifies important keywords and skills missing from your resume in just a minute!

Check Now
Resume Checker Illustration

Interview Preparation

Utilizing advanced AI, our tool generates tailored interview questions based on your industry, role, and experience. Practice and receive feedback on your answers in real time!

Let's Prepare
Resume Checker Illustration

Resume Builder

Let us show you the differences between a bad, good, and great resume, and guide you in building a resume that helps you stand out to employers, ensuring you land your next position faster!

Build Resume