>

Job Summary


Job Type
Permanent

Seniority
Mid
Junior

Years of Experience
At least 2 years

Tech Stacks
RDS
Spark
NoSQL
Flink
Scala
Hadoop
Python
Java

Job Description


Apply
  • Design, build and maintain the ingestion system to support various types of data(e.g. User behavior, RDS, NoSQL db and others) to be ingested to the data warehouse more timely and accurately
  • Translate data requirements into scalable technical data service with low latency and high concurrency
  • Design, build and maintain the batch or real time data pipeline in production using Hadoop big data technology
  • Analyse and improve efficiency, scalability, and stability of the system
  • Define and manage service level agreement and data quality for all data sets in allocated areas of ownership

Requirements

  • Bachelor Degree in Computer Science or a related technical field
  • 2+ years of working experience in programming languages,such as Java,Scala,Python
  • Familiar with Hadoop, Spark and Flink data processing, experience of TB data processing experience is a plus
  • Familiar designing and operating of a robust distributed system is a plus
  • Understand data mining or machine learning
  • Excited to work intimately with data
  • Passionate, self-motivated, and takes ownership

Salaries of Data Engineer at Shopee

Salaries from Shopee that are similar to Data Engineer - Processing & Analysis

6500 SGD

Estimated Salary

View more Data Engineer salaries at Shopee View more Data Engineer salaries


NodeFlair Insights of Shopee