>

Lead Software Engineer (Big Data)

EPAM Systems

  View Insights

Apply

Job Summary


Salary
$7,000 - $14,000 SGD / Monthly EST

Job Type
Permanent

Seniority
Lead

Years of Experience
At least 7 years

Tech Stacks
Docker
ORC
play
Analytics
Spark Streaming
CI
Jupyter
HDFS
Avro
Hive
Spark
yarn
NoSQL
Airflow
Kubernetes
kafka
SQL
Scala
Hadoop
Python
Java

Job Description


We are looking for a Lead Big Data Engineer specialized in Big Data in Singapore to make the team stronger.
WE VALUEValue the individuals – We encourage and motivate people to grow. We perceive our people as a source of our success;
Strive for excellence – We strive for the highest standards of excellence and continuously learn. We take pride in our engineering and accomplishments;
Act as a team – We treat one another with respect and encourage the best ideas to come from anywhere within the organization. We value our diversity;
Focus on Customers – We build long term customer relationships, as we strive to always understand our customers' business and needs;
Act with integrity – We operate legally, honestly and ethically. We take responsibility for our actions.

RESPONSIBILITIES

  • Play a lead developer role
  • Write high quality and testable code following clean code principles
  • Implement functionality by following defined software development process without direct supervision
  • Read and understand project and requirement documentation
  • Create documentation describing his / her code
  • Participate in Agile Scrum activities: daily standup, demo session, retrospective, planning, etc

REQUIREMENTS

  • Polytechnic Diploma or above in Computer Science
  • 7+ years of experience in software engineering and Big Data
  • Able to lead a team and provide technical guidance to team
  • Advanced knowledge at least one programming language such as Java, Python, Scala
  • Familiar with SQL, Bash
  • Experienced in any of big data technologies and frameworks below:
    • Spark, Spark Streaming, Kafka/ Kafka Streams, Hadoop, Yarn, HDFS, Hive, Airflow, Jupyter
    • Parquet, ORC, AVRO, CarbonData
    • Lambda, Kappa, Data Lake
    • NoSQL Data Bases
    • Data platform
    • Machine learning
  • Software Professional with experience in IT mostly with JVM based technologies and frameworks
  • Has background with different platforms and strong focus on back-ends / Big Data / Analytics Solutions
  • Core professional expertise includes: Platform Architecture, Data Pipelines Architecture, Infrastructure Deployment and Management
  • Able to support existing and potential customers with requirements capture, solutions architecture, system design, solution prototyping
  • Experience with building traditional Cloud Data Warehouses, Data Lakes. Close and intensive work on previous projects with Containers and Resource Management systems: Docker, Kubernetes, Yarn
  • Designed, prototype and adjust end to end solution
  • Designed and implemented set of ingestion workflow to parse, transform and validate input data
  • Designed and developed independent CI/CD pipelines
  • Provided technical guidance for the support team
  • Participated in communication with customer on every phase

WE OFFER

  • Friendly team and enjoyable working environment
  • Work-life balance and flexible schedule
  • Online training library, mentoring, career development and potential partial grant of certification
  • Unlimited access to LinkedIn learning solutions
  • Referral bonuses
  • Compensation for sick leave and paid time off
  • Opportunities for self-realization

Salaries of Data Engineer at EPAM Systems

Salaries from EPAM Systems that are similar to Lead Software Engineer (Big Data)

7000 - 14000 SGD

Estimated Salary Range

View more Data Engineer salaries at EPAM Systems View more Data Engineer salaries
Apply

NodeFlair Insights of EPAM Systems