>

Big Data Engineer, Group Operations & Technology

OCBC Bank

  View Insights

Apply

Job Summary


Salary
$6,000 - $12,000 SGD / Monthly EST

Job Type
Permanent

Seniority
Senior

Years of Experience
7-10 years

Tech Stacks
ETL
Druid
Shell Script
Spark Streaming
Teradata
Elastic
Pandas
Shell
UNIX
Hive
Solr
Spark
Flink
kafka
Hadoop
Django
Python

Job Description


  • Collaborate with End Users, Business Analysts, and translate requirements into robust, scalable, operable solutions.
  • Build, Test, Deploy Data Pipelines for both Real time , Batch and Hybrid Frameworks
  • Implement Best Practices and Performance Optimization on Big Data Pipelines to achieve the best data engineering outcomes
  • Troubleshoot & Resolve Issues across various toolsets and services on the Big Data Platform
  • Work with various stakeholders within IT and Business and Support the Projects Life Cycle (Agile & SDLC)
  • Employ Dev Ops to deliver Codes from Development to Production using relevant technologies

Job Qualifications

  • Overall 7-10 years of relevant working experience in Data Management/Integration/Modelling within the big data ecosystem in a Banking environment
  • 5+ Years’ as a hands on technologist familiar with Hadoop. Hive, Spark, Kafka, Spark Streaming, Flink, Druid and allied tools and technologies
  • 5+ Years’ experience, Designing, Architecting, Implementing and optimizing high throughput fault tolerant data pipelines for Batch (ETL/ELT) and Real Time, and Stream Processing
  • 3+ Years’ experience with Architecting Frameworks for Self Service Platforms/Data Market Place/Data APIs delivering data at Scale
  • 4+ Years’ experience with collaborating and fronting business users for gathering Requirements and translating to Technical Outcomes
  • 3+ Years’ experience with Performance Tuning on Hadoop, Spark data pipelines
  • Demonstrable automation experience on Unix Shell Scripting
  • Experience with Teradata FSL-DM is an added advantage
  • Experience with Indexing platforms like Solr, Elastic is an added advantage
  • Experience in Python Scripting and libraries like Pandas, Django is an added advantage
  • Should be Collaborate with diverse cross functional teams within IT and Business to Independently drive outcomes
  • Should possess Good Communication Skills

Salaries of Data Engineer at OCBC Bank

Salaries from OCBC Bank that are similar to Big Data Engineer, Group Operations & Technology

6000 - 12000 SGD

Estimated Salary Range

View more Data Engineer salaries at OCBC Bank View more Data Engineer salaries
Apply

NodeFlair Insights of OCBC Bank