We are looking for a Lead Big Data Engineer specialized in Big Data in Singapore to make the team stronger.
WE VALUEValue the individuals – We encourage and motivate people to grow. We perceive our people as a source of our success;
Strive for excellence – We strive for the highest standards of excellence and continuously learn. We take pride in our engineering and accomplishments;
Act as a team – We treat one another with respect and encourage the best ideas to come from anywhere within the organization. We value our diversity;
Focus on Customers – We build long term customer relationships, as we strive to always understand our customers' business and needs;
Act with integrity – We operate legally, honestly and ethically. We take responsibility for our actions.
RESPONSIBILITIES
- Play a lead developer role
- Write high quality and testable code following clean code principles
- Implement functionality by following defined software development process without direct supervision
- Read and understand project and requirement documentation
- Create documentation describing his / her code
- Participate in Agile Scrum activities: daily standup, demo session, retrospective, planning, etc
REQUIREMENTS
- Polytechnic Diploma or above in Computer Science
- 7+ years of experience in software engineering and Big Data
- Able to lead a team and provide technical guidance to team
- Advanced knowledge at least one programming language such as Java, Python, Scala
- Familiar with SQL, Bash
- Experienced in any of big data technologies and frameworks below:
- Spark, Spark Streaming, Kafka/ Kafka Streams, Hadoop, Yarn, HDFS, Hive, Airflow, Jupyter
- Parquet, ORC, AVRO, CarbonData
- Lambda, Kappa, Data Lake
- NoSQL Data Bases
- Data platform
- Machine learning
- Software Professional with experience in IT mostly with JVM based technologies and frameworks
- Has background with different platforms and strong focus on back-ends / Big Data / Analytics Solutions
- Core professional expertise includes: Platform Architecture, Data Pipelines Architecture, Infrastructure Deployment and Management
- Able to support existing and potential customers with requirements capture, solutions architecture, system design, solution prototyping
- Experience with building traditional Cloud Data Warehouses, Data Lakes. Close and intensive work on previous projects with Containers and Resource Management systems: Docker, Kubernetes, Yarn
- Designed, prototype and adjust end to end solution
- Designed and implemented set of ingestion workflow to parse, transform and validate input data
- Designed and developed independent CI/CD pipelines
- Provided technical guidance for the support team
- Participated in communication with customer on every phase
WE OFFER
- Friendly team and enjoyable working environment
- Work-life balance and flexible schedule
- Online training library, mentoring, career development and potential partial grant of certification
- Unlimited access to LinkedIn learning solutions
- Referral bonuses
- Compensation for sick leave and paid time off
- Opportunities for self-realization