Lead Software Engineer (Big Data) Lead Software Engineer (Big Data) …

EPAM Systems (Hong Kong) Limited
in Singapore
Permanent, Full time
Last application, 22 Oct 20
Competitive Package
EPAM Systems (Hong Kong) Limited
in Singapore
Permanent, Full time
Last application, 22 Oct 20
Competitive Package
To play a lead developer role and run the scrum team for the project.


  • Play a lead developer role and run the scrum team
  • Write high quality and testable code following clean code principles
  • Implement functionality by following defined software development process without direct supervision
  • Read and understand project and requirement documentation
  • Create documentation describing his/her code
  • Must be a role model for colleagues; creates deliverables in high quality
  • Participate in Agile Scrum activities: daily standup, demo session, retrospective, planning, etc.


  • Polytechnic Diploma or above in Computer Science
  • At least 7 years of relevant experience; experience working with a variety of information systems and data files, including large and complex files; ability to interpret and report results of analyses, provide business recommendations; ability to coach and train others.
  • Has expert level of software development and data analysis/quality concepts. Able to define, follow, actively influence and enhance a data quality verification process
  • Advanced knowledge at least one programming language such as Java, Python, Scala
  • Familiar with SQL, Bash
  • Experienced in any of big data technologies and frameworks below:
  1. Spark, Spark Streaming, Kafka/ Kafka Streams, Hadoop, Yarn, HDFS, Hive, Airflow, Jupyter
  2. Parquet, ORC, AVRO, CarbonData
  3. Lambda, Kappa, Data Lake
  4. NoSQL Data Bases
  5. Data platform
  6. Machine learning
  • Software Professional with experience in IT mostly with JVM based technologies and frameworks
  • Has background with different platforms and strong focus on back-ends / Big Data / Analytics Solutions
  • Core professional expertise includes: Platform Architecture, Data Pipelines Architecture, Infrastructure Deployment and Management
  • Able to support existing and potential customers with requirements capture, solutions architecture, system design, solution prototyping
  • Expected to lead meetings/phone conferences with clients and senior-level client contacts; be involved into customer workshops and presentations; supervise junior staff in client meetings and presentations; visit customers without supervision
  • Experience with building traditional Cloud Data Warehouses, Data Lakes. Close and intensive work on previous projects with Containers and Resource Management systems: Docker, Kubernetes, Yarn.
  • Designed, prototype and adjust end to end solution
  • Designed and implemented set of ingestion workflow to parse, transform and validate input data
  • Designed and developed independent CI/CD pipelines
  • Provided technical guidance for the support team
  • Participated in communication with customer on every phase
EPAM Systems (Hong Kong) Limited logo
More Jobs Like This
See more jobs