Senior data platform architect Senior data platform architect …

Newtone Consulting
in Singapore
Permanent, Full time
Be the first to apply
Attractive
Newtone Consulting
in Singapore
Permanent, Full time
Be the first to apply
Attractive
Posted by:
Guoyi Zhang • Director
Posted by:
Guoyi Zhang
Director
The candidate will work within the Squad in charge of the DataLake implementation. As data architect, he/she will provide solutions and solution/positioning for the existing platform as well as for the target platform (2024).

Role and responsibilities:

  • Provide the architectural view of the solution and will be responsible for the technical documentations necessary for validations in the technical committees of the bank
  • Responsible for the Data platform TAD (Technical Architecture Document) 
  • Responsible for ensuring the security requirements
  • Contribute to the design of the target data platform (design, integration, platform management, data management, storage requirements based on usage, etc...)
  • Provide analysis/evaluation of technical solutions recommended by the group to facilitate management decision. 
  • Provide architectural roadmap (planning) for software/platform upgrades

 

Ideal profile:

  • 10+ years of experience,
  • 3+ yrs into Senior Architect Role / Data platform architect
  • 5+ yrs of hands on experience working as Technical Lead / Senior Data Engineer
  • Experience in data platform design, management, storage, integration
  • Proficient with Big Data Hadoop - Hortonworks HDP 3.1.x & core Components covering data engineering, management, operation stack 
  • Detailed Knowledge on HDP/CDH, HDFS (File Format – Parquet, ORC, Avro, JSON), Hive (Schema, Partitioning) , Data Lake (Object Store), NoSQL(MongoDB, HBase)
  • Access & Data Security – AD-LDAP-SAML- Kerberos-2FA IDP AuthN plus Data security through encryption, masking, filtering , anonymization
  • Strong hands on experience in Processing Framework - Spark 2.x/3.x (Core, structured API, Streaming, MLLib)
  • Language & Package - Python (Scripting & PySpark), Scala using Spark API, Unix Shell, SQL Query (basic & advanced)
  • Good communication skills
Newtone Consulting logo
More Jobs Like This
See more jobs
Close
Loading...
Loading...