Data Engineer Data Engineer …

TEKsystems (Allegis Group Singapore Pte Ltd)
in Singapore
Contract, Full time
Be the first to apply
Competitive
TEKsystems (Allegis Group Singapore Pte Ltd)
in Singapore
Contract, Full time
Be the first to apply
Competitive
Data Engineer
Duties:
You will be involved in various areas of the company's Data Ecosystem including reporting & analytics, data infrastructure, and various other data services that are integral parts of the company's overall technical stack.
You will run the code, pipeline and infrastructure that extracts, processes, and prepares
every piece of data generated or consumed by the company's systems with a diverse team.

Abilities
  • Build, deploy and manage big data solutions that can adequately handle the needs of a rapidly growing data driven company
  • Spearhead the development of systems, architectures, and platforms that can scale to the 3 Vs of Big data (Volume, Velocity, Variety)
  • Streamline data access and security to enable data scientists and analysts to easily access to data whenever they need to
  • Build out scalable and reliable ETL pipelines and processes to ingest data from a large number and variety of data sources
  • Maintain and optimize the performance of our data analytics infrastructure to ensure accurate, reliable and timely delivery of key insights for decision making
  • Lead the movement cleaning and normalizing subsets of data of interest as preparatory step before deeper analysis by the data scientists
  • Run Modern high performance analytical databases and computation engines like Spark, Flink, Presto, Synapse, BigQuery, Greenplum and others

Skills
Essential
  • Python
  • Scala
  • Spark/Hive or other big data stack (NOT Hadoop)
  • Able to build, deploy and manage big data solutions to support the large data requests
  • Development of robust and reliable data ETL pipelines for the ingestion of large volumes of data
  • Deep understanding of databases and best engineering practices - include handling and logging errors, monitoring the system, building human-fault-tolerant pipelines, understanding how to scale up, addressing continuous integration, knowledge of database administration, maintaining data cleaning and ensuring a deterministic pipeline
  • Designed high performance scalable infrastructure stacks for Big Data Analytics
  • Experience in handling large data sets (multiple PBs) and working with structured, unstructured and geographical datasets
  • Good communication skills

Bonus
  • Experience with Airflow
  • Experience with Cloud (AWS and/or Azure)

For more information you can email Aiden Peh in our Singapore office on aiden.peh@teksystems.com quoting Job Reference 527656 or alternatively, apply here to register your interest.
http://jobs.en-sg.teksystems.com/O08d9V/data-engineer-itcommunications-singapore-central-singapore-14857981

Allegis Group Singapore Pte Ltd, Company Reg No. 200909448N, EA License No. 10C4544

TEKsystems (Allegis Group Singapore Pte Ltd) logo
More Jobs Like This
See more jobs
Close
Loading...