Big Data Engineer Big Data Engineer …

Cognizant
in Sydney, New South Wales, Australia
Permanent, Full time
Be the first to apply
Competitive
Cognizant
in Sydney, New South Wales, Australia
Permanent, Full time
Be the first to apply
Competitive
Big Data Engineer
What makes Cognizant a unique place to work? The combination of rapid growth and an international and innovative environment! This is creating many opportunities for people like YOU - people with an entrepreneurial spirit who want to make a difference in this world.
At Cognizant, together with your colleagues from all around the world, you will collaborate on creating solutions for the world's leading companies and help them become more flexible, more innovative, and successful. Moreover, this is your chance to be part of the success story.
Job Description:
  • Looking for a Big Data Engineer who knows to work on potential use cases of Big Data.
  • Have awareness of clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data to our feature developers and business analysts.
  • Have knowledge of Real-time and Batch Big data system & Data Analysis using Python.
  • Responsibilities
  • Create Spark (using Scala or Python) jobs for data transformation and aggregation
  • Write unit tests and maintain code coverage for developed code
  • Capable in creating the confluence document.
  • Capable in working with Batch and real time data both.
Skill Set
  • Hands on experience on Spark ( Using Scala or Python or Java )
  • Should hold working knowledge in AWS services (Cloud (AWS) - EC2, RDS,S3, SNS, SQS, Glue, Redshift, Lambda, ELB, and Cloud watch )
  • Should hold working knowledge in Azure services (ADF, ADLS, Event Hub, cosmosdb, Azure Databricks, etc...).
  • Knowledge of CICD and VC - Git, Bamboo CI/CD, Terraform, Ansible, Code build & Cloud formation
  • Languages -Scala(Spark), Java, Knockout.js & SQL , Capable in executing Hive/Impala SQLs.
  • Other Tools - Apache Airflow
  • Sound knowledge on Spark Query tuning and performance optimization.
  • Advantage on having knowledge on Real-time tool - Kafka
  • Added advantage to have awareness of Agile Methodology and tools like JIRA.
  • Good documentation experience
  • Salary range : >100k
Next steps
If you feel this opportunity suits you, or Cognizant is the type of organization you would like to join, we want to have a conversation with you! Please apply directly with us.
For a complete list of open opportunities with Cognizant, visit http://www.cognizant.com/careers
Cognizant is committed to providing Equal Employment Opportunities. Successful candidates will be required to undergo a background check.
About Cognizant
Cognizant (Nasdaq-100: CTSH) is one of the world's leading professional services companies, transforming clients' business, operating and technology models for the digital era. Our unique industry-based, consultative approach helps clients envision, build and run more innovative and efficient businesses. Headquartered in the US, Cognizant is ranked 185 on the Fortune 500 and is consistently listed among the most admired companies in the world. Learn how Cognizant helps clients lead with digital at www.cognizant.com or follow us @Cognizant.

Cognizant logo
More Jobs Like This
See more jobs
Close