• Competitive
  • Raleigh, NC, USA
  • Permanent, Full time
  • Credit Suisse -
  • 25 May 18

Big Data / Hadoop Administrator# 111836

We Offer
We are seeking talented, experienced Big Data / Hadoop Administrator to join a growing, high-visibility cross-Bank team that is developing and deploying solutions to some of Credit Suisse's most challenging analytical problems. As a member of this team, the successful candidate will support big data clients with data spanning Credit Suisse's global organization to solve emerging mission-critical challenges via the utilization of emerging technologies such as:
  • Distributed file systems and storage technologies (HDFS, HBase, Hive, Kudu)
  • Large-scale distributed data analytic platforms and compute environments (Spark, Map/Reduce)
  • Streaming technologies such as Kafka, Flume

Credit Suisse maintains a Working Flexibility Policy, subject to the terms as set forth in the Credit Suisse United States Employment Handbook.

You Offer
  • Expert level knowledge of Cloudera Hadoop components such as HDFS, Sentry, HBase, Impala, Hue, Spark, Hive, Kafka, YARN, ZooKeeper and Postgres
  • Cluster maintenance as well as creation and removal of nodes using tools like Cloudera Manager
  • Performance tuning of Hadoop clusters and Hadoop MapReduce routines
  • Screen Hadoop cluster job performances and capacity planning
  • Monitor Hadoop cluster connectivity and security. Manage, Troubleshoot and review Hadoop log files
  • Eyes-on-glass cluster monitoring and responding to internal tickets and email alerts. File system management and monitoring
  • Intimate knowledge of non-root installation with fully integrated AD/Kerberos authentication
  • Working with data delivery teams to setup new Hadoop clusters. This job includes setting up Kerberos principals and testing
  • Monitor Hadoop cluster connectivity and security. Setup Splunk monitoring
  • Diligently teaming with the infrastructure, network, database, application and business intelligence teams to guarantee high data quality and availability
  • Collaborating with application teams to install Hadoop updates, patches, version upgrades when required
  • Aligning with the engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments
  • Assist in documenting requirements as well as resolve conflicts or ambiguities
  • Tune Hadoop solutions to improve performance and end-user experience
  • Languages: Bash (essential), Python (essential)
  • Understanding of security principles e.g. TLS, Kerberos
  • Good attention to detail around documentation
  • Proactive individual with a solution-driven attitude with production support experience
  • Service Management i.e. Release management, Change management, incident management
  • Experience with deployment toolsets like Odyssey, SVN, Tableau, Nolio, Pentaho
  • Loading data from different datasets and deciding on which file format is efficient for a task. Source large volumes of data from diverse data platforms into Hadoop platform
  • Understanding the requirements of input to output transformations
  • Assign schemas and create Hive tables
  • Apply different HDFS formats and structure like Parquet, Avro, etc. to speed up analytics
  • Fine tune Hadoop applications for high performance and throughput
  • Troubleshoot and debug any Hadoop ecosystem run time issues
  • Strong communication skills and the ability to present deep technical findings to a business audience
  • The ability to function within a multidisciplinary, global team. Be a self-starter with a strong curiosity for extracting knowledge from data and the ability to elicit technical requirements from a non-technical audience
  • Work in teams and collaborate with others to clarify requirements. Process oriented, strong team player, Good client facing skills
  • 7+ years' experience in enterprise IT at a global organization. Recent 3+ years in Big Data ecosystem administration
  • Fluent written and spoken English

For more information visit Technology Careers .

Raleigh, NC, USA Raleigh NC US