Big Data Engineer/Hadoop Big Data Engineer/Hadoop …

in Houston, TX, United States
Permanent, Full time
Be the first to apply
in Houston, TX, United States
Permanent, Full time
Be the first to apply
Big Data Engineer/Hadoop
The Corporate Technology (CT) organization develops applications and provides technology support for corporate functions across JPMorgan Chase, including Global Finance, Corporate Treasury, Risk Management, Human Resources, Compliance, Legal, and all functions within the Corporate Administrative Office (CAO).

Our Technology Controls team relies on smart, technology-driven people like you to develop and deliver streamlined solutions supporting our Controls and IT Risk agendas. We focus on areas like Oversight & Controls Technology, Cloud Controls, Identity & Access Management , IT Risk & Controls, and Third Party Risk Management. At the end of the day, our goal is to create products that promote productivity, quality and innovation across our network

CT teams are aligned with corporate partners' evolving technology needs and the firm's ever expanding technology controls agenda.

A top CT priority is purpose-building scalable corporate systems. Teams focus is on:

  • Responding to the evolving regulatory environment and helping to meet the firm's regulatory commitments by addressing internal and external commitments
  • Advancing the firm's Roadmap programs -- Single Sourcing of data, Architecture Convergence, and Rationalization of Application Portfolio and Platforms
  • Adopting industry leading technologies to support best-in-class business capabilities for high performance computing and data storage solutions
  • Driving innovation across the firm's corporate technology portfolio, increasing efficiencies through process automation and Agile application development, with an emphasis on user experience and shorter development cycles
  • Investing in security & controls for cyber, access/entitlements uplift, data protection and application resiliency

Controls & Operational Risk Technology supports - identification, assessment, and prioritization of risks followed by coordinated application of resources to minimize, monitor, and control the probability and/or impact of events.

As a member of our Software Engineering Group you will dive head-first into creating innovative solutions that advance businesses and careers. You'll join an inspiring and curious team of technologists dedicated to improving the design, analytics, development, coding, testing and application programming that goes into creating high quality software and new products. You'll be tasked with keeping the team and other key stakeholders up to speed on the progress of what's being developed. Coming in with an understanding of the importance of end-to-end software development-such as Agile frameworks-is key. And best of all, you'll be working with and sharing ideas, information and innovation with our global team of technologists from all over the world.

Key Responsibilities
•Design and Development of data pipelines in Hadoop/SPARK
•Design and Development of data access API's
•Carry out design reviews/code reviews at agreed points throughout the project life cycle
•Work closely with the vendor development team to monitor the design/development undertaken by them
•Hands on design and development of technical artifacts
•Participate in technical reviews; define/Improve processes on configuration management, deployment and resiliency planning for the application.

This role requires a wide variety of strengths and capabilities, including:
•Advanced knowledge of application, data and infrastructure architecture disciplines

•Understanding of architecture and design across all systems

•Working proficiency in developmental toolsets

•Ability to collaborate with high-performing teams and individuals throughout the firm to accomplish common goals

•Proficiency in one or more general purpose programming languages

•Minimum 5 + years of financial application development/consulting experience.

•Solid experience in Core Java/ J2EE design techniques

•3-4 years of hands on Hadoop development specifically in the following areas:
◦Kafka Real time messaging

◦Hbase modeling and development

◦Spark processing and performance tuning

◦Sqoop data ingestions

◦Parquet file partitioning


•Micro Services Design and Development

•Exposure/competence with Agile Development approach

•Solid experience utilizing Source code control software (e.g. GIT, Subversion)

•Multi-threaded Programming

•RDBMS experience preferably with Oracle including stored procedures

•Test Driven Development/Behavior Driven Development


•Code Reviews - PMD, JUNIT, Performance, Memory Management

•Understanding of software skills such as business analysis, development, maintenance and software improvement

•Experience with Cloud native application development, Cloud deployment, and Cloud application refactoring

•Tableau (a plus)

•Continuous Integration/Development

•UNIX shell scripting (1 year)

•Experience with Rule Engines

•Experience with Natural Language Processing (a plus)

Tech at JPMC:
When you work at JPMorgan Chase & Co., you're not just working at a global financial institution. You're an integral part of one of the world's biggest tech companies. In 14 technology hubs worldwide, our team of 40,000 technologists design, build and deploy everything from enterprise technology initiatives to big data and mobile solutions, as well as innovations in electronic payments, cybersecurity, machine learning, and cloud development. Our $9.5B annual investment in technology enables us to hire people to create innovative solutions that will not only transform the financial services industry, but also change the world.