Senior Data Engineer Senior Data Engineer …

Experian Information Solutions Incorporated
in Costa Mesa, CA, United States
Permanent, Full time
Be the first to apply
Competitive
Experian Information Solutions Incorporated
in Costa Mesa, CA, United States
Permanent, Full time
Be the first to apply
Competitive
Senior Data Engineer
🌎 English English (United Kingdom) Espaol Portugus (Brasil) () This job posting isn't available in all website languages ☰ Senior Big Data Engineer New 📅 1 day ago Post Date 📅 197935 Requisition # Apply for Job Share this Job Justin Hastings - Chief Human Resources Officer, North America at Experian Justin Hastings talks about our culture of innovation and inclusion. Visit jobs.experian.com to search for your next opportunity. Experian's Engineering team is looking for motivated and experienced Big Data Engineers, to join a highly skilled team of experienced professionals, who believe in best-of-breed software craftsmanship, clean and elegant coding, using the right tool for the job, and always exploring and learning new technologies and approaches. This Big Data Engineer will work on a high-volume data pipeline, data validation, data integration, data transformation with transaction state management. This involves working with multiple BUs to ingest data into an operational data store for downstream analytics by numerous stakeholders. There will be the following activities in this initiative.
  • Evolve a Data Validation Strategy
  • Data validation frameworks with high volume data processing
  • Near real time operational data store
  • Performance tuning of big data applications and analytical queries
Responsibilities/Requirements:

As a Big Data Engineer, you will be responsible for working on applications and services that handle all types of transactions. You will work in a fast-paced environment where continuous innovation and experimentation are a given. You will master both established and cutting-edge technologies like Hadoop, Hive, Spark, Presto, Oracle, Casandra, Storm, Kafka, Druid, MongoDB, CouchBase, among others to build data validation framework.
  • Develop the vision for an ever-evolving Data validation improvement strategy that not only satisfies current needs but can be easily adapted to future needs as new sources of data input and requirements for data output are identified
  • Designing, testing, deploying and documenting data validation procedures and their outputs
  • Utilize data validation tooling to profile the project source data, define or confirm the definition of the metadata, cleanse and accurately check the project data, check for duplicate or redundant records, and provide information on how to proceed with backend ETL Processes 
  • Partner with data stewards to provide summary results of data validation analysis, which will be used to make decisions regarding how to measure business rules and quality of the data
  • Develop methods to cleanse, manipulate and analyze large datasets, structured and unstructured data using Hadoop platform
  • Expert on data architecture, data models, data governance and data flow diagrams 
  • Collaborating with peers and seniors both within their team and across the organization
  • Experience with Cloud, industry-specific and data privacy, protection regulatory compliance requirements (GDPR, CCPA, PCI, FFIEC etc.)
  • Thorough knowledge of agile software delivery models (Kanban, Scrum, Less, SAFe, etc.) 
  • Design, develop, test, and debug large scale complex platform using big data technologies
  • Develop tools and automation for the effective management and operation of Big Data platform 
  • Collaborate with architects, engineers, and business on product design and feature
  • Exhibit a strong backbone and challenge the status quo when needed
  • Demonstrate a high level of curiosity and keep abreast of the latest technologies
  • Attention details are a must-have skill, show pride of ownership and strive for excellence in everything they do
Job Requirements:
  • 7-10 + years of software development experience
  • BS in Computer Science or related degree required. MS preferred
  • A mastery of how data validation is measured, including understanding of completeness, uniqueness, validity, accuracy, integrity, timeliness
  • Experience programming languages like Python, Java, C/C++, Scala or Go
  • Expert in Big Data Technologies such as Hadoop, HBase, Yarn, Presto, Kafka, Apache Spark
  • Experience in database/storage technologies, systems like DB2, Oracle, Cassandra, CouchBase, Mainframe
  • Competent in design/implementation for security, quality, reliability, availability, scalability, and performance
  • Skilled in software engineering tools and best practices
Benefits:

Working for a leading FTSE 50 global information services company is just one of the rewards of joining Experian. Our benefits package is designed to reward contribution and loyalty and to attract the kind of talented individuals who have their pick of employers. That is why we offer a highly competitive package which comprises:
  • Competitive base salary
  • Aggressive bonus plan
  • Core benefits including: full medical, dental, vision, matching 401K and the opportunity to work with a global leader
Experian is listed on the London Stock Exchange (EXPN) and is a constituent of the FTSE 100 Index. Total revenue for the year ended March 31, 2019 was $4.8 billion. Experian employs over 17,000 people across 44 countries.
Experian is an Equal Opportunity Employer. Anyone needing accommodation to complete the interview process should notify the talent acquisition partner. The word "Experian" is a registered trademark in the EU and other countries and is owned by Experian Ltd. and/or its associated companies. EEO Including Disability/Veterans My Profile

Create and manage profiles for future opportunities.

My Submissions

Track your opportunities.

Similar Listings

Costa Mesa, California, United States

📁 Product Development

Post Date: Oct 16, 2019

Costa Mesa, California, United States

📁 Product Development

Post Date: Sep 16, 2019

Costa Mesa, California, United States

📁 Product Development

Post Date: Sep 27, 2019

© Experian Jobs. All rights reserved. | | |

0 1
Close
Loading...