For Recruiters
It goes well beyond a lack of supply.

The real reasons investment firms can’t find good data scientists

Over two days at this week's AI and Data Science and Trading Conference in New York, one general theme became very clear: banks, hedge funds and asset managers are desperate for good data scientists. The prevailing theory has always been that the supply just isn't enough to meet the demand. But hiring managers across several different panel discussions suggested that wasn’t necessarily the case. The bigger issue is that the majority of master’s and PhD candidates simply aren’t skilled enough in all the areas necessary to demand big pay packages.

When asked about the biggest challenge facing the data science and machine learning community over the next five years, Anthony Ledford, Man AHL’s chief scientist, pointed to the lack of “suitable” candidates, noting that too many young people think they can just plug-and-play data mining tools and be successful. “Finding those people with the curiosity and ability to really scrutinize data and come back with something different,” is a challenge, Ledford said, noting his firm has become extremely “fussy” about who they hire.

Sameer Gupta, head of data sourcing at Point72, said that much of what he considers “talent” in data science is passion and a curiosity to learn. Yet he fails to recognize those traits in many candidates with perfect resumes, 4.0 GPAs and Ivy League educations. “They know all the buzzwords, but they are rarely the people for the job," he said. Some new recruits are also surprised or turned off when they are asked to do so-called “janitor work,” an industry term for data preparation and cleaning, according to Two Sigma’s machine learning guru Claudia Perlich.

The apparent conflicts between resume and execution is why Gupta said he’s not a fan of interviews, something echoed earlier by his colleague Matthew Granade, Point72’s chief market intelligence officer. Instead, they prefer projects and tests.

“Give them a problem to solve, throw them in the water, and if they don’t like it or can’t do it, they often don’t even come back to you,” he said. “It’s a great way to figure out who to bring on.”

The general takeaway was that firms need to look beyond target schools and GPAs to find niche talent. Roughly 80% of PhD-level machine learning talent works at Google and Facebook, said Sarah Hoffman, vice president of AI and machine learning research at Fidelity Investments, citing an unknown study (likely touched on in this paper). That leaves just 20% for everyone else, meaning they need to be more creative.

Investment firms have to get involved in more university projects and hackathons, she said. “We need to get to the point where we can say: ‘I don’t care about if you went to college, I’m going to give you data and see what you can do with it.’”


The final struggle for hiring managers is finding the right personality match. An AI and machine learning headhunter had previously noted that a lack of communication skills and an inability to interface with key stakeholders at investment firms has held back many potential data scientists.

One such example was given to us anonymously by a speaker at a different forum who recalled interviewing a candidate who had a strong resume for an engineer at an asset manager but who didn’t appear to have much in the way of communication skills or a willingness to engage. The interviewer tried to get the candidate to open up a bit, asking him to say something about himself that wasn’t on his resume. After pausing for a few seconds, the candidate questioned why there would be anything that he wouldn't put on his resume.

In an attempt to clarify, the interviewer said he just wanted to get to know him beyond his list of achievements and skills. The candidate paused again, this time for upwards of 45 seconds. He finally responded: “I don’t own an air conditioner.”

In his report, the interviewer noted that the prospect “could well be a genius, but you can never put him in front of anyone.” They decided to pass.

Have a confidential story, tip, or comment you’d like to share? Contact: btuttle@efinancialcareers.comBear with us if you leave a comment at the bottom of this article: all our comments are moderated by actual human beings. Sometimes these humans might be asleep, or away from their desks, so it may take a while for your comment to appear. Eventually it will – unless it’s offensive or libelous (in which case it won’t).  

AUTHORBeecher Tuttle US Editor
  • Ma
    Mark Smith
    27 March 2019

    My resume, while some would think is reasonably impressive, now shows 15 years of teaching math and AP Java, because of life's curveballs. But, I can communicate clearly, and have quiescent skills I'm dying to showcase and employ (maybe even share some of those high school jokes that I have been privy to!).

    If resumes are inadequate, as were personal ads in newspapers pre-internet, where can I send a video of me sharing my personal data mining exploits vis-à-vis the stock market, and get noticed?

    In the meantime, I'll keep studying data structures and algorithms from my college years...

  • da
    22 March 2019

    In my opinion there are other elements to consider. First recruiters are on average far from expert on the topic, especially on really technical and fast moving sectors such as data science or ML. So they try to just add boxes to tick in the list to have their work done. Having worked with many talented specialists I find many of them with less developed social skills. You can choose if have managers able do work with them or renounce to good specialists. Also design companies have started the trend of asking for demo projects even before evaluating a candidature. In my opinion specialized consulting come not for free, so an agreement for compensation need to be found.

  • Ad
    22 March 2019

    Another possibility: the typical personality profile of highly qualified and excellent minds in data science.

    If you have an obviously great, creative and analytical mind and your top priority is to use it to buy a stable, well paying career path in finance then you study finance, business or economics.

    If you're that same person except it's also a high priority for feeling like you're changing the world in a positive way then perhaps you study data science. You have native talent and in the academic world your source datasets orient you toward big societal issues, worthy open-data projects and before long you're gaining a reputation for being able to put together exciting and important sounding results. Your trajectory is toward NGOs, cool tech companies or high flying in government. You'll probably earn a bit less than you could have made in finance but you're a recognised star so it sure isn't bad.

    This is not to say startups, NGOs have a higher average quality of staff, just that this is probably where the top 5% want to be in contrast to finance majors.

Apply for jobs

Find thousands of jobs in financial services and technology by signing up to eFinancialCareers today.

Boost your career

Find thousands of job opportunities by signing up to eFinancialCareers today.
Latest Jobs
Amber Group
Quant Trader (OMM)- PROP- US
Amber Group
New York, USA
State Street Corporation
Senior Software Engineer in Test-2
State Street Corporation
Burlington, USA
State Street Corporation
Cyber Security Operations Center Analyst-1
State Street Corporation
Boston, USA
Robert Half - US
VP Credit Analyst - Corporate Banking
Robert Half - US
New York, USA