Skip to main content
MENU
Subscribe
  • Subscribe
  • Account
  • LOGIN
  • Topics
    • Alternatives
    • Consultants
    • Coronavirus
    • Courts
    • Defined Contribution
    • ESG
    • ETFs
    • Hedge Funds
    • Industry Voices
    • Investing
    • Money Management
    • Opinion
    • Partner Content
    • Pension Funds
    • Private Equity
    • Real Estate
    • Russia-Ukraine War
    • SECURE Act 2.0
    • Special Reports
    • White Papers
  • Rankings & Awards
    • 1,000 Largest Retirement Plans
    • Top-Performing Managers
    • Largest Money Managers
    • DC Money Managers
    • DC Record Keepers
    • Largest Hedge Fund Managers
    • World's Largest Retirement Funds
    • Best Places to Work in Money Management
    • Excellence & Innovation Awards
    • WPS Innovation Awards
    • Eddy Awards
  • ETFs
    • Latest ETF News
    • Fund Screener
    • Education Center
    • Equities
    • Fixed Income
    • Commodities
    • Actively Managed
    • Alternatives
    • ESG Rated
  • ESG
    • Latest ESG News
    • The Institutional Investor’s Guide to ESG Investing
    • ESG Sustainability - Gaining Momentum
    • Climate Change: The Inescapable Opportunity
    • Impact Investing
    • 2022 ESG Investing Conference
    • ESG Rated ETFs
  • Defined Contribution
    • Latest DC News
    • DC Money Manager Rankings
    • DC Record Keeper Rankings
    • Innovations in DC
    • Trends in DC: Focus on Retirement Income
    • 2022 Defined Contribution East Conference
    • 2022 DC Investment Lineup Conference
  • Searches & Hires
    • Latest Searches & Hires News
    • Searches & Hires Database
    • RFPs
  • Performance Data
    • P&I Research Center
    • Earnings Tracker
    • Endowment Returns Tracker
    • Corporate Pension Contribution Tracker
    • Pension Fund Returns Tracker
    • Pension Risk Transfer Database
    • Future of Investments Research Series
    • Charts & Infographics
    • Polls
  • Careers
  • Events
    • View All Conferences
    • View All Webinars
    • 2022 Retirement Income Conference
    • 2022 Managing Pension Risk & Liabilities
    • 2022 WorldPensionSummit
Breadcrumb
  1. Home
  2. MONEY MANAGEMENT
March 20, 2017 01:00 AM

Machine learning will transform investment management

David Andre and Conrad Gann
  • Tweet
  • Share
  • Share
  • Email
  • More
    Reprints Print

    “Prediction is very difficult, especially if it's about the future.”

    — Niels Bohr, Nobel Prize-winning physicist

    Watch out, investment professionals — machine learning is coming to a company like yours. This subset of artificial intelligence isn't just for programming self-driving cars or sorting cat pictures. It's entering the investment management space, and its disruptive potential is only beginning to emerge.

    From Siri and Alexa to Amazon and IBM's Watson, computer programs driven by artificial intelligence draw on massive amounts of data to solve previously intractable problems. Machine learning gives computers the additional ability to learn without being explicitly programmed. This type of AI enables computers to change — to learn — when exposed to new data.

    The technology behind machine learning is being propelled by major algorithmic innovations that allow machines to synthesize extremely large data sets and reveal patterns, trends and associations that are relevant to prediction problems. And the increasing ubiquity of inexpensive parallel computation is making this technology accessible to even lean startups.

    The technology already has transformed many industries, from the medical to the automotive. In addition, machine learning is widely seen as a leading driver of revenue at Google, Facebook and Amazon. However, its adoption in investment management so far has been limited. With the exception of a few leading hedge funds, the industry has failed to recognize machine learning's potential to drive investment decisions.

    Algorithms that continuously improve

    ML automates the discovery of predictive algorithms that are able to continuously improve as they get access to more data. Recently, the focus has been on automating many of the tasks traditionally performed by data scientists, including data cleaning, model selection, data clustering, automatic feature generation and dimensionality reduction.

    One technique, deep learning, has been responsible for many recent breakthroughs, including learning to play the game of Go well enough to beat the world's third-ranked player. Deep learning is enabling image recognition that is on par with human abilities and is significantly improving speech recognition and language translation; it is also permitting better story and ad targeting at places like Google and Facebook. Part of what makes deep learning so powerful is that it can organize and aggregate large unlabeled data sets into abstracted forms, which are more useful for prediction. The results have been stunning, both in speed and accuracy.

    What does this mean for investment management?

    We believe that machine learning will transform the way investment strategies are administered by all types of managers. Even the most fundamental, non-quantitative managers will be generating ideas from data that originally was sourced and synthesized via ML. For example, deep learning's ability to create structured data could be used to extract topic and sentiment from text sources such as earnings calls, SEC filings and social media; or for the analysis of satellite imagery for parking lot or crop data; or to evaluate location data from mobile phones.

    While quant managers will certainly use these new data sources, they will also be able to use machine learning to conquer the classic hazard of overfitting. The problem with overfitting lies in the temptation for investment committees, or their portfolio managers, to believe they could have discovered a data-driven relationship before they really could have or to mistake spurious correlation for causation.

    Overfitting often starts when data scientists take their favorite methodology, set up a number of input features and put in place the parameters of their method and a utility function. Then they run their algorithm on a part of their data (the training set), and look at results on another part of their data (the hold-out set). When invariably, things don't work as predicted, the researchers will tweak their parameters, or the features of their data, or the algorithm being used. Over time, the results are overfitted, as the value of the hold-out set becomes contaminated with each new test.

    A solution to overfitting

    With machine learning, we can minimize overfitting by restricting the role of the human to setting the overall investment framework. This framework will include the stock universe, trading frequency, performance benchmarks, data sources for signals and risk constraints. We leave the discovery of the specific formulation of the investment strategy to the system.

    The framework will also specify the types of ML techniques that the machine will have access to as it discovers new strategies and decides which ones to trade. Essentially, the role of the quant will move to a higher-level function. The more routine steps of testing, scoring and tuning different structures will be handled by the machine, which will iterate through history in much the same way as humans do in real time (i.e. without knowing about the future).

    Advances in machine learning will allow further automation of tasks, including feature discovery, algorithm selection and even the optimization of trading code that implements a signal. With these newer methods, humans can spend their time creating frameworks and obtaining new data sets. Automated methods also reduce the number of quants needed to run a firm, which, given the high cost of salaries, is increasingly important as well.

    The tools that enable automated strategy discoveries will also enable customized solutions. This is because the criteria for a successful strategy can be specified upfront in the framework. For instance, one approach could search for a strategy with a specified maximum deviation from a classic index, such as U.S. small-cap value, with as much additional alpha as possible. This type of customization could lead to a new class of retail investment products.

    We believe machine learning will become increasingly important for asset management and that most firms will be utilizing either machine learning tools or data within five years. Human involvement will still be critical for risk management and framework selection, but increasingly the strategy innovation process will be automated.

    David Andre is CEO and director, and Conrad Gann is chief operating officer, at Cerebellum Capital, San Francisco. This content represents the views of the authors. It was submitted and edited under P&I guidelines, but is not a product of P&I's editorial team.

    Related Articles
    Data, analytics grow in importance amid slow markets — report
    Hedge fund industry divided on impact of technology – survey
    Stress testing a new normal for investors
    Robo-advisers aren't taking over ... yet
    AI going to head of the class
    BlackRock puts more of its future in tech
    Management firms gain big attention with upgrades
    State Street CEO sees custody 'arms race'
    AI? It's not sci-fi anymore
    WorldQuant University offering free master's
    AI key for third wave of hedge fund managers
    Glass box vs. black box
    Technology disruption now a pressing issue for investors
    Japan's GPIF selects Sony Computer Science Laboratories to study AI applications
    Recommended for You
    Robert Sharps
    T. Rowe Price's Robert Sharps takes stock of volatility, markets
    Karen Lau
    Marathon adds co-leader of CLOs to corporate credit team
    Ant_Group_i.jpg
    Fidelity, BlackRock cut fintech giant Ant's valuation

    Reader Poll

    August 10, 2022
    SEE MORE POLLS >
    Sponsored
    White Papers
    Gaining Momentum: Where Next for Trend-Following?
    How Has 2022's Carnage Reshaped Global Stock and Bond Markets?
    Can Sustainable Labeling of Financial Products Prevent Greenwashing?
    Hedge Funds 2.0: Back to the future
    Is there a mid-cap gap in your DC plan?
    Why pursue direct lending in the core middle market?
    View More
    Sponsored Content
    Partner Content
    The Industrialization of ESG Investment
    For institutional investors, ETFs can make meeting liquidity needs easier
    Gold: the most effective commodity investment
    2021 Investment Outlook | Investing Beyond the Pandemic: A Reset for Portfolios
    Ten ways retirement plan professionals add value to plan sponsors
    Gold: an efficient hedge
    View More
    E-MAIL NEWSLETTERS

    Sign up and get the best of News delivered straight to your email inbox, free of charge. Choose your news – we will deliver.

    Subscribe Today
    August 1, 2022 page one

    Get access to the news, research and analysis of events affecting the retirement and institutional money management businesses from a worldwide network of reporters and editors.

    Subscribe
    Connect With Us
    • RSS
    • Twitter
    • Facebook
    • LinkedIn

    Our Mission

    To consistently deliver news, research and analysis to the executives who manage the flow of funds in the institutional investment market.

    About Us

    Main Office
    685 Third Avenue
    Tenth Floor
    New York, NY 10017-4036

    Chicago Office
    130 E. Randolph St.
    Suite 3200
    Chicago, IL 60601

    Contact Us

    Careers at Crain

    About Pensions & Investments

     

    Advertising
    • Media Kit
    • P&I Content Solutions
    • P&I Careers | Post a Job
    • Reprints & Permissions
    Resources
    • Subscribe
    • Newsletters
    • FAQ
    • P&I Research Center
    • Site map
    • Staff Directory
    Legal
    • Privacy Policy
    • Terms and Conditions
    • Privacy Request
    Pensions & Investments
    Copyright © 1996-2022. Crain Communications, Inc. All Rights Reserved.
    • Topics
      • Alternatives
      • Consultants
      • Coronavirus
      • Courts
      • Defined Contribution
      • ESG
      • ETFs
      • Hedge Funds
      • Industry Voices
      • Investing
      • Money Management
      • Opinion
      • Partner Content
      • Pension Funds
      • Private Equity
      • Real Estate
      • Russia-Ukraine War
      • SECURE Act 2.0
      • Special Reports
      • White Papers
    • Rankings & Awards
      • 1,000 Largest Retirement Plans
      • Top-Performing Managers
      • Largest Money Managers
      • DC Money Managers
      • DC Record Keepers
      • Largest Hedge Fund Managers
      • World's Largest Retirement Funds
      • Best Places to Work in Money Management
      • Excellence & Innovation Awards
      • WPS Innovation Awards
      • Eddy Awards
    • ETFs
      • Latest ETF News
      • Fund Screener
      • Education Center
      • Equities
      • Fixed Income
      • Commodities
      • Actively Managed
      • Alternatives
      • ESG Rated
    • ESG
      • Latest ESG News
      • The Institutional Investor’s Guide to ESG Investing
      • ESG Sustainability - Gaining Momentum
      • Climate Change: The Inescapable Opportunity
      • Impact Investing
      • 2022 ESG Investing Conference
      • ESG Rated ETFs
    • Defined Contribution
      • Latest DC News
      • DC Money Manager Rankings
      • DC Record Keeper Rankings
      • Innovations in DC
      • Trends in DC: Focus on Retirement Income
      • 2022 Defined Contribution East Conference
      • 2022 DC Investment Lineup Conference
    • Searches & Hires
      • Latest Searches & Hires News
      • Searches & Hires Database
      • RFPs
    • Performance Data
      • P&I Research Center
      • Earnings Tracker
      • Endowment Returns Tracker
      • Corporate Pension Contribution Tracker
      • Pension Fund Returns Tracker
      • Pension Risk Transfer Database
      • Future of Investments Research Series
      • Charts & Infographics
      • Polls
    • Careers
    • Events
      • View All Conferences
      • View All Webinars
      • 2022 Retirement Income Conference
      • 2022 Managing Pension Risk & Liabilities
      • 2022 WorldPensionSummit