Machine learning will transform investment management
Skip to main content
pilogo-NEW
Subscribe
  • Subscribe
  • My Account
  • login
  • NEWS
    • Asset owners and the coronavirus
    • Alternatives
    • Consultants
    • Coronavirus
    • Defined Contribution
    • ESG
    • Frontlines
    • Hedge Funds
    • Investing / Portfolio Strategies
    • Money Management
    • Pension Funds
    • People Moves
    • Private Equity
    • Real Estate
    • Searches & Hires News
    • SECURE Act
    • Special Reports
    • WorldPensionSummit
    • Ron Schmitz
      Pandemic drives faster transition for Virginia to private markets
      Mubadala Investment Co. logo
      Mubadala draws on portfolio in coronavirus fight
      T.J. Carlson
      Texas Muni reduces downside risk during pandemic, finding opportunities now
      Scott Davis
      ‘Triage plan’ at Indiana system helped stem losses
    • BentallGreenOak agrees to acquire Metropolitan Real Estate Equity
      watch video
      0:45
      Private funds weathered 2020 turmoil
      Daniel McHugh
      Aviva Investors promotes from within for real assets CIO
      Marc Rowan
      More alts managers seek expansion to retail market
    • Kieran Mistry
      Hymans Robertson picks head for new non-traditional risk transfer unit
      Troy Saharic
      NEPC brings on director of new business development
      Bill Foley
      Foley-backed SPAC agrees to $7.3 billion deal with Alight
      Jason Schwarz, chief operating officer of Wilshire,
      New owners have big plans for future of Wilshire
    • OMERS CEO Blake Hutcheson
      OMERS records worst loss since 2008 on bad COVID-19 bets
      Mitchells & Butlers turns off tap on pension contributions until April
      Jerome Powell, chairman of the Federal Reserve, adjusts his glasses during a Senate Banking, Housing and Urban Affairs Committee hearing in Washington on Sept 24, 2020.
      Powell says Fed will hold steady during economic recovery
      Institutional investors mobilize for equitable global COVID-19 response
    • Database’s debut focuses on public-sector DC plans
      DC plan sponsors differ on need for annuities – survey
      Biden’s retirement idea getting the cold shoulder
      Few participants tapped savings to weather pandemic – Vanguard
    • Emissions from a smokestack in Poland
      Asset managers facing more scrutiny on ESG issues – report
      Boris Johnson, U.K. prime minister, hosts the U.N. Security Council's virtual meeting on climate change risks in London on Feb. 23, 2021
      Progress in fighting climate change falls short – U.N.
      Justin Trudeau, Canada's prime minister, smiles during a virtual joint news conference with U.S. President Joe Biden in Ottawa on Feb. 23, 2021
      U.S. joins forces with Canada on climate change
      Signage is displayed at Harvard University Health Services in Cambridge, Mass., on April 20, 2020
      Harvard endowment’s fossil-fuel investments drop to 2% of assets
    • Spirit winners
      Prudential honors young people who are helping out
      2 U.K. pension execs take on ESG investing in new podcast
      Donation illustration
      Jefferies will use trading commissions to do good
      Michael Arougheti
      SPACs ride wave as latest investment darling
    • Robert 'Rob' Shafir listens during a Senate Permanent Subcommittee on Investigations hearing in Washington on Feb. 26, 2014
      Sculptor hedge fund hits sixth straight year of outflows
      The WallStreetBets forum on the Reddit Inc. website on a laptop computer and the GameStop logo on a smartphone in an arranged photo.
      GameStop frenzy has hedge fund managers rethinking next moves
      Gabe Plotkin, chief investment officer and portfolio manager of Melvin Capital Management, speaks during the Sohn Investment Conference in New York on May 6, 2019
      Citadel, Point72 back Melvin with $2.75 billion after losses
      Shanghai skyline
      Global hedge funds struggle even in a more open China market
    • Illinois Teachers chalks up $1.3 billion in investments, commitments
      Emissions from a smokestack in Poland
      Asset managers facing more scrutiny on ESG issues – report
      Indiana chooses PIMCO for emerging markets debt
      Boris Johnson, U.K. prime minister, hosts the U.N. Security Council's virtual meeting on climate change risks in London on Feb. 23, 2021
      Progress in fighting climate change falls short – U.N.
    • Margaret Anadu
      GSAM chooses global head of sustainability and impact
      Signage for AMP Ltd. adorns the top of a building in the Docklands area of Melbourne on May 10, 2018
      Ares, AMP eye joint venture
      Thasunda Brown Duckett
      TIAA appoints Thasunda Duckett as president and CEO
      Brightwood Capital adds senior investment professional
    • Thomas Spencer
      Oklahoma Teachers chief Tom Spencer to retire
      Swedish flags fly from a tourist souvenir shop in Gamla Stan in Stockholm on March 26, 2020
      Sweden’s AP1 gains 9.7% in 2020
      CDPQ returns 7.7% in 2020
      Cleveland-Cliffs to pour $202 million into pension plans in 2021
    • Thomas Spencer
      Oklahoma Teachers chief Tom Spencer to retire
      Margaret Anadu
      GSAM chooses global head of sustainability and impact
      Doug Heron
      Lothian Pension Fund to lose CEO this year
      Correction: PGIM Real Estate
    • Carlyle secures $4.1 billion ESG-related credit facility
      Hamilton Lane raises $3.9 billion for fifth secondary fund
      PSG closes first Europe-focused fund at $1.5 billion
      Kohlberg closes latest private equity fund at $3.4 billion
    • Sebastiano Ferrante and Jocelyn de Verdelon
      PGIM Real Estate turns to staff to fill new roles
      European managers key in on specialist strategies
      Ingrid Jacobs
      Jones Lang LaSalle brings on head of diversity and inclusion
      EQT inks deal to buy real estate manager
    • Neal and Brady
      Retirement security could be only issue both sides accept
      Retirement cartoon
      Hopes rising for retirement readiness in 2021
      Shawn O'Brien
      Annuities coming to target-date funds, but not right away
      David Ireland
      Sponsors returning to questions about in-plan annuities
    • Charging Bull, sometimes referred to as the Wall Street Bull or the Bowling Green Bull, a bronze sculpture that stands on Broadway just north of Bowling Green in the Financial District of New York City
      Top-performing managers Q4 2020
      P&I 1,000 largest retirement plans: 2021
      Retirement in emerging markets
      Outlook 2021
    • U.S. still a key market for investors
      Collected coverage of P&I's 2020 WorldPensionSummit
      Pedestrians pass a large advertisement on the Arndale Center shopping mall reading 'Act now to avoid a local lockdown' in Manchester, England
      COVID-19 puts new opportunities and risks on the agenda - WPS panelists
      Screens display stock price information over the trading floor of the NYSE Euronext exchange in Paris
      Private assets will continue to grow in portfolios – WPS panelists
  • Data
    • Research Center
    • Searches & Hires Database
    • Searches & Hires News
    • RFPs
    • Charts / Infographics
    • Sponsored Research
    • Trackers
    • Q2 2020 searches and hires overview report
      Q2 2020 money manager M&A activity summary
      Q2 2020 legal overview report
      Q1 2020 searches and hires overview report
    • Illinois Teachers chalks up $1.3 billion in investments, commitments
      Indiana chooses PIMCO for emerging markets debt
      New York Deferred Comp plan re-ups with Goldman as stable value manager
      Ann Arbor Employees taps Artisan Partners for international equities
    • Illinois Teachers chalks up $1.3 billion in investments, commitments
      Indiana chooses PIMCO for emerging markets debt
      New York Deferred Comp plan re-ups with Goldman as stable value manager
      Ann Arbor Employees taps Artisan Partners for international equities
    • Emerging Market Equity Manager Services
      Securitized Credit Manager Search
      Private Placements Asset Manager Search
      Actuarial Consultant Search
    • Taiwan Semiconductor’s No. 1 in the emerging markets book
      U.S. fixed-income returns post another positive year
      Nasdaq delivers an impressive year
      U.S. dollar's recent decline continues
    • Institutional Investors: Shared Expectations, Divergent Paths
      Global Investor Study 2016
      Workplace Financial Wellness
    • U.S. Endowment Returns Tracker
      Pension Fund Returns Tracker
      Earnings Tracker
      Corporate Pension Contribution Tracker
  • Insights
    • Opinion
    • White Papers
    • Industry Voices
    • Letters to the Editor
    • Partner Content
    • Publisher's Update
    • Tesla cartoon
      Don’t confuse wealth creation with retirement saving
      Top 1000 cartoon
      Top 1,000 retirement plans weather storm just fine
      Infrastructure cartoon
      You must go big on infrastructure, Mr. President
      Retirement cartoon
      Hopes rising for retirement readiness in 2021
    • Shifting DC Times – Winter 2021
      Bond ETFs show maturity during Covid market mayhem
      Pension Consolidation: Optimizing Scale and Maximizing Efficiency
      China is embarking on a new stage of growth
    • David Blitzstein
      Commentary: Without a national retirement policy, Americans face a future of pension crises
      Lawrence Cunningham
      Commentary: Gensler should keep Clayton’s pragmatic proxy adviser rules
      My-Linh Ngo
      Commentary: Pension funds and the role of the debt market in the fight against climate change
      Bill Peressini
      Commentary: Carbon’s elemental role in the future of impact investing
    • Writer using a typewriter
      OCIO industry needs to adopt GIPS
      Writer or journalist workplace. stock illustration
      Even as it assails China, Trump administration emulates it
      Skeptical of Main Street support for proxy adviser proposal
      Focus on manager diversity pushes asset owners’ to walk the talk
    • P&I Content Solutions
      How will gold react?
      To people shaking hands
      P&I Content Solutions
      Lessons From 2020: Today’s OCIO Model Passes a Major Test of Governance
      Sponsored Content By MassMutual
      Leveraging Data to Manage Risk
      Sponsored Content By iShares
      ETFs are becoming a cornerstone of insurance equity portfolios
    • Help us help you by supporting quality journalism
      You Must Believe in Spring
      Everything Must Change
      Tomatoes & Investments
  • Multimedia
    • Videos
    • Webinars
    • Polls
    • Slideshows
    • Charts / Infographics
    • watch video
      0:45
      Private funds weathered 2020 turmoil
      watch video
      0:59
      Secure choice and other retirement plans at a state level
      watch video
      3:33
      P&I 1,000 by the numbers 2021
      watch video
      1:33
      A look at hiring activity in 2020
    • Emerging Markets: Expanding Investors’ View
      2021: A Fixed Income Odyssey
      Technology is the New Oil: The Changing Nature of Emerging Markets
      Powering the Change: The power of diversity and inclusion
    • POLL: Working after the pandemic
      POLL: The year ahead for the 1,000 largest U.S. retirement funds
      POLL: The Biden administration’s economic plans
      POLL: Retirement issues in 2021
    • view gallery
      9 photos
      Coronavirus and the markets
      view gallery
      22 photos
      The 1,000 largest retirement funds: 2020
      view gallery
      10 photos
      Outlook 2020
      view gallery
      10 photos
      2019 as seen through the eyes of Roger
    • By the Numbers for February 2021
      Top Performing Managers of Domestic Blend Equity, 4th Quarter 2020
      Top Performing Managers of Domestic Intermediate-Duration Fixed Income, 4th Quarter 2020
      Top Performing Managers of Domestic Taxable Bond, 4th Quarter 2020
  • Events
    • Conferences
    • Webinars
    • Defined Contribution Spring Virtual Series
      DC Investment Lineup Virtual Series
      ESG Investing Virtual Series
      Private Markets Virtual Series
    • Emerging Markets: Expanding Investors’ View
      2021: A Fixed Income Odyssey
      Technology is the New Oil: The Changing Nature of Emerging Markets
      Powering the Change: The power of diversity and inclusion
  • Careers
  • Research Center
MENU
Breadcrumb
  1. Home
  2. MONEY MANAGEMENT
March 20, 2017 01:00 AM

Machine learning will transform investment management

David Andre and Conrad Gann
  • Tweet
  • Share
  • Share
  • Email
  • More
    Reprints Print

    “Prediction is very difficult, especially if it's about the future.”

    — Niels Bohr, Nobel Prize-winning physicist

    Watch out, investment professionals — machine learning is coming to a company like yours. This subset of artificial intelligence isn't just for programming self-driving cars or sorting cat pictures. It's entering the investment management space, and its disruptive potential is only beginning to emerge.

    From Siri and Alexa to Amazon and IBM's Watson, computer programs driven by artificial intelligence draw on massive amounts of data to solve previously intractable problems. Machine learning gives computers the additional ability to learn without being explicitly programmed. This type of AI enables computers to change — to learn — when exposed to new data.

    The technology behind machine learning is being propelled by major algorithmic innovations that allow machines to synthesize extremely large data sets and reveal patterns, trends and associations that are relevant to prediction problems. And the increasing ubiquity of inexpensive parallel computation is making this technology accessible to even lean startups.

    The technology already has transformed many industries, from the medical to the automotive. In addition, machine learning is widely seen as a leading driver of revenue at Google, Facebook and Amazon. However, its adoption in investment management so far has been limited. With the exception of a few leading hedge funds, the industry has failed to recognize machine learning's potential to drive investment decisions.

    Algorithms that continuously improve

    ML automates the discovery of predictive algorithms that are able to continuously improve as they get access to more data. Recently, the focus has been on automating many of the tasks traditionally performed by data scientists, including data cleaning, model selection, data clustering, automatic feature generation and dimensionality reduction.

    One technique, deep learning, has been responsible for many recent breakthroughs, including learning to play the game of Go well enough to beat the world's third-ranked player. Deep learning is enabling image recognition that is on par with human abilities and is significantly improving speech recognition and language translation; it is also permitting better story and ad targeting at places like Google and Facebook. Part of what makes deep learning so powerful is that it can organize and aggregate large unlabeled data sets into abstracted forms, which are more useful for prediction. The results have been stunning, both in speed and accuracy.

    What does this mean for investment management?

    We believe that machine learning will transform the way investment strategies are administered by all types of managers. Even the most fundamental, non-quantitative managers will be generating ideas from data that originally was sourced and synthesized via ML. For example, deep learning's ability to create structured data could be used to extract topic and sentiment from text sources such as earnings calls, SEC filings and social media; or for the analysis of satellite imagery for parking lot or crop data; or to evaluate location data from mobile phones.

    While quant managers will certainly use these new data sources, they will also be able to use machine learning to conquer the classic hazard of overfitting. The problem with overfitting lies in the temptation for investment committees, or their portfolio managers, to believe they could have discovered a data-driven relationship before they really could have or to mistake spurious correlation for causation.

    Overfitting often starts when data scientists take their favorite methodology, set up a number of input features and put in place the parameters of their method and a utility function. Then they run their algorithm on a part of their data (the training set), and look at results on another part of their data (the hold-out set). When invariably, things don't work as predicted, the researchers will tweak their parameters, or the features of their data, or the algorithm being used. Over time, the results are overfitted, as the value of the hold-out set becomes contaminated with each new test.

    A solution to overfitting

    With machine learning, we can minimize overfitting by restricting the role of the human to setting the overall investment framework. This framework will include the stock universe, trading frequency, performance benchmarks, data sources for signals and risk constraints. We leave the discovery of the specific formulation of the investment strategy to the system.

    The framework will also specify the types of ML techniques that the machine will have access to as it discovers new strategies and decides which ones to trade. Essentially, the role of the quant will move to a higher-level function. The more routine steps of testing, scoring and tuning different structures will be handled by the machine, which will iterate through history in much the same way as humans do in real time (i.e. without knowing about the future).

    Advances in machine learning will allow further automation of tasks, including feature discovery, algorithm selection and even the optimization of trading code that implements a signal. With these newer methods, humans can spend their time creating frameworks and obtaining new data sets. Automated methods also reduce the number of quants needed to run a firm, which, given the high cost of salaries, is increasingly important as well.

    The tools that enable automated strategy discoveries will also enable customized solutions. This is because the criteria for a successful strategy can be specified upfront in the framework. For instance, one approach could search for a strategy with a specified maximum deviation from a classic index, such as U.S. small-cap value, with as much additional alpha as possible. This type of customization could lead to a new class of retail investment products.

    We believe machine learning will become increasingly important for asset management and that most firms will be utilizing either machine learning tools or data within five years. Human involvement will still be critical for risk management and framework selection, but increasingly the strategy innovation process will be automated.

    David Andre is CEO and director, and Conrad Gann is chief operating officer, at Cerebellum Capital, San Francisco. This content represents the views of the authors. It was submitted and edited under P&I guidelines, but is not a product of P&I's editorial team.

    Related Articles
    Data, analytics grow in importance amid slow markets — report
    Hedge fund industry divided on impact of technology – survey
    Stress testing a new normal for investors
    Robo-advisers aren't taking over ... yet
    AI going to head of the class
    BlackRock puts more of its future in tech
    Management firms gain big attention with upgrades
    State Street CEO sees custody 'arms race'
    AI? It's not sci-fi anymore
    WorldQuant University offering free master's
    AI key for third wave of hedge fund managers
    Glass box vs. black box
    Technology disruption now a pressing issue for investors
    Japan's GPIF selects Sony Computer Science Laboratories to study AI applications
    Recommended for You
    GSAM chooses global head of sustainability and impact
    GSAM chooses global head of sustainability and impact
    Ares, AMP eye joint venture
    Ares, AMP eye joint venture
    TIAA appoints Thasunda Duckett as president and CEO
    TIAA appoints Thasunda Duckett as president and CEO
    How will gold react?
    Sponsored Content: How will gold react?
    sponsored
    Events
     
     
    Sponsored
    White Papers
    Shifting DC Times - Winter 2021
    Bond ETFs show maturity during Covid market mayhem
    Pension Consolidation: Optimizing Scale and Maximizing Efficiency
    China is embarking on a new stage of growth
    GP-LED OPPORTUNITIES AT THE SMALLER END OF THE MARKET
    Gold Outlook 2021
    View More
    Sponsored Content
    Partner Content
    The Industrialization of ESG Investment
    For institutional investors, ETFs can make meeting liquidity needs easier
    Gold: the most effective commodity investment
    2021 Investment Outlook | Investing Beyond the Pandemic: A Reset for Portfolios
    Ten ways retirement plan professionals add value to plan sponsors
    Gold: an efficient hedge
    View More
    E-MAIL NEWSLETTERS

    Sign up and get the best of News delivered straight to your email inbox, free of charge. Choose your news – we will deliver.

    Subscribe Today

    Get access to the news, research and analysis of events affecting the retirement and institutional money management businesses from a worldwide network of reporters and editors.

    Subscribe
    Connect With Us
    • RSS
    • Twitter
    • Facebook
    • LinkedIn

    Our Mission

    To consistently deliver news, research and analysis to the executives who manage the flow of funds in the institutional investment market.

    pilogo-NEW
    About Us

    Main Office
    685 Third Avenue
    Tenth Floor
    New York, NY 10017-4036

    Chicago Office
    150 N. Michigan Ave.
    Chicago, IL 60601

    Contact Us

    Careers at Crain

    About Pensions & Investments

     

    Advertising
    • Media Kit
    • P&I Content Solutions
    • P&I Careers | Post a Job
    • Reprints & Permissions
    Resources
    • Subscribe
    • Newsletters
    • FAQ
    • P&I Research Center
    • Site map
    • Staff Directory
    Legal
    • Privacy Policy
    • Terms and Conditions
    • Privacy Request
    Pensions & Investments
    Copyright © 1996-2021. Crain Communications, Inc. All Rights Reserved.
    • NEWS
      • Asset owners and the coronavirus
      • Alternatives
      • Consultants
      • Coronavirus
      • Defined Contribution
      • ESG
      • Frontlines
      • Hedge Funds
      • Investing / Portfolio Strategies
      • Money Management
      • Pension Funds
      • People Moves
      • Private Equity
      • Real Estate
      • Searches & Hires News
      • SECURE Act
      • Special Reports
      • WorldPensionSummit
    • Data
      • Research Center
      • Searches & Hires Database
      • Searches & Hires News
      • RFPs
      • Charts / Infographics
      • Sponsored Research
      • Trackers
    • Insights
      • Opinion
      • White Papers
      • Industry Voices
      • Letters to the Editor
      • Partner Content
      • Publisher's Update
    • Multimedia
      • Videos
      • Webinars
      • Polls
      • Slideshows
      • Charts / Infographics
    • Events
      • Conferences
      • Webinars
    • Careers
    • Research Center