Commentary: It's cultural – why investment management has yet to fully embrace machine learning
Skip to main content
pilogo-NEW
Subscribe
  • Subscribe
  • My Account
  • login
  • NEWS
    • Asset owners and the coronavirus
    • Alternatives
    • Consultants
    • Coronavirus
    • Defined Contribution
    • ESG
    • Frontlines
    • Hedge Funds
    • Investing / Portfolio Strategies
    • Money Management
    • Pension Funds
    • People Moves
    • Private Equity
    • Real Estate
    • Searches & Hires News
    • SECURE Act
    • Special Reports
    • WorldPensionSummit
    • Ron Schmitz
      Pandemic drives faster transition for Virginia to private markets
      Mubadala Investment Co. logo
      Mubadala draws on portfolio in coronavirus fight
      T.J. Carlson
      Texas Muni reduces downside risk during pandemic, finding opportunities now
      Scott Davis
      ‘Triage plan’ at Indiana system helped stem losses
    • Coller Capital collects $9 billion with latest secondaries fund
      Directional signs respresenting types of traditional and alternative investments
      Setter: Alternative secondary deals drop 27.7% in 2020
      Kennedy Lewis raises $2.1 billion for latest opportunistic credit fund
      Emma Davies
      Octopus Ventures chooses co-CEO
    • Jason Schwarz, chief operating officer of Wilshire,
      New owners have big plans for future of Wilshire
      Amy Hsiang
      Meketa picks new public markets manager research director
      Will Martindale
      Cardano Group chooses group head of sustainability
      Meketa hires first chief marketing officer
    • Multiemployer pension plans could soon see relief
      Yellen calls for more COVID relief, retirement access
      A healthcare worker provides care for a COVID-19 patient in the intensive care unit at the Saint Joseph hospital in Marseille, France, on Nov. 20, 2020.
      World must act to strengthen against future pandemics – report
      New York State Common challenges Tyson’s dual-share stock structure
    • Kenneth J. Munro III
      Empower names new national sales director
      Fidelity cuts target-date asset threshold for lower fees
      DCIIA looks to spark engagement with plan sponsor institute
      Ascensus, Empower acquire Truist record-keeping business
    • Ontario Teachers commit to net zero emissions by 2050
      LaSalle Investment Management taps 2 for new ESG roles
      Sovereign credit ratings vulnerable to ESG risks — Moody’s
      JPMAM names head of investment stewardship, Asia ex-Japan
    • Blackstone holiday video
      Blackstone would like to show you how things are done around the office
      Galina Churkina
      Building research earns honor from Aquila Capital
      MacArthur Foundation invests in women’s safe housing fund
      CAIA’s expansion to online exams yields big results
    • Shanghai skyline
      Global hedge funds struggle even in a more open China market
      The Sun Hung Kai Properties Ltd. logo is displayed on the Sun Hung Kai Centre building in Hong Kong on Sept. 13, 2018
      SHK spins out East Point Asset Management
      Man holding a business card with Hedge Fund written on it
      Hedge funds chalk up decade’s best returns in 2020 – HFR
      New hedge fund launches surpass liquidations in third quarter
    • Famed value investor and co-founder of Boston-based GMO Jeremy Grantham
      Grantham warns of Biden stimulus further inflating epic bubble
      Jason Schwarz, chief operating officer of Wilshire,
      New owners have big plans for future of Wilshire
      Ontario Teachers commit to net zero emissions by 2050
    • Marques Benton
      Loomis Sayles chooses first chief diversity officer
      Standard Life Aberdeen CEO Stephen Bird
      Standard Life Aberdeen CEO: Some staff won’t get bonuses
      Nuveen sells holdings in sanctioned Chinese stocks
      Northern Trust to take $55 million charge for job cuts
    • The Great Seal of the State of New Mexico in the House of Representatives chamber within the New Mexico State Capitol in Santa Fe
      New Mexico PERA executive director taking new position
      ABP calls for clarity over funding ratio rules
      CalPERS CEO Marcie Frost
      CalPERS’ pick for new CIO expected soon
      Ohio Public Employees returns 11.35% in 2020
    • The Great Seal of the State of New Mexico in the House of Representatives chamber within the New Mexico State Capitol in Santa Fe
      New Mexico PERA executive director taking new position
      Marques Benton
      Loomis Sayles chooses first chief diversity officer
      Charles Wu
      State Super appoints chief investment officer
      Kenneth J. Munro III
      Empower names new national sales director
    • Pension funds continue private equity investing spree
      Big jump in private equity AUM expected over next 5 years
      Thoma Bravo takes in $22.8 billion for 3 funds
      Jason Thomas
      Data, technology become new prized possessions
    • Chiang Ling Ng
      Hines hires first head of Asia-Pacific real estate investments
      Brand new apartment building on sunny day in spring with blooming trees
      Real estate returns forecast to trend lower – report
      Ivanhoe Cambridge Inc. signage is displayed outside the company's office near Bay Street in Toronto on Aug. 29, 2011
      Ivanhoe Cambridge, PAG announce joint venture for Japan logistics investments
      Residential buildings in Hong Kong on Feb. 20, 2020
      KKR closes first Asia-Pacific real estate fund at $1.7 billion
    • Retirement cartoon
      Hopes rising for retirement readiness in 2021
      Neal and Brady
      Retirement security could be only issue both sides accept
      Shawn O'Brien
      Annuities coming to target-date funds, but not right away
      David Ireland
      Sponsors returning to questions about in-plan annuities
    • Outlook 2021
      The top 10 stories of 2020
      The best places to work in money management
      Investment consultants
    • U.S. still a key market for investors
      Collected coverage of P&I's 2020 WorldPensionSummit
      Pedestrians pass a large advertisement on the Arndale Center shopping mall reading 'Act now to avoid a local lockdown' in Manchester, England
      COVID-19 puts new opportunities and risks on the agenda - WPS panelists
      Screens display stock price information over the trading floor of the NYSE Euronext exchange in Paris
      Private assets will continue to grow in portfolios – WPS panelists
  • Data
    • Research Center
    • Searches & Hires Database
    • Searches & Hires News
    • RFPs
    • Charts / Infographics
    • Sponsored Research
    • Trackers
    • Q2 2020 searches and hires overview report
      Q2 2020 money manager M&A activity summary
      Q2 2020 legal overview report
      Q1 2020 searches and hires overview report
    • Houston Firefighters puts $180 million into 3 funds
      LACERA allocates up to $442 million with 6 managers
      BBC Pension Scheme re-signs HSBC as global custodian
      Stanislaus County Employees earmarks $20 million to buyout fund
    • Houston Firefighters puts $180 million into 3 funds
      LACERA allocates up to $442 million with 6 managers
      BBC Pension Scheme re-signs HSBC as global custodian
      Stanislaus County Employees earmarks $20 million to buyout fund
    • International Small Cap Manager Services
      Financial Expertise
      Passive Index Manager Services
      Emerging Markets Equity Investment Management Services
    • Taiwan Semiconductor’s No. 1 in the emerging markets book
      U.S. fixed-income returns post another positive year
      Nasdaq delivers an impressive year
      U.S. dollar's recent decline continues
    • Institutional Investors: Shared Expectations, Divergent Paths
      Global Investor Study 2016
      Workplace Financial Wellness
    • U.S. Endowment Returns Tracker
      Pension Fund Returns Tracker
      Earnings Tracker
      Corporate Pension Contribution Tracker
  • Insights
    • Opinion
    • White Papers
    • Industry Voices
    • Letters to the Editor
    • Partner Content
    • Publisher's Update
    • Retirement cartoon
      Hopes rising for retirement readiness in 2021
      view gallery
      25 photos
      2020 in editorial Cartoons
      view gallery
      25 photos
      Cartoons depict a year like no other
      Consultants cartoon
      Seeking an investment consultant? Caveat emptor
    • GP-LED OPPORTUNITIES AT THE SMALLER END OF THE MARKET
      Gold Outlook 2021
      Bond ETFs show maturity during Covid market mayhem
      2021 Outlook: A rousing recovery
    • Charles E.F. MIllard
      Commentary: It’s time to make 401(k) plans into real pension plans
      Michael McNally
      Commentary: New ‘investment-plus’ test poses risks to private equity investors
      Adam Waterous
      Commentary: Institutions urged to act now on opportunities created by current global oil disruption
      Ron Lagnado
      Commentary: Straw man critiques don’t hold up in face of real world success
    • Writer using a typewriter
      OCIO industry needs to adopt GIPS
      Writer or journalist workplace. stock illustration
      Even as it assails China, Trump administration emulates it
      Skeptical of Main Street support for proxy adviser proposal
      Focus on manager diversity pushes asset owners’ to walk the talk
    • Sponsored Content By iShares
      ETFs are becoming a cornerstone of insurance equity portfolios
      Sponsored Content By Aberdeen Standard Investments
      Taking a passive approach to the hedge-fund universe
      Sponsored Content By World Gold Council
      Gold: the most effective commodity investment
      Sponsored Content By Moody's Analytics
      The Industrialization of ESG Investment
    • Help us help you by supporting quality journalism
      You Must Believe in Spring
      Everything Must Change
      Tomatoes & Investments
  • Multimedia
    • Videos
    • Webinars
    • Polls
    • Slideshows
    • Charts / Infographics
    • watch video
      1:24
      U.S. stocks were 2020’s comeback kid
      watch video
      1:23
      Outlook 2021
      watch video
      1:52
      Buy gold's pullback?
      Coronavirus and the S&P 500: 2020
    • Getting Back to Normal: How to Creatively Manage Fixed Income Portfolios in a Rising Rate Environment
      Lessons From 2020: OCIO Model Passes Major Test of Governance
      What might a Biden DOL and SEC mean for retirement plans?
      Staying on target with target-date funds
    • POLL: Retirement issues in 2021
      POLL: Money managers' priority in Asia-Pacific region
      POLL: Retirement issues in the presidential election
      POLL: The S&P 500 in the third quarter
    • view gallery
      9 photos
      Coronavirus and the markets
      view gallery
      22 photos
      The 1,000 largest retirement funds: 2020
      view gallery
      10 photos
      Outlook 2020
      view gallery
      10 photos
      2019 as seen through the eyes of Roger
    • Taiwan Semiconductor’s No. 1 in the emerging markets book
      Graphic: U.S. stocks were 2020's comeback kid
      U.S. fixed-income returns post another positive year
  • Events
    • Conferences
    • Webinars
    • Defined Contribution Spring Virtual Series
      DC Investment Lineup Virtual Series
      ESG Investing Virtual Series
      Private Markets Virtual Series
    • Getting Back to Normal: How to Creatively Manage Fixed Income Portfolios in a Rising Rate Environment
      Lessons From 2020: OCIO Model Passes Major Test of Governance
      What might a Biden DOL and SEC mean for retirement plans?
      Staying on target with target-date funds
  • Careers
  • Research Center
MENU
Breadcrumb
  1. Home
  2. INDUSTRY VOICES
April 26, 2018 01:00 AM

Commentary: It's cultural – why investment management has yet to fully embrace machine learning

David E. Kuenzi
  • Tweet
  • Share
  • Share
  • Email
  • More
    Reprints Print

    There is a lot of talk these days in financial circles about artificial intelligence and machine learning. Most of the discussion has focused on how powerful these approaches are and how they may transform the industry in the next five years.

    We have seen that machine learning offers potentially powerful solutions to problems in many domains across the economy. While machine learning might transform the investment management industry, the path by which we get there is uncertain. As is often the case with potentially disruptive technologies, the obstacles seem as much cultural as technical. In a word, the issue is transparency.

    Investors require transparency in how and why investment decisions are made. To the extent that machine learning is used to make investment decisions (rather than as an ancillary element of the investment process), transparency might be drastically reduced. Here is the rub: To obtain potentially better investment results driven by a full-blown machine-learning model, investors might need to accept less transparency regarding why a model did what it did. That cultural shift will take time.

    The primary branch of ML is call supervised machine learning, and is used to predict something — e.g., whether an email is spam or not. In this case, the ML algorithm learns the key characteristics of spam (words used, formatting, etc.) by looking at perhaps hundreds of thousands or even millions of emails that are labeled as either spam or not spam. It can then predict fairly accurately which emails to filter out.

    In the world of investing, an oversimplified example of the use of supervised ML might be the case of predicting whether stocks will go up or down the following day. A data scientist would need to make many critical model construction decisions, including the exact algorithm to use in the ML framework (something simple, such as logistic regression, or something more involved, such as a random forest), and the appropriate data set. The data would include many columns of time series market data (such as a variety of price momentum and valuation measures) where each row of data (or time period) is labeled something like, "Stocks went up next day" or "Stocks went down next day." The model is then trained on this historical data to determine characteristics of periods associated with future rising or falling stock prices. The model (the machine) is continually trying to learn — to figure out the best way to weight and process the many data items in order to best predict the direction of the market.

    The issue is that, when a model is implemented and predicts that "stocks will go up tomorrow," it might not be clear why the model is making this particular recommendation. How this huge mass of data worked its way through very complex algorithms to come up with the "buy" answer is not always obvious — not even to the data scientist who created the model. By contrast, with a more traditional quantitative approach, the reason a particular model has put on a particular trade is often more clear. In a trend-following strategy, for example, if an investor asks the manager why the strategy was significantly long equities last February, it is easy to point to the strong positive trend in equities over the prior 12 months to explain the long positioning. Similar intuitions can be made quite easily with regard to carry, curve, value and other traditional risk premium strategies captured through quantitative approaches. But again, this will not necessarily be the case with a large-scale machine learning approach.

    The real issue comes when there is sustained underperformance. When the reason a model put on money-losing positions is not obvious (i.e., why it was long bunds, short Japanese yen, or long the FTSE 100 index), investors begin to raise larger questions, and perhaps rightly so. Is the model broken? How do you know it's not broken? Did you overfit the model?

    It is perhaps at this point that ML fails — not because it doesn't work, but because investors become more reticent with their investment dollars in the face of this lack of transparency.

    The question as to whether there is something inherently wrong with the model is an important one. Given the power of ML methods, it is indeed possible that a given model has been overfit. Overfitting occurs when the model incorporates random and noisy characteristics of the training data and treats them as though they actually provide good, predictive information. Generally, the larger the number of data fields that go into the model and the more detailed the algorithm, the higher the probability the algorithm will identify a "pattern" that is really just random noise.

    Cognizant of these modeling concerns, researchers have created a host of methods for limiting the propensity of these models to overfit data, including being very thoughtful about which data to start with. Similarly, there is a greater awareness of the need for data scientists who have strong financial backgrounds and can work collaboratively with those who are more pure data scientists. All the same, when a model underperforms, potential overfitting can be a legitimate concern, and one that can be difficult to ascertain, even using state-of-the-art techniques.

    Having focused on the most intensive use of machine learning in investment management above, it is worth noting that ML also can be used indirectly. A quantitative manager might use it in order to better select model parameters. If, for example, a model uses an estimate of a stock's volatility, one might use ML for ferreting out the best combination of a multitude of methods for calculating volatility. This can be a very powerful use of machine learning in the current environment, as it is one that generally does not compromise the transparency of the investment process.

    ML can also be used within a discretionary investment process. A value manager, for example, might use it to screen the universe of stocks for those with the best prospects based on valuation. The data set could include a very large number of traditional and non-traditional valuation measures. Stocks that the model identifies can then be subject to a deeper bottom-up analysis before any final buy or sell determination. Nevertheless, we might run into similar cultural issues in this use of ML. The lack of transparency afforded by these models may produce results that are inconsistent with the discretionary manager's intuition and thereby induce questions as to whether the stock screening process is broken.

    In short, the main advantage and the main drawback of machine learning are one and the same: these algorithms care less about the intuition behind the model and more about the power to predict. This means that, if done well, ML may produce better results than more traditional approaches, but explanations for the outperformance or underperformance of a particular model are more difficult to produce.

    As machine learning is used more frequently in investment management, investors may increasingly need to rely on due diligence regarding the model construction and data science process, and they might also need to accept a less than transparent explanation and perhaps unintuitive reason for specific periods of outperformance or underperformance. This is effectively the cultural shift that must take place with regard to investor acceptance of these strategies before machine learning can take a more central role in investment management.

    David E. Kuenzi is senior research scientist and portfolio manager at AlphaSimplex Group LLC, Cambridge, Mass. This content represents the views of the author. It was submitted and edited under P&I guidelines but is not a product of P&I's editorial team.

    Related Articles
    Machine learning, AI pose host of potential risks, benefits in financial servic…
    Parametric adopting AI, machine learning for its back office
    Capabilities key to firms' future success
    Broad adoption will mean better beta for all investors
    Two Sigma adds Google scientist for AI expansion
    Recommended for You
    Commentary: It’s time to make 401(k) plans into real pension plans
    Commentary: It’s time to make 401(k) plans into real pension plans
    Commentary: New ‘investment-plus’ test poses risks to private equity investors
    Commentary: New ‘investment-plus’ test poses risks to private equity investors
    Commentary: Institutions urged to act now on opportunities created by current global oil disruption
    Commentary: Institutions urged to act now on opportunities created by current global oil disruption
    Research for Institutional Money Management
    Sponsored Content: Research for Institutional Money Management
    sponsored
    Events
     
     
    Sponsored
    White Papers
    GP-LED OPPORTUNITIES AT THE SMALLER END OF THE MARKET
    Gold Outlook 2021
    Bond ETFs show maturity during Covid market mayhem
    Global gold-backed ETFs: A popular gateway to the gold market
    2021 Outlook: A rousing recovery
    Climate change and emerging markets after Covid-19
    View More
    Sponsored Content
    Partner Content
    The Industrialization of ESG Investment
    For institutional investors, ETFs can make meeting liquidity needs easier
    Gold: the most effective commodity investment
    2021 Investment Outlook | Investing Beyond the Pandemic: A Reset for Portfolios
    Ten ways retirement plan professionals add value to plan sponsors
    Gold: an efficient hedge
    View More
    E-MAIL NEWSLETTERS

    Sign up and get the best of News delivered straight to your email inbox, free of charge. Choose your news – we will deliver.

    Subscribe Today

    Get access to the news, research and analysis of events affecting the retirement and institutional money management businesses from a worldwide network of reporters and editors.

    Subscribe
    Connect With Us
    • RSS
    • Twitter
    • Facebook
    • LinkedIn

    Our Mission

    To consistently deliver news, research and analysis to the executives who manage the flow of funds in the institutional investment market.

    pilogo-NEW
    About Us

    Main Office
    685 Third Avenue
    Tenth Floor
    New York, NY 10017-4036

    Chicago Office
    150 N. Michigan Ave.
    Chicago, IL 60601

    Contact Us

    Careers at Crain

    About Pensions & Investments

     

    Advertising
    • Media Kit
    • P&I Content Solutions
    • P&I Careers | Post a Job
    • Reprints & Permissions
    Resources
    • Subscribe
    • Newsletters
    • FAQ
    • P&I Research Center
    • Site map
    • Staff Directory
    Legal
    • Privacy Policy
    • Terms and Conditions
    • Privacy Request
    Pensions & Investments
    Copyright © 1996-2021. Crain Communications, Inc. All Rights Reserved.
    • NEWS
      • Asset owners and the coronavirus
      • Alternatives
      • Consultants
      • Coronavirus
      • Defined Contribution
      • ESG
      • Frontlines
      • Hedge Funds
      • Investing / Portfolio Strategies
      • Money Management
      • Pension Funds
      • People Moves
      • Private Equity
      • Real Estate
      • Searches & Hires News
      • SECURE Act
      • Special Reports
      • WorldPensionSummit
    • Data
      • Research Center
      • Searches & Hires Database
      • Searches & Hires News
      • RFPs
      • Charts / Infographics
      • Sponsored Research
      • Trackers
    • Insights
      • Opinion
      • White Papers
      • Industry Voices
      • Letters to the Editor
      • Partner Content
      • Publisher's Update
    • Multimedia
      • Videos
      • Webinars
      • Polls
      • Slideshows
      • Charts / Infographics
    • Events
      • Conferences
      • Webinars
    • Careers
    • Research Center