Machine learning will transform investment management
Skip to main content
pilogo-NEW
Subscribe
  • Subscribe
  • My Account
  • login
  • NEWS
    • Asset owners and the coronavirus
    • Alternatives
    • Consultants
    • Coronavirus
    • Defined Contribution
    • ESG
    • Frontlines
    • Hedge Funds
    • Investing / Portfolio Strategies
    • Money Management
    • Pension Funds
    • People Moves
    • Private Equity
    • Real Estate
    • Searches & Hires News
    • SECURE Act
    • Special Reports
    • WorldPensionSummit
    • Ron Schmitz
      Pandemic drives faster transition for Virginia to private markets
      Mubadala Investment Co. logo
      Mubadala draws on portfolio in coronavirus fight
      T.J. Carlson
      Texas Muni reduces downside risk during pandemic, finding opportunities now
      Scott Davis
      ‘Triage plan’ at Indiana system helped stem losses
    • KKR lifts out 3 to focus on clean energy infrastructure
      Richard Johnson
      Appian Capital Advisory adds global investor relations head
      Alternative investment funds faced liquidity squeezes in COVID-19 crisis and 2019
      CI Financial launches global real estate, infrastructure joint venture
    • Callan brings on 2 executives
      Hub International agrees to buy Plan Sponsor Consultants
      Aon names public markets solution leader
      Deloitte to acquire Sydney-based consulting firm Rice Warner
    • Alternative investment funds faced liquidity squeezes in COVID-19 crisis and 2019
      Jerome Powell, chairman of the Federal Reserve, listens during a Senate Banking Committee hearing in Washington on Dec. 1, 2020
      Fed saw some time before taper conditions met – minutes
      International Monetary Fund and World Bank spring meetings signage at the IMF headquarters in Washington
      IMF upgrades global growth forecast, warns of diverging recoveries
      A cashier standing behind a protective barrier assists a customer at a Peter Harris Clothes store in Latham, N.Y.
      Job growth tops 900,000 in March as hiring broadens
    • Pentegra launches pooled employer plan
      Teresa Hassara
      Ascensus taps MassMutual alum as new FuturePlan president
      Economic Group Pension Services scoops up third-party administrator
      OregonSaves gathers $100 million in assets
    • Shoppers wear protective masks while visiting an Apple Inc. store at George Street in Sydney, Australia, on June 24, 2020.
      Apple backs SEC mandate on climate disclosure
      Emissions rise from the Kentucky Utilities Co. Ghent generating station in Ghent, Ky.
      Investors, businesses call for ambitious emissions goals
      Signage for Temasek Holdings Pte. is displayed during a news conference following the company's annual review in Singapore
      Temasek, BlackRock partner to launch carbon-cutting funds
      New York state pension fund limits oil sands investments
    • Ken Griffin
      Ken Griffin donates $5 million to give Miami students internet
      New book culls institutional wisdom from podcast series
      Fearless Girl
      SSGA’s Fearless Girl statue now shattering glass ceiling
      Tangen video
      Norges chief dons chef’s hat to boost employees’ spirits
    • Hedge funds post best first-quarter return since 2000
      Jason Kephart
      Managers see good times ahead in 2021
      Jev Mehmet, CEO of Brevan Howard's Coremont unit
      Brevan Howard runs $50 billion unit like BlackRock’s Aladdin
      A sign outside a Credit Suisse Group bank branch in Murten, Switzerland
      Credit Suisse, Nomura slump as banks tally Archegos damage
    • Mirova adds proxy voting and engagement leader
      S&P Global holds fast on New Jersey’s long-term debt rating
      New York University revamps options for 5 DC plans
    • Mirova adds proxy voting and engagement leader
      Erick Bronner
      Palladium Equity Partners picks new head of fundraising and investor relations
      The Euro sculpture illuminated outside the Eurotower, the former headquarters of the European Central Bank in Frankfurt on Dec. 15, 2020
      European manager AUM rises to record $12.7 trillion in 2020
      Lydia Wu
      Barings chooses head of Greater China distribution
    • Kansas City Employees adopts global strategy with small-cap swing
      Michael C. Viteri
      Arizona appoints new CIO
      A £10 sterling bank note with a pound coin and a ballpoint pen, with focus on the word 'pension.'
      U.K. defined benefit plans’ surplus surges in March
      Columbia University professor Takatoshi Ito
      GPIF treads water as ESG picks up pace
    • Mirova adds proxy voting and engagement leader
      Erick Bronner
      Palladium Equity Partners picks new head of fundraising and investor relations
      Callan brings on 2 executives
      Michael C. Viteri
      Arizona appoints new CIO
    • Bills of euro, dollar and pound currencies, among others
      Ardian closes latest buyout fund at $8.8 billion
      Hand typing on stationary iPhone at an office reception desk
      Private equity’s taste for tech spurs $80 billion deal spree
      Vista Equity promotes 2 to leadership roles on 2 funds
      Azimut takes minority stake in HighPost
    • CalSTRS indutrial property
      Investors hungry for industrial properties
      Tim Wang
      GLP names co-president of logistics, industrial real estate for China
      Frank Forster
      StepStone Real Estate adds managing director for Europe
      Christine Iacoucci
      BentallGreenOak promotes from within to fill Canadian CIO role
    • Andy Schreiner
      New PEPs targeting firms without retirement plans
      Jackie Walorski
      Contribution catch-up for caregivers gaining favor
      Retirement cartoon
      Hopes rising for retirement readiness in 2021
      Neal and Brady
      Retirement security could be only issue both sides accept
    • Corporate pension contributions
      Eddy Awards 2021
      COVID-19: One year in
      Charging Bull, sometimes referred to as the Wall Street Bull or the Bowling Green Bull, a bronze sculpture that stands on Broadway just north of Bowling Green in the Financial District of New York City
      Top-performing managers Q4 2020
    • U.S. still a key market for investors
      Collected coverage of P&I's 2020 WorldPensionSummit
      Pedestrians pass a large advertisement on the Arndale Center shopping mall reading 'Act now to avoid a local lockdown' in Manchester, England
      COVID-19 puts new opportunities and risks on the agenda - WPS panelists
      Screens display stock price information over the trading floor of the NYSE Euronext exchange in Paris
      Private assets will continue to grow in portfolios – WPS panelists
  • Data
    • Research Center
    • Searches & Hires Database
    • Searches & Hires News
    • RFPs
    • Charts / Infographics
    • Sponsored Research
    • Trackers
    • Q2 2020 searches and hires overview report
      Q2 2020 money manager M&A activity summary
      Q2 2020 legal overview report
      Q1 2020 searches and hires overview report
    • Insurer Phoenix chooses Barings for real estate debt allocation
      Texas Employees discloses $246 million in commitments
      New York University revamps options for 5 DC plans
      Riverside County adds BlackRock bond fund, drops Templeton fund
    • Insurer Phoenix chooses Barings for real estate debt allocation
      Texas Employees discloses $246 million in commitments
      New York University revamps options for 5 DC plans
      Riverside County adds BlackRock bond fund, drops Templeton fund
    • Passive Investment Management Services
      Active Extended Global Credit Manager Search
      Actuarial Services
      Investment Management Services
    • Managed account adoption stalls in 2020
      U.S. bonds have worst quarterly return since 1981
      Stable value retains edge over money market funds
      Taiwan Semiconductor’s No. 1 in the emerging markets book
    • Institutional Investors: Shared Expectations, Divergent Paths
      Global Investor Study 2016
      Workplace Financial Wellness
    • U.S. Endowment Returns Tracker
      Pension Fund Returns Tracker
      Earnings Tracker
      Corporate Pension Contribution Tracker
  • Insights
    • Opinion
    • White Papers
    • Industry Voices
    • Letters to the Editor
    • Partner Content
    • Publisher's Update
    • CalPERS cartoon
      Urgency underscores CalPERS' search for a CIO
      Multiemployer plans cartoon
      Money — but no fixes — for multiemployer plans
      Vaccination cartoon
      Rallying to meet the ongoing COVID-19 challenge
      Tesla cartoon
      Don’t confuse wealth creation with retirement saving
    • Bipsync Client Stories: RMS in Action at Pensions and Superannuation Funds
      COVID-19 Makes LP Portfolio Management More Important Than Ever
      China: the outlook is bright for longer-term investors
      Finding Differentiation in Securitized Assets
    • Greg Shea and Steven Kindred
      Commentary: The solution for yield-seeking allocators may be hiding in plain sight
      Jim Park
      Commentary: Asian Americans, Pacific Islanders face ‘bamboo ceiling’ in money management
      Jared Gross
      Commentary: Anchors and allocations – breaking the grip of 60/40
      Peter Marber
      Commentary: Is it time for an emerging markets rally?
    • Writer using a typewriter
      OCIO industry needs to adopt GIPS
      Writer or journalist workplace. stock illustration
      Even as it assails China, Trump administration emulates it
      Skeptical of Main Street support for proxy adviser proposal
      Focus on manager diversity pushes asset owners’ to walk the talk
    • P&I Content Solutions
      Research for Institutional Money Management
      P&I Content Solutions
      Top questions for institutional investors
      Sponsored Content By Newton Investment Management
      Growth and Innovation in Emerging Markets
      P&I Content Solutions
      In Challenging Markets, Systematic Global Macro Strategies Could Hold Opportunity
    • Help us help you by supporting quality journalism
      You Must Believe in Spring
      Everything Must Change
      Tomatoes & Investments
  • Multimedia
    • Videos
    • Webinars
    • Polls
    • Slideshows
    • Charts / Infographics
    • watch video
      1:23
      The passive fixed-income glut
      watch video
      1:38
      Is it time for DC plans to embrace private equity?
      watch video
      5:39
      The coronavirus pandemic: One year later
      watch video
      0:45
      Private funds weathered 2020 turmoil
    • Understanding the PEP Evolution
      Divest or engage?
      New Outlook on Income: A Framework for Evaluating DC Retirement Income Solutions
      Innovations in DC: Helping supercharge retirement outcomes
    • POLL: The Biden infrastructure plan
      POLL: Retirement income solutions
      POLL: Working after the pandemic
      POLL: The year ahead for the 1,000 largest U.S. retirement funds
    • view gallery
      9 photos
      Coronavirus and the markets
      view gallery
      22 photos
      The 1,000 largest retirement funds: 2020
      view gallery
      10 photos
      Outlook 2020
      view gallery
      10 photos
      2019 as seen through the eyes of Roger
    • Managed account adoption stalls in 2020
      U.S. bonds have worst quarterly return since 1981
  • Events
    • Conferences
    • Webinars
    • DC Investment Lineup Virtual Series
      ESG Investing Virtual Series
      Private Markets Virtual Series
    • Understanding the PEP Evolution
      Divest or engage?
      New Outlook on Income: A Framework for Evaluating DC Retirement Income Solutions
      Innovations in DC: Helping supercharge retirement outcomes
  • Careers
  • Research Center
MENU
Breadcrumb
  1. Home
  2. MONEY MANAGEMENT
March 20, 2017 01:00 AM

Machine learning will transform investment management

David Andre and Conrad Gann
  • Tweet
  • Share
  • Share
  • Email
  • More
    Reprints Print

    “Prediction is very difficult, especially if it's about the future.”

    — Niels Bohr, Nobel Prize-winning physicist

    Watch out, investment professionals — machine learning is coming to a company like yours. This subset of artificial intelligence isn't just for programming self-driving cars or sorting cat pictures. It's entering the investment management space, and its disruptive potential is only beginning to emerge.

    From Siri and Alexa to Amazon and IBM's Watson, computer programs driven by artificial intelligence draw on massive amounts of data to solve previously intractable problems. Machine learning gives computers the additional ability to learn without being explicitly programmed. This type of AI enables computers to change — to learn — when exposed to new data.

    The technology behind machine learning is being propelled by major algorithmic innovations that allow machines to synthesize extremely large data sets and reveal patterns, trends and associations that are relevant to prediction problems. And the increasing ubiquity of inexpensive parallel computation is making this technology accessible to even lean startups.

    The technology already has transformed many industries, from the medical to the automotive. In addition, machine learning is widely seen as a leading driver of revenue at Google, Facebook and Amazon. However, its adoption in investment management so far has been limited. With the exception of a few leading hedge funds, the industry has failed to recognize machine learning's potential to drive investment decisions.

    Algorithms that continuously improve

    ML automates the discovery of predictive algorithms that are able to continuously improve as they get access to more data. Recently, the focus has been on automating many of the tasks traditionally performed by data scientists, including data cleaning, model selection, data clustering, automatic feature generation and dimensionality reduction.

    One technique, deep learning, has been responsible for many recent breakthroughs, including learning to play the game of Go well enough to beat the world's third-ranked player. Deep learning is enabling image recognition that is on par with human abilities and is significantly improving speech recognition and language translation; it is also permitting better story and ad targeting at places like Google and Facebook. Part of what makes deep learning so powerful is that it can organize and aggregate large unlabeled data sets into abstracted forms, which are more useful for prediction. The results have been stunning, both in speed and accuracy.

    What does this mean for investment management?

    We believe that machine learning will transform the way investment strategies are administered by all types of managers. Even the most fundamental, non-quantitative managers will be generating ideas from data that originally was sourced and synthesized via ML. For example, deep learning's ability to create structured data could be used to extract topic and sentiment from text sources such as earnings calls, SEC filings and social media; or for the analysis of satellite imagery for parking lot or crop data; or to evaluate location data from mobile phones.

    While quant managers will certainly use these new data sources, they will also be able to use machine learning to conquer the classic hazard of overfitting. The problem with overfitting lies in the temptation for investment committees, or their portfolio managers, to believe they could have discovered a data-driven relationship before they really could have or to mistake spurious correlation for causation.

    Overfitting often starts when data scientists take their favorite methodology, set up a number of input features and put in place the parameters of their method and a utility function. Then they run their algorithm on a part of their data (the training set), and look at results on another part of their data (the hold-out set). When invariably, things don't work as predicted, the researchers will tweak their parameters, or the features of their data, or the algorithm being used. Over time, the results are overfitted, as the value of the hold-out set becomes contaminated with each new test.

    A solution to overfitting

    With machine learning, we can minimize overfitting by restricting the role of the human to setting the overall investment framework. This framework will include the stock universe, trading frequency, performance benchmarks, data sources for signals and risk constraints. We leave the discovery of the specific formulation of the investment strategy to the system.

    The framework will also specify the types of ML techniques that the machine will have access to as it discovers new strategies and decides which ones to trade. Essentially, the role of the quant will move to a higher-level function. The more routine steps of testing, scoring and tuning different structures will be handled by the machine, which will iterate through history in much the same way as humans do in real time (i.e. without knowing about the future).

    Advances in machine learning will allow further automation of tasks, including feature discovery, algorithm selection and even the optimization of trading code that implements a signal. With these newer methods, humans can spend their time creating frameworks and obtaining new data sets. Automated methods also reduce the number of quants needed to run a firm, which, given the high cost of salaries, is increasingly important as well.

    The tools that enable automated strategy discoveries will also enable customized solutions. This is because the criteria for a successful strategy can be specified upfront in the framework. For instance, one approach could search for a strategy with a specified maximum deviation from a classic index, such as U.S. small-cap value, with as much additional alpha as possible. This type of customization could lead to a new class of retail investment products.

    We believe machine learning will become increasingly important for asset management and that most firms will be utilizing either machine learning tools or data within five years. Human involvement will still be critical for risk management and framework selection, but increasingly the strategy innovation process will be automated.

    David Andre is CEO and director, and Conrad Gann is chief operating officer, at Cerebellum Capital, San Francisco. This content represents the views of the authors. It was submitted and edited under P&I guidelines, but is not a product of P&I's editorial team.

    Related Articles
    Data, analytics grow in importance amid slow markets — report
    Hedge fund industry divided on impact of technology – survey
    Stress testing a new normal for investors
    Robo-advisers aren't taking over ... yet
    AI going to head of the class
    BlackRock puts more of its future in tech
    Management firms gain big attention with upgrades
    State Street CEO sees custody 'arms race'
    AI? It's not sci-fi anymore
    WorldQuant University offering free master's
    AI key for third wave of hedge fund managers
    Glass box vs. black box
    Technology disruption now a pressing issue for investors
    Japan's GPIF selects Sony Computer Science Laboratories to study AI applications
    Recommended for You
    Mirova adds proxy voting and engagement leader
    Palladium Equity Partners picks new head of fundraising and investor relations
    Palladium Equity Partners picks new head of fundraising and investor relations
    European manager AUM rises to record $12.7 trillion in 2020
    European manager AUM rises to record $12.7 trillion in 2020
    Innovations in DC: Helping Supercharge Retirement Outcomes
    Sponsored Content: Innovations in DC: Helping Supercharge Retirement Outcomes
    sponsored
    Events
     
     
    Sponsored
    White Papers
    Bipsync Client Stories: RMS in Action at Pensions and Superannuation Funds
    COVID-19 Makes LP Portfolio Management More Important Than Ever
    China: the outlook is bright for longer-term investors
    Finding Differentiation in Securitized Assets
    Green and sustainable bonds in emerging markets
    Portfolio Protection: One Size Fits None
    View More
    Sponsored Content
    Partner Content
    The Industrialization of ESG Investment
    For institutional investors, ETFs can make meeting liquidity needs easier
    Gold: the most effective commodity investment
    2021 Investment Outlook | Investing Beyond the Pandemic: A Reset for Portfolios
    Ten ways retirement plan professionals add value to plan sponsors
    Gold: an efficient hedge
    View More
    E-MAIL NEWSLETTERS

    Sign up and get the best of News delivered straight to your email inbox, free of charge. Choose your news – we will deliver.

    Subscribe Today
    April 5, 2021 Page One

    Get access to the news, research and analysis of events affecting the retirement and institutional money management businesses from a worldwide network of reporters and editors.

    Subscribe
    Connect With Us
    • RSS
    • Twitter
    • Facebook
    • LinkedIn

    Our Mission

    To consistently deliver news, research and analysis to the executives who manage the flow of funds in the institutional investment market.

    pilogo-NEW
    About Us

    Main Office
    685 Third Avenue
    Tenth Floor
    New York, NY 10017-4036

    Chicago Office
    150 N. Michigan Ave.
    Chicago, IL 60601

    Contact Us

    Careers at Crain

    About Pensions & Investments

     

    Advertising
    • Media Kit
    • P&I Content Solutions
    • P&I Careers | Post a Job
    • Reprints & Permissions
    Resources
    • Subscribe
    • Newsletters
    • FAQ
    • P&I Research Center
    • Site map
    • Staff Directory
    Legal
    • Privacy Policy
    • Terms and Conditions
    • Privacy Request
    Pensions & Investments
    Copyright © 1996-2021. Crain Communications, Inc. All Rights Reserved.
    • NEWS
      • Asset owners and the coronavirus
      • Alternatives
      • Consultants
      • Coronavirus
      • Defined Contribution
      • ESG
      • Frontlines
      • Hedge Funds
      • Investing / Portfolio Strategies
      • Money Management
      • Pension Funds
      • People Moves
      • Private Equity
      • Real Estate
      • Searches & Hires News
      • SECURE Act
      • Special Reports
      • WorldPensionSummit
    • Data
      • Research Center
      • Searches & Hires Database
      • Searches & Hires News
      • RFPs
      • Charts / Infographics
      • Sponsored Research
      • Trackers
    • Insights
      • Opinion
      • White Papers
      • Industry Voices
      • Letters to the Editor
      • Partner Content
      • Publisher's Update
    • Multimedia
      • Videos
      • Webinars
      • Polls
      • Slideshows
      • Charts / Infographics
    • Events
      • Conferences
      • Webinars
    • Careers
    • Research Center