All About Time Series Modeling With Neural Networks


Seth Weidman
Senior Data Scientist
Facebook

Overview

In this presentation, Seth speaks to the details of   different types of time series and how to apply them to different problems experienced in the workplace. He covers tricks used to train models effectively in order for accurate predictions to be made and account for different variables used throughout a model.

“Companies entire businesses are based off of time series modeling. What the demand is going to be in the next minute, hour, etc. This requires dynamic and accurate predictions.”

Watch Seth Weidman’s full presentation here

Time series measure something that is varying over time and tries to predict what it will do in the future. These models are based on fluctuations in a univariate model to try and predict the outcome of that variable. ARIMA (auto regressive integrated moving average) models are commonly used in these univariate models. This class of modeling predicts linear effects of the last “p” time steps to future predictions. It assumes old patterns will hold in to the future by analyzing the correlation between deviations of previous trends.

Based on these historical trends and outcomes, a positive deviation will mimic the positive or negative changes that have occurred in the past. Downsides of this classical time series include only being able to look at linear relationships (which can be overcome with some feature engineering) and the inability to handle exogenous features (which can be particularly important in the financial realm where everything is connected).

These graphs represent exogenous factors and how they relate to the price of bitcoin

Classical time series can incorporate exogenous factors as extra regressors to the original model but have limitations. These can still only be captured as linear relationship between the features and targets. Additionally, they cannot capture relationships between any combinations of features and the target. 

RNNs (recurrent neural networks) can aid in overcoming some of these complications faced by classical time series. They are able to take in data from a sequence of time steps and process it sequentially to predict values into the future. A vector captures the stat of all of the variables in a model from a time step which classical time series do not do. By processing this data sequentially, it is much more effective at making predictions. This is accomplished by storing hidden statistics within the hidden layers of the neural network that then incorporate all of the data that has been used in the past. 

Classical time series can be given the same data as RNNs but will run this through a single model as opposed to the multiple models used in RNNs. Classical models do not have the same notion of sequential process of data and it is difficult to encode a notion of order.

This image shows classical time series using only one neural network
This image shows recurrent neural network with multiple models

RNNs do require a lot of data in order to form accurate predictions. This factor can be aided by the fact that RNNs work best when helpful exogenous features are present. While it is typical to understand the exact processes of neural networks due to the complicated mathematical processes taking place, they are useful in implementing what-if analyses. It is as simple as giving a properly trained model a new data set that reflects a specific question to see how results differ. An additional advantage of RNNs is that confidence intervals can be determined by using Bayesian Deep Learning techniques. By randomly dropping different subsets from the RNN nodes, the resulting change in predictions can be correlated to the confidence of that prediction.

Deep mind and open AI are continually being used in new ways to improve machine learning processes. Seth and his team at Facebook are continuing to find new ways to implement these tools for different uses in the workplace. As these techniques become more efficient and perfected their applications to real world uses continue to be realized.


Tags   •   Finance

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *

Related Posts

Recent Posts

Does Healthcare AI Meet Basic Ethics Principles? - Ingrid Vasiliu-Feltes Chief Quality and Innovation Officer MEDNAX, Health Solutions Partner Over the past decade we have noticed an exponential…
“Ask Me Anything” with Zappos’s Head of AI/ML Research & Platforms, Ameen Kazerouni - Ameen Kazerouni Head of AI/ML Research & Platforms Zappos Family of Companies Ai4 recently hosted an "Ask Me Anything" session…
Top AI Conferences - Interested in learning the latest in AI this year? We’ve compiled a list of the top artificial intelligence conferences in…
Securing Personal Data for AI/ML Computing in the Cloud - Serge Vilvovsky Cybersecurity & Big Data Engineer MIT Startup Exchange Overview In this presentation, Serge Vilvovsky, a Cyber Security and…
Secure Your Code Via AI - Eliezer Kanal Technical Manager, Cyber Security Foundations, CERT Division Carnegie Mellon University Software Engineering Institute Introduction In this presentation Eliezer…
Leveraging AI in Cybersecurity Risk Modeling & Mitigation - Christopher Novak Director, Threat Advisory Research Verizon Wireless Introduction Originally, there was a poor understanding of why cyber breaches were…
Using AI to Build More Secure Software - Mark Sherman Technical Director, Cyber Security Foundations, CERT Division Carnegie Mellon University Software Engineering Institute Introduction MITRE's Common Vulnerabilities and…
Artificial Intelligence & Cybersecurity: Math Not Magic - Wayne Chung CTO FBI Introduction The field of cybersecurity has slowly progressed from an art to a science. It has…
Life Hacks for Thrilling the Customer with Your Data Science Technical Summary Products - Anne Lifton Manager of Data Science Nordstrom Overview Anne Lifton is a Manager of Data Science at Nordstrom and in…
Machine Learning for Pricing and Inventory Optimization @ Macy’s - Jolene Mork Senior Data Scientist Macy's Iain Stitt Data Scientist Macy's Bhagyesh Phanse VP, Data Science Macy's Overview In this…

Popular Posts

Leveraging AI in Cybersecurity Risk Modeling & Mitigation - Christopher Novak Director, Threat Advisory Research Verizon Wireless Introduction Originally, there was a poor understanding of why cyber breaches were…
Machine Learning for Pricing and Inventory Optimization @ Macy’s - Jolene Mork Senior Data Scientist Macy's Iain Stitt Data Scientist Macy's Bhagyesh Phanse VP, Data Science Macy's Overview In this…
Machine Learning and Artificial Intelligence in Banking - Artit "Art" Wangperawong Distinguished Engineer US Bank Introduction Every company’s AI journey is different. We’re all trying to figure out…
Convergent AI in Reducing Overdiagnosis, Overtreatment, and Misdiagnosis - Stephen Wong Chief Research Information Officer & Chair Professor Houston Methodist The current healthcare situation:  High-cost/low-quality healthcare is now a…
Figuring Out Applied ML: Building Frameworks and Teams to Operationalize ML at Scale - Dr. Nels Lindahl Director of Clinical Systems CVS Health How do you operationalize machine learning at scale? How do you…
The Autonomous Pharmacy: Applying AI and ML to Medication Management Across the Care Continuum - Ken Perez VP of Healthcare Policy Omnicell, Inc. Ken applies artificial intelligence (AI) and machine learning (ML) solutions to medication…
Unleashing the Power of AI on R&D: The Potential, The Pitfalls, The Progress - Dr. Jim Weatherall VP, Data Science & AI Astrazeneca R&D Intro to AstraZeneca R&D Here we see an end-to-end case…
Advancements at Siemens Healthineers in AI for Medical Imaging - Bimba Rao Head of Global Artificial Intelligence Engineering Siemens Healthineers Ultrasound Siemens Healthineers background  Siemens Healthineers builds healthcare products and…
What AI Will Bring to Medicine and Why Human Experts Are Here to Stay - Hakima Ibaroudene Group Leader - Research & Development Southwest Research Institute Overview Hakima Ibaroudene discusses how she and her team…
Does Healthcare AI Meet Basic Ethics Principles? - Ingrid Vasiliu-Feltes Chief Quality and Innovation Officer MEDNAX, Health Solutions Partner Over the past decade we have noticed an exponential…