All About Time Series Modeling With Neural Networks


Seth Weidman
Senior Data Scientist
Facebook

Overview

In this presentation, Seth speaks to the details of   different types of time series and how to apply them to different problems experienced in the workplace. He covers tricks used to train models effectively in order for accurate predictions to be made and account for different variables used throughout a model.

“Companies entire businesses are based off of time series modeling. What the demand is going to be in the next minute, hour, etc. This requires dynamic and accurate predictions.”

Watch Seth Weidman’s full presentation here

Time series measure something that is varying over time and tries to predict what it will do in the future. These models are based on fluctuations in a univariate model to try and predict the outcome of that variable. ARIMA (auto regressive integrated moving average) models are commonly used in these univariate models. This class of modeling predicts linear effects of the last “p” time steps to future predictions. It assumes old patterns will hold in to the future by analyzing the correlation between deviations of previous trends.

Based on these historical trends and outcomes, a positive deviation will mimic the positive or negative changes that have occurred in the past. Downsides of this classical time series include only being able to look at linear relationships (which can be overcome with some feature engineering) and the inability to handle exogenous features (which can be particularly important in the financial realm where everything is connected).

These graphs represent exogenous factors and how they relate to the price of bitcoin

Classical time series can incorporate exogenous factors as extra regressors to the original model but have limitations. These can still only be captured as linear relationship between the features and targets. Additionally, they cannot capture relationships between any combinations of features and the target. 

RNNs (recurrent neural networks) can aid in overcoming some of these complications faced by classical time series. They are able to take in data from a sequence of time steps and process it sequentially to predict values into the future. A vector captures the stat of all of the variables in a model from a time step which classical time series do not do. By processing this data sequentially, it is much more effective at making predictions. This is accomplished by storing hidden statistics within the hidden layers of the neural network that then incorporate all of the data that has been used in the past. 

Classical time series can be given the same data as RNNs but will run this through a single model as opposed to the multiple models used in RNNs. Classical models do not have the same notion of sequential process of data and it is difficult to encode a notion of order.

This image shows classical time series using only one neural network
This image shows recurrent neural network with multiple models

RNNs do require a lot of data in order to form accurate predictions. This factor can be aided by the fact that RNNs work best when helpful exogenous features are present. While it is typical to understand the exact processes of neural networks due to the complicated mathematical processes taking place, they are useful in implementing what-if analyses. It is as simple as giving a properly trained model a new data set that reflects a specific question to see how results differ. An additional advantage of RNNs is that confidence intervals can be determined by using Bayesian Deep Learning techniques. By randomly dropping different subsets from the RNN nodes, the resulting change in predictions can be correlated to the confidence of that prediction.

Deep mind and open AI are continually being used in new ways to improve machine learning processes. Seth and his team at Facebook are continuing to find new ways to implement these tools for different uses in the workplace. As these techniques become more efficient and perfected their applications to real world uses continue to be realized.


Tags   •   Finance

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *

Related Posts

Recent Posts

COVID-19 Curfew and Social Distancing Enforcement using AI enabled Drones - https://youtu.be/A41BASN9TA8 Amarjot Singh, PhDFounder & CEOSkyLark Labs LLC The SARS-CoV-2(also known as COVID-19 or Novel Corona Virus) infectious outbreak has rapidly…
“Ask Me Anything” with Roboticist & Program Lead of Racing Vehicles at General Motors - Harish SkumarRoboticist & Program Lead of Racing Vehicles General Motors Ai4 recently hosted an “Ask Me Anything” session with Harish…
Bottlenecks in Supply Chains & How AI Can Help - During this panel, industry experts (showed above) discussed the impact of COVID-19 on AI on Supply Chains. We’ve included a…
How COVID-19 is Impacting the State of AI in Supply Chains - During this panel, industry experts (showed above) discussed the impact of COVID-19 on AI on Supply Chains. We’ve included a…
How COVID-19 is Impacting the State of AI in Investment Management - On this panel, industry experts (listed above) discussed the impact of COVID-19 on AI on Investment Management. We've included a…
The State of AI in Investment Management - On this panel, industry experts (listed above) discussed the affects of AI on Investment Management. We've included a short transcription…
The State of AI in Banking - On this panel, industry experts (listed above) discussed what they are most excited about in AI in Banking. We've included…
How COVID-19 is Impacting the State of AI in Banking - On this panel, industry experts (listed above) discussed The State of AI in Banking and how COVID-19 is affecting it.…
The Ethics of AI: Who will be Responsible for the Decisions of AI Applications? - Ayodele Odubela Data Scientist SambaSafety One of the issues often debated in AI as it regards to ethics is who…
“Ask Me Anything” with Krzysztof Geras, PhD - Krzysztof Geras Assistant Professor NYU Department of Radiology Ai4's recently hosted an "Ask Me Anything" session with one of our…

Popular Posts

Does Healthcare AI Meet Basic Ethics Principles? - Ingrid Vasiliu-Feltes Chief Quality and Innovation Officer MEDNAX, Health Solutions Partner Over the past decade we have noticed an exponential…
AI/ML in Investment and Risk Management: Recent Applications, Use Cases, and Implementation Challenges - Arvind Rajan Managing Director - Head of Global & Macro PGIM Fixed Income Introduction Investing is a completely different ballgame…
Top AI Conferences - Interested in learning the latest in AI this year? We’ve compiled a list of the top artificial intelligence conferences in…
Artificial Intelligence & Cybersecurity: Math Not Magic - Wayne Chung CTO FBI Introduction The field of cybersecurity has slowly progressed from an art to a science. It has…
Machine Learning for Pricing and Inventory Optimization @ Macy’s - Jolene Mork Senior Data Scientist Macy's Iain Stitt Data Scientist Macy's Bhagyesh Phanse VP, Data Science Macy's Overview In this…
“Ask Me Anything” with Zappos’s Head of AI/ML Research & Platforms, Ameen Kazerouni - Ameen Kazerouni Head of AI/ML Research & Platforms Zappos Family of Companies Ai4 recently hosted an "Ask Me Anything" session…
Advancements at Siemens Healthineers in AI for Medical Imaging - Bimba Rao Head of Global Artificial Intelligence Engineering Siemens Healthineers Ultrasound Siemens Healthineers background  Siemens Healthineers builds healthcare products and…
Leveraging AI in Cybersecurity Risk Modeling & Mitigation - Christopher Novak Director, Threat Advisory Research Verizon Wireless Introduction Originally, there was a poor understanding of why cyber breaches were…
An Ensemble Approach to Predict Default Risk in Stress Testing - Yun Zheng VP of Innovation & Global Risk Analytics HSBC Overview This presentation discussed the importance of performing stress tests…
Machine Learning and Artificial Intelligence in Banking - Artit "Art" Wangperawong Distinguished Engineer US Bank Introduction Every company’s AI journey is different. We’re all trying to figure out…