.. _sec_forecasting_quickstart:

Forecasting Time Series - Quick Start
=====================================


Via a simple ``fit()`` call, AutoGluon can train and tune

-  simple forecasting models (e.g., ARIMA, ETS, Theta),
-  powerful deep learning models (e.g., DeepAR, Temporal Fusion
   Transformer),
-  tree-based models (e.g., XGBoost, CatBoost, LightGBM),
-  an ensemble that combines predictions of other models

to produce multi-step ahead *probabilistic* forecasts for univariate
time series data.

This tutorial demonstrates how to quickly start using AutoGluon to
generate hourly forecasts for the `M4 forecasting
competition <https://www.sciencedirect.com/science/article/pii/S0169207019301128>`__
dataset.

Loading time series data as a ``TimeSeriesDataFrame``
-----------------------------------------------------

First, we import some required modules

.. code:: python

    import pandas as pd
    from autogluon.timeseries import TimeSeriesDataFrame, TimeSeriesPredictor

To use ``autogluon.timeseries``, we will only need the following two
classes:

-  ``TimeSeriesDataFrame`` stores a dataset consisting of multiple time
   series.
-  ``TimeSeriesPredictor`` takes care of fitting, tuning and selecting
   the best forecasting models, as well as generating new forecasts.

We load a subset of the M4 hourly dataset as a ``pandas.DataFrame``

.. code:: python

    df = pd.read_csv("https://autogluon.s3.amazonaws.com/datasets/timeseries/m4_hourly_subset/train.csv")
    df.head()




.. raw:: html

    <div>
    <style scoped>
        .dataframe tbody tr th:only-of-type {
            vertical-align: middle;
        }
    
        .dataframe tbody tr th {
            vertical-align: top;
        }
    
        .dataframe thead th {
            text-align: right;
        }
    </style>
    <table border="1" class="dataframe">
      <thead>
        <tr style="text-align: right;">
          <th></th>
          <th>item_id</th>
          <th>timestamp</th>
          <th>target</th>
        </tr>
      </thead>
      <tbody>
        <tr>
          <th>0</th>
          <td>H1</td>
          <td>1750-01-01 00:00:00</td>
          <td>605.0</td>
        </tr>
        <tr>
          <th>1</th>
          <td>H1</td>
          <td>1750-01-01 01:00:00</td>
          <td>586.0</td>
        </tr>
        <tr>
          <th>2</th>
          <td>H1</td>
          <td>1750-01-01 02:00:00</td>
          <td>586.0</td>
        </tr>
        <tr>
          <th>3</th>
          <td>H1</td>
          <td>1750-01-01 03:00:00</td>
          <td>559.0</td>
        </tr>
        <tr>
          <th>4</th>
          <td>H1</td>
          <td>1750-01-01 04:00:00</td>
          <td>511.0</td>
        </tr>
      </tbody>
    </table>
    </div>



AutoGluon expects time series data in `long
format <https://doc.dataiku.com/dss/latest/time-series/data-formatting.html#long-format>`__.
Each row of the data frame contains a single observation (timestep) of a
single time series represented by

-  unique ID of the time series (``"item_id"``) as int or str
-  timestamp of the observation (``"timestamp"``) as a
   ``pandas.Timestamp`` or compatible format
-  numeric value of the time series (``"target"``)

The raw dataset should always follow this format with at least three
columns for unique ID, timestamp, and target value, but the names of
these columns can be arbitrary. It is important, however, that we
provide the names of the columns when constructing a
``TimeSeriesDataFrame`` that is used by AutoGluon. AutoGluon will raise
an exception if the data doesn’t match the expected format.

.. code:: python

    train_data = TimeSeriesDataFrame.from_data_frame(
        df,
        id_column="item_id",
        timestamp_column="timestamp"
    )
    train_data.head()




.. raw:: html

    <div>
    <style scoped>
        .dataframe tbody tr th:only-of-type {
            vertical-align: middle;
        }
    
        .dataframe tbody tr th {
            vertical-align: top;
        }
    
        .dataframe thead th {
            text-align: right;
        }
    </style>
    <table border="1" class="dataframe">
      <thead>
        <tr style="text-align: right;">
          <th></th>
          <th></th>
          <th>target</th>
        </tr>
        <tr>
          <th>item_id</th>
          <th>timestamp</th>
          <th></th>
        </tr>
      </thead>
      <tbody>
        <tr>
          <th rowspan="5" valign="top">H1</th>
          <th>1750-01-01 00:00:00</th>
          <td>605.0</td>
        </tr>
        <tr>
          <th>1750-01-01 01:00:00</th>
          <td>586.0</td>
        </tr>
        <tr>
          <th>1750-01-01 02:00:00</th>
          <td>586.0</td>
        </tr>
        <tr>
          <th>1750-01-01 03:00:00</th>
          <td>559.0</td>
        </tr>
        <tr>
          <th>1750-01-01 04:00:00</th>
          <td>511.0</td>
        </tr>
      </tbody>
    </table>
    </div>



We refer to each individual time series stored in a
``TimeSeriesDataFrame`` as an *item*. For example, items might
correspond to different products in demand forecasting, or to different
stocks in financial datasets. This setting is also referred to as a
*panel* of time series. Note that this is *not* the same as multivariate
forecasting — AutoGluon generates forecasts for each time series
individually, without modeling interactions between different items
(time series).

``TimeSeriesDataFrame`` inherits from
`pandas.DataFrame <https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.DataFrame.html>`__,
so all attributes and methods of ``pandas.DataFrame`` are available in a
``TimeSeriesDataFrame``. It also provides other utility functions, such
as loaders for different data formats (see
:class:`autogluon.timeseries.TimeSeriesDataFrame` for details).

Training time series models with ``TimeSeriesPredictor.fit``
------------------------------------------------------------

To forecast future values of the time series, we need to create a
``TimeSeriesPredictor`` object.

Models in ``autogluon.timeseries`` forecast time series *multiple steps*
into the future. We choose the number of these steps — the *prediction
length* (also known as the *forecast horizon*) — depending on our task.
For example, our dataset contains time series measured at hourly
*frequency*, so we set ``prediction_length = 48`` to train models that
forecast up to 48 hours into the future.

We instruct AutoGluon to save trained models in the folder
``./autogluon-m4-hourly``. We also specify that AutoGluon should rank
models according to `symmetric mean absolute percentage error
(sMAPE) <https://en.wikipedia.org/wiki/Symmetric_mean_absolute_percentage_error>`__,
and that data that we want to forecast is stored in the column
``"target"`` of the ``TimeSeriesDataFrame``.

.. code:: python

    predictor = TimeSeriesPredictor(
        prediction_length=48,
        path="autogluon-m4-hourly",
        target="target",
        eval_metric="sMAPE",
    )
    
    predictor.fit(
        train_data,
        presets="medium_quality",
        time_limit=600,
    )


.. parsed-literal::
    :class: output

    ================ TimeSeriesPredictor ================
    TimeSeriesPredictor.fit() called
    Setting presets to: medium_quality
    Fitting with arguments:
    {'enable_ensemble': True,
     'evaluation_metric': 'sMAPE',
     'hyperparameter_tune_kwargs': None,
     'hyperparameters': 'medium_quality',
     'prediction_length': 48,
     'random_seed': None,
     'target': 'target',
     'time_limit': 600}
    Provided training data set with 148060 rows, 200 items (item = single time series). Average time series length is 740.3.
    Training artifacts will be saved to: /home/ci/autogluon/docs/_build/eval/tutorials/timeseries/autogluon-m4-hourly
    =====================================================
    AutoGluon will save models to autogluon-m4-hourly/
    AutoGluon will gauge predictive performance using evaluation metric: 'sMAPE'
    	This metric's sign has been flipped to adhere to being 'higher is better'. The reported score can be multiplied by -1 to get the metric value.
    
    Provided dataset contains following columns:
    	target:           'target'
    tuning_data is None. Will use the last prediction_length = 48 time steps of each time series as a hold-out validation set.
    
    Starting training. Start time is 2023-02-22 23:22:51
    Models that will be trained: ['Naive', 'SeasonalNaive', 'ETS', 'Theta', 'ARIMA', 'AutoETS', 'AutoGluonTabular', 'DeepAR']
    Training timeseries model Naive. Training for up to 599.88s of the 599.88s of remaining time.
    	-0.4341       = Validation score (-sMAPE)
    	0.00    s     = Training runtime
    	6.22    s     = Validation (prediction) runtime
    Training timeseries model SeasonalNaive. Training for up to 593.65s of the 593.65s of remaining time.
    	-0.1686       = Validation score (-sMAPE)
    	0.00    s     = Training runtime
    	0.40    s     = Validation (prediction) runtime
    Training timeseries model ETS. Training for up to 593.24s of the 593.24s of remaining time.
    	-0.2666       = Validation score (-sMAPE)
    	0.00    s     = Training runtime
    	34.60   s     = Validation (prediction) runtime
    Training timeseries model Theta. Training for up to 558.62s of the 558.62s of remaining time.
    	-0.2236       = Validation score (-sMAPE)
    	0.00    s     = Training runtime
    	12.97   s     = Validation (prediction) runtime
    Training timeseries model ARIMA. Training for up to 545.64s of the 545.64s of remaining time.
    	-0.5269       = Validation score (-sMAPE)
    	0.00    s     = Training runtime
    	14.39   s     = Validation (prediction) runtime
    Training timeseries model AutoETS. Training for up to 531.24s of the 531.24s of remaining time.
    	-0.2381       = Validation score (-sMAPE)
    	0.00    s     = Training runtime
    	120.43  s     = Validation (prediction) runtime
    Training timeseries model AutoGluonTabular. Training for up to 410.79s of the 410.79s of remaining time.
    	-0.1089       = Validation score (-sMAPE)
    	48.48   s     = Training runtime
    	3.98    s     = Validation (prediction) runtime
    Training timeseries model DeepAR. Training for up to 358.32s of the 358.32s of remaining time.
    	Warning: Exception caused DeepAR to fail during training... Skipping this model.
    	cuDNN error: CUDNN_STATUS_NOT_INITIALIZED
    Fitting simple weighted ensemble.
    	-0.1083       = Validation score (-sMAPE)
    	7.19    s     = Training runtime
    	23.17   s     = Validation (prediction) runtime
    Training complete. Models trained: ['Naive', 'SeasonalNaive', 'ETS', 'Theta', 'ARIMA', 'AutoETS', 'AutoGluonTabular', 'WeightedEnsemble']
    Total runtime: 256.03 s
    Best model: WeightedEnsemble
    Best model score: -0.1083




.. parsed-literal::
    :class: output

    <autogluon.timeseries.predictor.TimeSeriesPredictor at 0x7fa82f4c4a30>



Here we used the ``"medium_quality"`` presets and limited the training
time to 10 minutes (600 seconds). The presets define which models
AutoGluon will try to fit. For ``medium_quality`` presets, these are
simple baselines (``Naive``, ``SeasonalNaive``), statistical models
(``ARIMA``, ``ETS``, ``Theta``), tree-based models XGBoost, LightGBM and
CatBoost wrapped by ``AutoGluonTabular``, a deep learning model
``DeepAR``, and a weighted ensemble combining these. Other available
presets for ``TimeSeriesPredictor`` are ``"fast_training"``,
``"high_quality"`` and ``"best_quality"``. Higher quality presets will
usually produce more accurate forecasts but take longer to train and may
produce less computationally efficient models.

Inside ``fit()``, AutoGluon will train as many models as possible within
the given time limit. Trained models are then ranked based on their
performance on an internal validation set. By default, this validation
set is constructed by holding out the last ``prediction_length``
timesteps of each time series in ``train_data``.

Generating forecasts with ``TimeSeriesPredictor.predict``
---------------------------------------------------------

We can now use the fitted ``TimeSeriesPredictor`` to forecast the future
time series values. By default, AutoGluon will make forecasts using the
model that had the best score on the internal validation set. The
forecast always includes predictions for the next ``prediction_length``
timesteps, starting from the end of each time series in ``train_data``.

.. code:: python

    predictions = predictor.predict(train_data)
    predictions.head()


.. parsed-literal::
    :class: output

    Global seed set to 123
    Model not specified in predict, will default to the model with the best validation score: WeightedEnsemble




.. raw:: html

    <div>
    <style scoped>
        .dataframe tbody tr th:only-of-type {
            vertical-align: middle;
        }
    
        .dataframe tbody tr th {
            vertical-align: top;
        }
    
        .dataframe thead th {
            text-align: right;
        }
    </style>
    <table border="1" class="dataframe">
      <thead>
        <tr style="text-align: right;">
          <th></th>
          <th></th>
          <th>mean</th>
          <th>0.1</th>
          <th>0.2</th>
          <th>0.3</th>
          <th>0.4</th>
          <th>0.5</th>
          <th>0.6</th>
          <th>0.7</th>
          <th>0.8</th>
          <th>0.9</th>
        </tr>
        <tr>
          <th>item_id</th>
          <th>timestamp</th>
          <th></th>
          <th></th>
          <th></th>
          <th></th>
          <th></th>
          <th></th>
          <th></th>
          <th></th>
          <th></th>
          <th></th>
        </tr>
      </thead>
      <tbody>
        <tr>
          <th rowspan="5" valign="top">H1</th>
          <th>1750-01-30 04:00:00</th>
          <td>660.275837</td>
          <td>585.152879</td>
          <td>621.962248</td>
          <td>640.632471</td>
          <td>651.982102</td>
          <td>660.521498</td>
          <td>668.485765</td>
          <td>678.054771</td>
          <td>692.947233</td>
          <td>727.495623</td>
        </tr>
        <tr>
          <th>1750-01-30 05:00:00</th>
          <td>589.956997</td>
          <td>514.059597</td>
          <td>551.134817</td>
          <td>569.996736</td>
          <td>581.510165</td>
          <td>590.202659</td>
          <td>598.320024</td>
          <td>608.052828</td>
          <td>623.136986</td>
          <td>657.951263</td>
        </tr>
        <tr>
          <th>1750-01-30 06:00:00</th>
          <td>553.269267</td>
          <td>476.777615</td>
          <td>514.056829</td>
          <td>533.065843</td>
          <td>544.704958</td>
          <td>553.514928</td>
          <td>561.749769</td>
          <td>571.608260</td>
          <td>586.839512</td>
          <td>621.857783</td>
        </tr>
        <tr>
          <th>1750-01-30 07:00:00</th>
          <td>515.697766</td>
          <td>438.705138</td>
          <td>476.156327</td>
          <td>495.289346</td>
          <td>507.034420</td>
          <td>515.943427</td>
          <td>524.277305</td>
          <td>534.241754</td>
          <td>549.597013</td>
          <td>584.787258</td>
        </tr>
        <tr>
          <th>1750-01-30 08:00:00</th>
          <td>488.940736</td>
          <td>411.506739</td>
          <td>449.109441</td>
          <td>468.351712</td>
          <td>480.190138</td>
          <td>489.186397</td>
          <td>497.607529</td>
          <td>507.665329</td>
          <td>523.129839</td>
          <td>558.471598</td>
        </tr>
      </tbody>
    </table>
    </div>



AutoGluon produces a *probabilistic* forecast: in addition to predicting
the mean (expected value) of the time series in the future, models also
provide the quantiles of the forecast distribution. The quantile
forecasts give us an idea about the range of possible outcomes. For
example, if the ``"0.1"`` quantile is equal to ``500.0``, it means that
the model predicts a 10% chance that the target value will be below
``500.0``.

We will now visualize the forecast and the actually observed values for
one of the time series in the dataset. We plot the mean forecast, as
well as the 10% and 90% quantiles to show the range of potential
outcomes.

.. code:: python

    import matplotlib.pyplot as plt
    
    # TimeSeriesDataFrame can also be loaded directly from a file
    test_data = TimeSeriesDataFrame.from_path("https://autogluon.s3.amazonaws.com/datasets/timeseries/m4_hourly_subset/test.csv")
    
    plt.figure(figsize=(20, 3))
    
    item_id = "H1"
    y_past = train_data.loc[item_id]["target"]
    y_pred = predictions.loc[item_id]
    y_test = test_data.loc[item_id]["target"][-48:]
    
    plt.plot(y_past[-200:], label="Past time series values")
    plt.plot(y_pred["mean"], label="Mean forecast")
    plt.plot(y_test, label="Future time series values")
    
    plt.fill_between(
        y_pred.index, y_pred["0.1"], y_pred["0.9"], color="red", alpha=0.1, label=f"10%-90% confidence interval"
    )
    plt.legend();


.. parsed-literal::
    :class: output

    Loaded data from: https://autogluon.s3.amazonaws.com/datasets/timeseries/m4_hourly_subset/test.csv | Columns = 3 / 3 | Rows = 157660 -> 157660



.. figure:: output_forecasting-quickstart_a33e23_11_1.png


Evaluating the performance of different models
----------------------------------------------

We can view the performance of each model AutoGluon has trained via the
``leaderboard()`` method. We provide the test data set to the
leaderboard function to see how well our fitted models are doing on the
unseen test data. The leaderboard also includes the validation scores
computed on the internal validation dataset.

In AutoGluon leaderboards, higher scores always correspond to better
predictive performance. Therefore our sMAPE scores are multiplied by
``-1``, such that higher “negative sMAPE”s correspond to more accurate
forecasts.

.. code:: python

    # The test score is computed using the last
    # prediction_length=48 timesteps of each time series in test_data
    predictor.leaderboard(test_data, silent=True)


.. parsed-literal::
    :class: output

    Additional data provided, testing on additional data. Resulting leaderboard will be sorted according to test score (`score_test`).




.. raw:: html

    <div>
    <style scoped>
        .dataframe tbody tr th:only-of-type {
            vertical-align: middle;
        }
    
        .dataframe tbody tr th {
            vertical-align: top;
        }
    
        .dataframe thead th {
            text-align: right;
        }
    </style>
    <table border="1" class="dataframe">
      <thead>
        <tr style="text-align: right;">
          <th></th>
          <th>model</th>
          <th>score_test</th>
          <th>score_val</th>
          <th>pred_time_test</th>
          <th>pred_time_val</th>
          <th>fit_time_marginal</th>
          <th>fit_order</th>
        </tr>
      </thead>
      <tbody>
        <tr>
          <th>0</th>
          <td>WeightedEnsemble</td>
          <td>-0.103598</td>
          <td>-0.108320</td>
          <td>4.186317</td>
          <td>23.165947</td>
          <td>7.191082</td>
          <td>8</td>
        </tr>
        <tr>
          <th>1</th>
          <td>AutoGluonTabular</td>
          <td>-0.105318</td>
          <td>-0.108919</td>
          <td>4.228805</td>
          <td>3.983287</td>
          <td>48.479117</td>
          <td>7</td>
        </tr>
        <tr>
          <th>2</th>
          <td>SeasonalNaive</td>
          <td>-0.119063</td>
          <td>-0.168566</td>
          <td>0.380008</td>
          <td>0.398841</td>
          <td>0.002937</td>
          <td>2</td>
        </tr>
        <tr>
          <th>3</th>
          <td>Theta</td>
          <td>-0.194352</td>
          <td>-0.223630</td>
          <td>0.182456</td>
          <td>12.966635</td>
          <td>0.001830</td>
          <td>4</td>
        </tr>
        <tr>
          <th>4</th>
          <td>AutoETS</td>
          <td>-0.195432</td>
          <td>-0.238137</td>
          <td>123.482404</td>
          <td>120.434640</td>
          <td>0.001656</td>
          <td>6</td>
        </tr>
        <tr>
          <th>5</th>
          <td>ETS</td>
          <td>-0.218012</td>
          <td>-0.266572</td>
          <td>35.760995</td>
          <td>34.595953</td>
          <td>0.001607</td>
          <td>3</td>
        </tr>
        <tr>
          <th>6</th>
          <td>Naive</td>
          <td>-0.453291</td>
          <td>-0.434068</td>
          <td>0.177751</td>
          <td>6.216025</td>
          <td>0.003090</td>
          <td>1</td>
        </tr>
        <tr>
          <th>7</th>
          <td>ARIMA</td>
          <td>-0.518139</td>
          <td>-0.526885</td>
          <td>14.585204</td>
          <td>14.392367</td>
          <td>0.001564</td>
          <td>5</td>
        </tr>
      </tbody>
    </table>
    </div>



Summary
-------

We used ``autogluon.timeseries`` to make probabilistic multi-step
forecasts on the M4 Hourly dataset. Check out
:ref:`sec_forecasting_indepth` to learn about the advanced
capabilities of AutoGluon for time series forecasting.