Unable to reproduce the reported performance on METR-LA

[chjnbvf]

Hi, I'm trying to reproduce the results on METR-LA dataset, but getting ~15% worse performance:

My results (Horizon 12): MAE=3.48, MAPE=9.90%
Paper results: MAE=3.00, MAPE=8.15%

Setup:

• Using the provided code without modifications
• 6-layer BERT from google/bert_uncased_L-6_H-768_A-12
• Data from the link in the paper
• All hyperparameters as in Table 1

Could you please check if there are any missing details?