The human part of machine learning forecasts

I've seen a few videos showing a robot making a burger (here's one of RoboBurger for example). It seems pretty impressive that a machine can create a fresh burger. However, one thing seems missing in those videos. How do the ingredients get there? That part is kind of ignored.? Of course no ingredients means no burgers. It is what happens before the robot assembles the burger which is the most important step. A farmer has spent years raising a cow. Another farmer has grown tomatos for the ketchup. Another farmer has grown wheat for the flour in the bun and so on. The "robot" bit is the culmination of a massive amount of human effort.

When it comes to financial markets, it's often what you don't see which is most important too! Machine learning is creating a buzz in many places including financial markets, in particular models like ChatGPT, which work with text. Whilst these can be incredibly useful for financial markets, ultimately, what most folks are doing in financial markets boils down to forecasting time series (is a stock going up? is inflation going down? etc.). We can still use machine learning for time series forecasting, but typically we need to use different sorts of models when we do a regression, as opposed to ChatGPT.

Turnleaf Analytics, which I cofounded with Alexander Denev is built around using machine learning to forecast economic variables. What have we learnt from this about forecasting using machine learning? Machine learning allows us to squeeze more out of complex datasets, where simpler models aren't as effective. However, in order to do the modelling effectively, requires a lot of human effort for research. It can be tempting to simply do a "horse race" of many different machine learning models and just pick the best one. In practice, you need to understand the particular forecasting problem in a lot of detail. Forecasting inflation is different to many other types of forecasting, whether it is inventory changes, market prices etc.

If you can understand the particular nuances of your particular problem it can help greatly. Feature engineering is a big part of solving the problem. In some areas, feature engineering has been automated, such as computer vision through the use of deep learning. However, in that problem there is a lot of data which can feed data hungry models like CNNs....

To read the rest of the article on the Turnleaf Analytics website, please click here!