Flow Forecast (FF) is an open-source deep learning for time series forecasting framework. It provides all the latest state of the art models (transformers, attention models, GRUs, ODEs) and cutting ...
optimi optimizers can match the performance of mixed precision when training in pure BFloat16 by using Kahan summation. Training in BFloat16 with Kahan summation can reduce non-activation training ...