Feature request: Save Best Model During Tuning

[LucasDedieu]

Description

To avoid unnecessary retraining with the same configuration, the tuning script should save the best-performing model during the tuning process, particularly when no additional training steps are required.

Implementation

1. After each trial t:

   • If model_t performs better than best_model_so_far:
     • Update best_model_so_far = model_t

2. At the end of tuning:

   • Save best_model_so_far