TL;DR “You only run once” You can run twice (yay! well done) but PL forgets the results (nay )
- sometimes GPU not used??
- need copy/paste for text fields in UI
- rename folders on model rename please
- Model Hub, data wizard, etc. don’t seem to support copy/paste on text such as model name - please fix, it will smooth the experience
I created mnust_140k_85_5_10_No_BOM_3 (note the typo… I can rename the model in the model hub but the model folder also needs to be renamed)
Reason: I re-ran a model from yesterday and I swear it didn’t use the GPU properly - run time was 2x the nominal
So I restarted PL and it looked as though the model was not trained
So I ran it again
Notice the difference in CPU & GPU usage.
Then I ran it again without restarting PL congratulations! the memory leak seems to have been fixed - it ran fine!
Unfortunately, on restarting PL we see this: it looks fine but that is the timing for the 1st training run! And looking in the checkpoints folder nothing had been added for the second run
Hope that helps.