So… running the full set of mnist pngs (140k) split 85:5:10 with the recommended model.
I can use the model hub, and inspect the model while training proceeds and everything seems responsive. For example, clicks on the > of the convolution preview changes feature immediately.
- In Statistics view, previews never appear on the map, even when training has been completed.
- Weights on convolution only show one set even though there are 8 features specified by the recommended model
- Dense_1 (128 neurons) vs Dense_2 (10): output, weights & biases graphs oddly inconsistent. Output of Dense_2 is a (widely spaced) histogram, but smooth line graph for Dense_1. I thought - aha! - # neurons, but Weights and Biases are graphed as line graphs for both
- Tab selection in Viewbox resets when component selection changes in the Map - I can understand why but it’s a bit annoying if I am trying to compare e.g. gradients across components that I have to move mouse, click, move back for every selection.
- Looking at the Output tab of the Statistics view, I still don’t know how to read the Prediction vs Ground Truth panels. Why is there only one Ground Truth bar? Shouldn’t the One be split across all the categories (totalling One of course)?
- Accuracy over all epochs (there was only 1 on this occasion) is empty
- Why the strange dip in Accuracy during one epoch at the start of validation - it looks too large to be real (eyeball SD & probability estimation
- Run tests - already noted elsewhere, but nothing happens even though server restarted, model rebuilt, etc. Possibly the “dataset too large” error that kills the kernel.
- Restart server, re-open model, (but same browser, no cache clear) alas no previews on the components in modelling tool, but they are visible in the Preview area in the RH panel.
- Annoying: it no longer recognises that the model has been trained once - status is Waiting in the hub, but a checkpoint was saved.
In Statistics view, with focus on a convolution the “squares” of the Weights in the Viewbox cease to be square when the window is moved to another monitor whose dimensions in pixel is different, and the lower value of the scale bar is lost. They return to square when the windows is thrown back to the original monitor.
Generally some parts scale better with window resizing than others (while on the second monitor, so squares not square to begin with)
That’s enough for now