V0.12 - Anyone at home?

I have downloaded the full mnist data set and created a CSV for it (attached)

I loaded it

And I clicked Run Model

Nothing happened. Twice. (That’s for Godot fans) and then a couple more times. The first time I did this I waited 10 minutes. Then started again in case I had made a mistake. Still nothing. Did it again and tried customise - still nothing. Is the kernel at home?

At minimum clicking a button should give clear feedback so the user knows they clicked it properly. With the new data wizard there is no error console etc. so I have no idea what, if anything, is happening.

Ideas?

Other observations & issues

  • Nice to have a browse button, but how do I know whether I should use it when I can’t see the current path? Path needs to be visible - minimum lead in and lead out and skip the middle if insufficient room
  • #epochs persists between create models - did you intend that?
  • note the funny characters before image_path in the 1st image… note that CSV is UTF8
  • data type drop downs - if you are not going to sniff the type, please leave blank or use a prompt “Please specify the data type…” it’s so easy to forget or to forget to choose carefully :slight_smile:

All PNG paths.zip (286.2 KB)

UPDATE

Done again with -v=3

PerceptiLabs: PerceptiLabs Started
PerceptiLabs: PerceptiLabs is running at http://localhost:8080/?token=VwBEYd5c66MaBZyFUBtdE5M_EzQrOc1cX_EZjB38m6Q
PerceptiLabs: Use Control-C to stop this server and shut down all PerceptiLabs processes.
[11/May/2021 16:43:24] "GET /?token=VwBEYd5c66MaBZyFUBtdE5M_EzQrOc1cX_EZjB38m6Q HTTP/1.1" 200 493
[11/May/2021 16:43:24] "GET /fileserver_url HTTP/1.1" 200 0
[11/May/2021 16:43:24] "GET /rygg_url HTTP/1.1" 200 0
[11/May/2021 16:43:24] "GET /kernel_url HTTP/1.1" 200 0
[11/May/2021 16:43:25] "GET /is_url_reachable?path=https://keycloak.perceptilabs.com:8443/auth/realms/PerceptiLabs/protocol/openid-connect/3p-cookies/step1.html&token=VwBEYd5c66MaBZyFUBtdE5M_EzQrOc1cX_EZjB38m6Q HTTP/1.1" 200 22
[11/May/2021 16:43:25] "GET /is_url_reachable?path=https://keycloak.perceptilabs.com:8443/auth/realms/PerceptiLabs/protocol/openid-connect/3p-cookies/step1.html&token=VwBEYd5c66MaBZyFUBtdE5M_EzQrOc1cX_EZjB38m6Q HTTP/1.1" 200 22
[11/May/2021 16:43:26] "GET /rygg_url HTTP/1.1" 200 0
[11/May/2021 16:43:26] "GET /version?token=VwBEYd5c66MaBZyFUBtdE5M_EzQrOc1cX_EZjB38m6Q HTTP/1.1" 200 21
2021-05-11 16:43:26,795 - INFO - server.py:191 - Created coreLogic for network 'None'
[11/May/2021 16:43:26] "GET /projects/ HTTP/1.1" 200 293
[11/May/2021 16:43:26] "GET /app/updates_available/ HTTP/1.1" 200 22
2021-05-11 16:43:27,133 - INFO - server.py:191 - Created coreLogic for network ''
2021-05-11 16:43:27,134 - INFO - server.py:191 - User has been set to julianidostuff@gmail.com
[11/May/2021 16:43:27] "GET /mixpanel/decide/?verbose=1&version=1&lib=web&token=1480b2244fdd4d821227a29e2637f922&ip=1&_=1620747806533 HTTP/1.1" 200 0
[11/May/2021 16:43:37] "GET /directories/get_folder_content?path=A:/My%20Documents/IT/Programming/Python/Perceptilabs/Data%20Sets/mnist_png&token=VwBEYd5c66MaBZyFUBtdE5M_EzQrOc1cX_EZjB38m6Q HTTP/1.1" 200 234
('A:/My Documents/IT/Programming/Python/Perceptilabs/Data Sets/mnist_png/All PNG paths.csv', 4)
[11/May/2021 16:43:41] "GET /files/get_file_content?path=A:/My%20Documents/IT/Programming/Python/Perceptilabs/Data%20Sets/mnist_png/All%20PNG%20paths.csv&token=VwBEYd5c66MaBZyFUBtdE5M_EzQrOc1cX_EZjB38m6Q HTTP/1.1" 200 142
[11/May/2021 16:43:41] "GET /directories/resolved_dir?path=A:\My%20Documents\IT\Programming\Python\Perceptilabs\Models\V%200.11%20Models&token=VwBEYd5c66MaBZyFUBtdE5M_EzQrOc1cX_EZjB38m6Q HTTP/1.1" 200 90
[11/May/2021 16:43:41] "GET /directories/get_folder_content?path=A:\My%20Documents\IT\Programming\Python\Perceptilabs\Models\V%200.11%20Models&token=VwBEYd5c66MaBZyFUBtdE5M_EzQrOc1cX_EZjB38m6Q HTTP/1.1" 200 139
[11/May/2021 16:44:05] "GET /directories/get_folder_content?path=A:\My%20Documents\IT\Programming\Python\Perceptilabs\Models\V%200.11%20Models&token=VwBEYd5c66MaBZyFUBtdE5M_EzQrOc1cX_EZjB38m6Q HTTP/1.1" 200 139
[11/May/2021 16:44:06] "GET /directories/get_folder_content?path=A:/My%20Documents/IT/Programming/Python/Perceptilabs/Models/&token=VwBEYd5c66MaBZyFUBtdE5M_EzQrOc1cX_EZjB38m6Q HTTP/1.1" 200 173
[11/May/2021 16:44:08] "GET /directories/get_folder_content?path=A:/My%20Documents/IT/Programming/Python/Perceptilabs/Models/V%200.12%20Models/&token=VwBEYd5c66MaBZyFUBtdE5M_EzQrOc1cX_EZjB38m6Q HTTP/1.1" 200 140
[11/May/2021 16:44:25] "HEAD /directories?path=A:/My%20Documents/IT/Programming/Python/Perceptilabs/Models/V%200.12%20Models/mnist_png&token=VwBEYd5c66MaBZyFUBtdE5M_EzQrOc1cX_EZjB38m6Q HTTP/1.1" 204 34
[11/May/2021 16:44:25] "POST /models/ HTTP/1.1" 201 263
2021-05-11 16:44:26,593 - ERROR - server.py:191 - Error in create_response (action='getModelRecommendation') (issue origin: asyncio.events:88)
Traceback (most recent call last):
  File "perceptilabs\mainInterface.py", line 289, in perceptilabs.mainInterface.Interface.create_response
  File "perceptilabs\mainInterface.py", line 428, in perceptilabs.mainInterface.Interface._create_response
  File "perceptilabs\mainInterface.py", line 602, in perceptilabs.mainInterface.Interface._create_response_model_recommendation
  File "perceptilabs\data\base.py", line 56, in perceptilabs.data.base.DataLoader.from_dict
  File "perceptilabs\data\base.py", line 90, in perceptilabs.data.base.DataLoader.from_features
  File "perceptilabs\data\base.py", line 29, in perceptilabs.data.base.DataLoader.__init__
  File "perceptilabs\data\base.py", line 324, in perceptilabs.data.base.DataLoader._validate_feature_specs
ValueError: Column 'image_path' not in feature specs

[11/May/2021 16:44:26] "OPTIONS /models/59/ HTTP/1.1" 200 0
[11/May/2021 16:44:26] "DELETE /models/59/ HTTP/1.1" 204 0
[11/May/2021 16:44:26] "GET /projects/ HTTP/1.1" 200 293

Hi @JulianSMoore,
Thanks for the logs!

It looks like something is wrong with the CSV file (we really need to get some error handling for that), you can notice it by the strange symbols next to “image_path” in your first image (as you also pointed out).
If you are creating your own CSV file you want to make sure to save it in the format of “comma delimited”:

At minimum clicking a button should give clear feedback so the user knows they clicked it properly. With the new data wizard there is no error console etc. so I have no idea what, if anything, is happening.

Agreed, this is currently being worked on so we can get some loading symbol to indicate that something is happening.

Nice to have a browse button, but how do I know whether I should use it when I can’t see the current path? Path needs to be visible - minimum lead in and lead out and skip the middle if insufficient room

Good point with skipping the middle! Will add it as a polishing story.

data type drop downs - if you are not going to sniff the type, please leave blank or use a prompt “Please specify the data type…” it’s so easy to forget or to forget to choose carefully :slight_smile:

Update for this is coming soon :slight_smile:
They will first be left empty and shortly after be filtered.

@robertl Re the CSV… er… good to remind people generally that it should be COMMA separated (tab and ; are not uncommon though)

However - my CSV is comma separated (I attached for you to inspect in detail because whatever PL dislikes about it, I can’t see it here), as seen in Notepad++ the 1st few of lines are:

image_path,target
testing\0\10.png,0
testing\0\1001.png,0
testing\0\1009.png,0

Nothing wrong with that!

But, I noticed that NPP indicated the file was created as UTF-8 BOM and that is apparently the problem: see here about the 3 very specific chars you should look out for and filter out… because that’s what Excel does when creating a CSV so others are certain to encounter this problem. (I have no idea how to stop Excel doing this - or even if it is possible.)

That should fix it :smiley:

PS I think you need to deal with CSV + BOM because Excel UI won’t… it can be done via VBA but it’s not pretty (see here for some info)

Looks like it’s fixed in 0.12.3. Nice :smiley: