Hello everyone who reads this
We are looking to start building out a feature in the tool which will let you use your models easily.
However, there are a few different options on how this can be built out and I would love any opinion on what would work best for you
The four different options (so far) are:
- Run data through the tool using a CSV file
- Start serving an endpoint you can send data to
- Run Gradio (or a similar app)
- Export a serving script
I’ll go through and describe them briefly below.
Run data through the tool using a CSV
This variation is pretty simple; you select what model you want to run, then you select what dataset you want to run through the model and finally you select where you want to export the data and press Run.
The model will now run through the new dataset and will produce a folder will all the predictions in them in a relevant format.
The dataset you select to run through the model can be a CSV file which has not been used in the tool before, as long as the columns match with the ones in the model.
Start serving an endpoint you can send data to
In this variation, you would like before select what model you want to run, but that’s everything.
After you have selected the model and pressed Run, you would get an IP address which could look something like
127.0.0.1:8500 (not necessarily a local address).
Now you can send POST requests to this address with data (images for example) inside them and it will respond with the predictions. You can send both one image at a time or many at once.
Run Gradio (or a similar app)
Here we would utilize an OpenSource tool like Gradio (https://gradio.app/) to create an app for your model.
Like before, you would only need to select what model you would want to run, but this time it would open a Gradio app (probably as a new tab in your browser) that you can interact with.
One of those apps could look something like this:
This would have some restrictions though, such as:
- It seems like you can only run one sample (one image for example) through it at once.
- It would be limited to Image Classification and Segmentation to start with.
Export a serving script
This would work very similar to “Start serving an endpoint you can send data to”, except instead of starting it automatically for you, we just give you the script and the model so you can run it where you wish to.
Thanks for reading as well as any opinions on what you would like to see the most!
All the best,