Truss 101: Model serving
Step 2: Call the model server
Call predict to test the model server
Once your model server has finished deploying, you can call it from your terminal.
Call the model server
Model server input must be JSON-serializable: a string, number, list, or dictionary.
Note the double quotes to make the data parameter a string.
truss predict
uses the same data formatting on the as cURL.
Invocation
Response
Our model server is up and responding to requests. In the next step, we’ll set up the last piece of the developer loop on Truss.