Class RpcModel

java.lang.Object
ai.djl.BaseModel
ai.djl.engine.rpc.RpcModel
All Implemented Interfaces:
Model, AutoCloseable

public class RpcModel extends BaseModel
RpcModel is an implementation for the Model deployed on remote model server.
  • Method Details

    • load

      public void load(Path modelPath, String prefix, Map<String,?> options) throws IOException, MalformedModelException
      Loads the model from the modelPath with the name and options provided.
      Parameters:
      modelPath - the directory or file path of the model location
      prefix - the model file name or path prefix
      options - engine specific load model options, see documentation for each engine
      Throws:
      IOException - when IO operation fails in loading a resource
      MalformedModelException - if model file is corrupted