ts.torch_handler package

Subpackages

• ts.torch_handler.request_envelope package
  • Submodules
  • ts.torch_handler.request_envelope.base module
  • ts.torch_handler.request_envelope.body module
  • ts.torch_handler.request_envelope.json module
  • ts.torch_handler.request_envelope.kserve module
  • ts.torch_handler.request_envelope.kservev2 module
  • Module contents
• ts.torch_handler.unit_tests package
  • Subpackages
    • ts.torch_handler.unit_tests.models package
      • Submodules
      • ts.torch_handler.unit_tests.models.base_model module
      • Module contents
    • ts.torch_handler.unit_tests.test_utils package
      • Submodules
      • ts.torch_handler.unit_tests.test_utils.mock_context module
      • Module contents
  • Submodules
  • ts.torch_handler.unit_tests.test_base_handler module
  • ts.torch_handler.unit_tests.test_envelopes module
  • ts.torch_handler.unit_tests.test_image_classifier module
  • ts.torch_handler.unit_tests.test_image_segmenter module
  • ts.torch_handler.unit_tests.test_mnist_kf module
  • ts.torch_handler.unit_tests.test_object_detector module
  • Module contents

Submodules

ts.torch_handler.base_handler module

ts.torch_handler.contractions module

contraction map for text classification models.

ts.torch_handler.densenet_handler module

Module for image classification default handler

class ts.torch_handler.densenet_handler.DenseNetHandler

Bases: object

DenseNetHandler handler class. This handler takes an image and returns the name of object in that image.

handle(data, context)

Entry point for default handler

inference(data, *args, **kwargs)

Override to customize the inference :param data: Torch tensor, matching the model input shape :return: Prediction output as Torch tensor

initialize(context)

First try to load torchscript else load eager mode state_dict based model

ts.torch_handler.densenet_handler.list_classes_from_module(module, parent_class=None)

Parse user defined module to get all model service classes in it.

Parameters:

• module –

• parent_class –

Returns:

List of model service class definitions

ts.torch_handler.image_classifier module

ts.torch_handler.image_segmenter module

ts.torch_handler.object_detector module

ts.torch_handler.text_classifier module

ts.torch_handler.text_handler module

ts.torch_handler.vision_handler module

Module contents