change: Enable default model fn for cpu and gpu

[saimidu]

Issue #, if available:

Description of changes:
Add a default model function for CPU/GPU based inference, instead of raising a NotImplementedError

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

[sagemaker-bot]

AWS CodeBuild CI Report

• CodeBuild project: sagemaker-pytorch-inference-toolkit-pr
• Commit ID: 58b37b0
• Result: FAILED
• Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

[sagemaker-bot]

AWS CodeBuild CI Report

• CodeBuild project: sagemaker-pytorch-inference-toolkit-pr
• Commit ID: 455ee5a
• Result: FAILED
• Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

[sagemaker-bot]

AWS CodeBuild CI Report

• CodeBuild project: sagemaker-pytorch-inference-toolkit-pr
• Commit ID: 36b0b7d
• Result: FAILED
• Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

[sagemaker-bot]

AWS CodeBuild CI Report

• CodeBuild project: sagemaker-pytorch-inference-toolkit-pr
• Commit ID: 23b6d91
• Result: FAILED
• Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

[sagemaker-bot]

AWS CodeBuild CI Report

• CodeBuild project: sagemaker-pytorch-inference-toolkit-pr
• Commit ID: 6f8c71d
• Result: FAILED
• Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

[sagemaker-bot]

AWS CodeBuild CI Report

• CodeBuild project: sagemaker-pytorch-inference-toolkit-pr
• Commit ID: bf0e407
• Result: FAILED
• Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

[sagemaker-bot]

AWS CodeBuild CI Report

• CodeBuild project: sagemaker-pytorch-inference-toolkit-pr
• Commit ID: a93860a
• Result: SUCCEEDED
• Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

[sagemaker-bot]

AWS CodeBuild CI Report

• CodeBuild project: sagemaker-pytorch-inference-toolkit-pr
• Commit ID: 414c83a
• Result: FAILED
• Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

[sagemaker-bot]

AWS CodeBuild CI Report

• CodeBuild project: sagemaker-pytorch-inference-toolkit-pr
• Commit ID: 4b19f3d
• Result: SUCCEEDED
• Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

[davidthomas426]

Quick question. What is the experience like if the user uses a non-TorchScript model because they didn't realize the default model_fn only works for TorchScript models? Is it a clear error message?

[davidthomas426]

Quick question. What is the experience like if the user uses a non-TorchScript model because they didn't realize the default model_fn only works for TorchScript models? Is it a clear error message?

I tried it. It should look something like this:

>>> torch.jit.load('resnet18_state_dict.pt')
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/opt/conda/lib/python3.8/site-packages/torch/jit/_serialization.py", line 161, in load
    cpp_module = torch._C.import_ir_module(cu, str(f), map_location, _extra_files)
RuntimeError: PytorchStreamReader failed locating file constants.pkl: file not found

[davidthomas426]

LGTM

[sagemaker-bot]

AWS CodeBuild CI Report

• CodeBuild project: sagemaker-pytorch-inference-toolkit-pr
• Commit ID: 4729dcc
• Result: SUCCEEDED
• Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository