feature: add model and predictor for HuggingFace #2308

icywang86rui · 2021-04-28T16:36:07Z

Issue #, if available:

Description of changes:

Testing done:

Merge Checklist

Put an x in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your pull request.

General

I have read the CONTRIBUTING doc
I used the commit message format described in CONTRIBUTING
I have passed the region in to all S3 and STS clients that I've initialized as part of this change.
I have updated any necessary documentation, including READMEs and API docs (if appropriate)

Tests

I have added tests that prove my fix is effective or that my feature works (if appropriate)
I have checked that my tests are not configured for a specific region or account (if appropriate)
I have used unique_name_from_base to create resource names in integ tests (if appropriate)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

sagemaker-bot · 2021-04-28T16:38:46Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: ca63a14
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-04-28T17:12:53Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: f0eff66
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-04-28T17:15:11Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: ca63a14
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-04-28T17:19:15Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: ca63a14
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-04-28T17:22:37Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: ca63a14
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-04-28T17:46:30Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: f0eff66
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-04-28T17:50:45Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: f0eff66
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-04-28T17:54:24Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: f0eff66
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-04-28T17:55:34Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: f0eff66
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-03T17:15:36Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 3d32326
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-03T17:49:23Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: 3d32326
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-03T17:57:48Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: 3d32326
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-03T17:59:54Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: 3d32326
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-03T18:13:40Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: 3d32326
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

philschmid · 2021-06-10T16:15:08Z

src/sagemaker/huggingface/model.py

+        serializer=NumpySerializer(),
+        deserializer=NumpyDeserializer(),


NumpySerializer -> JSONSerializer

from sagemaker.serializers import JSONSerializer from sagemaker.deserializers import JSONDeserializer

philschmid · 2021-06-10T16:18:59Z

src/sagemaker/huggingface/model.py

+
+    def __init__(
+        self,
+        model_data,


could this be optional, since we have the option to create an endpoint with model_data.

sagemaker-bot · 2021-06-10T16:49:30Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: ebdd775
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-10T17:13:02Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: ebdd775
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-10T17:14:03Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: ebdd775
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-10T17:21:53Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: ebdd775
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-10T17:25:41Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: ebdd775
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-14T23:01:34Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: b559a3b
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-14T23:27:55Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: b559a3b
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-14T23:29:32Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: b559a3b
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

saimidu · 2021-06-25T18:09:42Z

src/sagemaker/image_uri_config/huggingface.json

+    },
+
+    "inference": {
+        "processors": ["gpu"],


We also have cpu inference images.

Suggested change

"processors": ["gpu"],

"processors": ["cpu", "gpu"],

saimidu · 2021-06-25T18:09:57Z

src/sagemaker/image_uri_config/huggingface.json

+        "versions": {
+            "4.6.1": {
+                "version_aliases": {
+                    "pytorch1.6": "pytorch1.7.1",


Suggested change

"pytorch1.6": "pytorch1.7.1",

"pytorch1.7": "pytorch1.7.1",

sagemaker-bot · 2021-06-25T18:15:21Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 0b4a46c
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-25T18:39:11Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: 0b4a46c
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-25T18:41:45Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: 0b4a46c
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-25T18:45:05Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: 0b4a46c
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-25T18:49:17Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: 0b4a46c
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-29T17:19:19Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 86ca70e
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-29T17:46:00Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: 86ca70e
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-29T17:51:12Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: 86ca70e
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-29T17:55:22Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: 86ca70e
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-29T18:07:27Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: 86ca70e
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-07-01T15:41:37Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: 0dc0e52
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-07-01T15:47:42Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 0dc0e52
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-07-01T16:12:03Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: 0dc0e52
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-07-01T16:13:15Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: 0dc0e52
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-07-01T16:13:47Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: 0dc0e52
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-07-01T17:35:06Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: 992a0e8
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-07-01T17:39:42Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 992a0e8
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-07-01T18:09:36Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: 992a0e8
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-07-01T18:09:43Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: 992a0e8
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-07-01T18:12:26Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: c4f4a03
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-07-01T18:17:44Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: c4f4a03
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-07-01T18:42:01Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: c4f4a03
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-07-01T18:43:15Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: c4f4a03
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-07-01T19:25:04Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: c4f4a03
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

Rui Wang Napieralski and others added 3 commits June 2, 2021 10:37

feature: add model and predictor for HuggingFace

f929baf

reformat

13a3e4d

allow to not provide inference script with HuggingFace model deployment

3d32326

icywang86rui force-pushed the hf-inference branch from f0eff66 to 3d32326 Compare June 3, 2021 17:12

philschmid reviewed Jun 10, 2021

View reviewed changes

make model_data optional

ebdd775

fix empty envvar issue

b559a3b

saimidu reviewed Jun 25, 2021

View reviewed changes

fix image config

86ca70e

Merge branch 'master' into hf-inference

0dc0e52

Merge branch 'master' into hf-inference

992a0e8

Merge branch 'master' into hf-inference

c4f4a03

ahsan-z-khan closed this Jul 7, 2021

		serializer=NumpySerializer(),
		deserializer=NumpyDeserializer(),

feature: add model and predictor for HuggingFace #2308

feature: add model and predictor for HuggingFace #2308

Conversation

icywang86rui commented Apr 28, 2021

Merge Checklist

General

Tests

sagemaker-bot commented Apr 28, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Apr 28, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Apr 28, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Apr 28, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Apr 28, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Apr 28, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Apr 28, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Apr 28, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Apr 28, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Jun 3, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Jun 3, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Jun 3, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Jun 3, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Jun 3, 2021

AWS CodeBuild CI Report

philschmid Jun 10, 2021

Choose a reason for hiding this comment

philschmid Jun 10, 2021

Choose a reason for hiding this comment

sagemaker-bot commented Jun 10, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Jun 10, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Jun 10, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Jun 10, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Jun 10, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Jun 14, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Jun 14, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Jun 14, 2021

AWS CodeBuild CI Report

saimidu Jun 25, 2021

Choose a reason for hiding this comment

saimidu Jun 25, 2021

Choose a reason for hiding this comment

sagemaker-bot commented Jun 25, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Jun 25, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Jun 25, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Jun 25, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Jun 25, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Jun 29, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Jun 29, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Jun 29, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Jun 29, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Jun 29, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Jul 1, 2021