Skip to content

Commit 71cb6bd

Browse files
committed
Update model loading path for task router and suppress logs in launchable notebook
1 parent dcfa7db commit 71cb6bd

2 files changed

Lines changed: 3 additions & 3 deletions

File tree

customize/router-builder/task-router/task-router.ipynb

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -430,7 +430,7 @@
430430
"tokenizer = AutoTokenizer.from_pretrained(\"nvidia/prompt-task-and-complexity-classifier\")\n",
431431
"\n",
432432
"# Load the traced model\n",
433-
"wrapped_model = torch.jit.load('prompt_classifier_traced.pt')\n",
433+
"wrapped_model = torch.jit.load('triton_template/task_router/1/model.pt')\n",
434434
"wrapped_model.eval()\n",
435435
"\n",
436436
"# Prepare a sample input\n",

launchable/1_Deploy_LLM_Router.ipynb

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -478,7 +478,7 @@
478478
"metadata": {},
479479
"outputs": [],
480480
"source": [
481-
"!cd .. && make up"
481+
"!cd .. && make up > /dev/null 2>&1"
482482
]
483483
},
484484
{
@@ -789,7 +789,7 @@
789789
"metadata": {},
790790
"outputs": [],
791791
"source": [
792-
"!cd .. && make app"
792+
"!cd .. && make app > /dev/null 2>&1"
793793
]
794794
},
795795
{

0 commit comments

Comments
 (0)