We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 7589142 commit 309c2daCopy full SHA for 309c2da
comps/llms/text-generation/vllm-xft/run.sh
@@ -3,7 +3,9 @@
3
# Copyright (C) 2024 Intel Corporation
4
# SPDX-License-Identifier: Apache-2.0
5
6
-# Preload libiomp5.so by following cmd or LD_PRELOAD=libiomp5.so manually
+# Preloading libiomp5.so is essential for optimal performance.
7
+# libiomp5.so is the Intel OpenMP runtime library, providing parallel computation support,
8
+# thread management, task scheduling, and performance optimization on Intel X86 platforms.
9
export $(python -c 'import xfastertransformer as xft; print(xft.get_env())')
10
11
# convert the model to fastertransformer format
0 commit comments