From 2739901c7ac4500f3ffcad9c2f92a27520fae244 Mon Sep 17 00:00:00 2001 From: AhnJoonSung Date: Sat, 20 Sep 2025 16:14:10 +0900 Subject: [PATCH 1/8] docs: ko: video_processors.md --- docs/source/ko/_toctree.yml | 4 +-- docs/source/ko/video_processors.md | 49 ++++++++++++++++++++++++++++++ 2 files changed, 51 insertions(+), 2 deletions(-) create mode 100644 docs/source/ko/video_processors.md diff --git a/docs/source/ko/_toctree.yml b/docs/source/ko/_toctree.yml index 21f26cd66af6..6a78074e1bc6 100644 --- a/docs/source/ko/_toctree.yml +++ b/docs/source/ko/_toctree.yml @@ -31,8 +31,8 @@ title: πŸ€— Tokenizers λΌμ΄λΈŒλŸ¬λ¦¬μ—μ„œ ν† ν¬λ‚˜μ΄μ € μ‚¬μš©ν•˜κΈ° - local: image_processors title: 이미지 ν”„λ‘œμ„Έμ„œ - - local: in_translation - title: (λ²ˆμ—­μ€‘) Video processors + - local: video_processors + title: λΉ„λ””μ˜€ ν”„λ‘œμ„Έμ„œ - local: in_translation title: (λ²ˆμ—­μ€‘) Backbones - local: in_translation diff --git a/docs/source/ko/video_processors.md b/docs/source/ko/video_processors.md new file mode 100644 index 000000000000..4f44914c8cfc --- /dev/null +++ b/docs/source/ko/video_processors.md @@ -0,0 +1,49 @@ + + + +# Video Processor + +A **Video Processor** is a utility responsible for preparing input features for video models, as well as handling the post-processing of their outputs. It provides transformations such as resizing, normalization, and conversion into PyTorch. + +The video processor extends the functionality of image processors by allowing the models to handle videos with a distinct set of arguments compared to images. It serves as the bridge between raw video data and the model, ensuring that input features are optimized for the VLM. + +Use [`~BaseVideoProcessor.from_pretrained`] to load a video processors configuration (image size, whether to normalize and rescale, etc.) from a video model on the Hugging Face [Hub](https://hf.co) or local directory. The configuration for each pretrained model should be saved in a [video_preprocessor_config.json] file but older models might have the config saved in [preprocessor_config.json](https://huggingface.co/llava-hf/llava-onevision-qwen2-0.5b-ov-hf/blob/main/preprocessor_config.json) file. Note that the latter is less preferred and will be removed in the future. + + +### Usage Example +Here's an example of how to load a video processor with [`llava-hf/llava-onevision-qwen2-0.5b-ov-hf`](https://huggingface.co/llava-hf/llava-onevision-qwen2-0.5b-ov-hf) model: + +```python +from transformers import AutoVideoProcessor + +processor = AutoVideoProcessor.from_pretrained("llava-hf/llava-onevision-qwen2-0.5b-ov-hf") +``` + +Currently, if using base image processor for videos, it processes video data by treating each frame as an individual image and applying transformations frame-by-frame. While functional, this approach is not highly efficient. Using `AutoVideoProcessor` allows us to take advantage of **fast video processors**, leveraging the [torchvision](https://pytorch.org/vision/stable/index.html) library. Fast processors handle the whole batch of videos at once, without iterating over each video or frame. These updates introduce GPU acceleration and significantly enhance processing speed, especially for tasks requiring high throughput. + +Fast video processors are available for all models and are loaded by default when an `AutoVideoProcessor` is initialized. When using a fast video processor, you can also set the `device` argument to specify the device on which the processing should be done. By default, the processing is done on the same device as the inputs if the inputs are tensors, or on the CPU otherwise. For even more speed improvement, we can compile the processor when using 'cuda' as device. + +```python +import torch +from transformers.video_utils import load_video +from transformers import AutoVideoProcessor + +video = load_video("video.mp4") +processor = AutoVideoProcessor.from_pretrained("llava-hf/llava-onevision-qwen2-0.5b-ov-hf", device="cuda") +processor = torch.compile(processor) +processed_video = processor(video, return_tensors="pt") +``` From 1d4f6407de04c5274a2d75980b6c5b4d63980bcd Mon Sep 17 00:00:00 2001 From: AhnJoonSung Date: Sat, 20 Sep 2025 16:26:49 +0900 Subject: [PATCH 2/8] feat: nmt draft --- docs/source/ko/video_processors.md | 17 ++++++++--------- 1 file changed, 8 insertions(+), 9 deletions(-) diff --git a/docs/source/ko/video_processors.md b/docs/source/ko/video_processors.md index 4f44914c8cfc..c26ecd658cf1 100644 --- a/docs/source/ko/video_processors.md +++ b/docs/source/ko/video_processors.md @@ -14,18 +14,17 @@ rendered properly in your Markdown viewer. --> +# λΉ„λ””μ˜€ ν”„λ‘œμ„Έμ„œ[[video-processor]] -# Video Processor +**Video Processor**λŠ” λΉ„λ””μ˜€ λͺ¨λΈμ„ μœ„ν•œ μž…λ ₯ νŠΉμ§•μ„ μ€€λΉ„ν•˜κ³ , 좜λ ₯의 ν›„μ²˜λ¦¬λ₯Ό λ‹΄λ‹Ήν•˜λŠ” μœ ν‹Έλ¦¬ν‹°μž…λ‹ˆλ‹€. 크기 μ‘°μ •, μ •κ·œν™”, PyTorch둜의 λ³€ν™˜κ³Ό 같은 λ³€ν™˜μ„ μ œκ³΅ν•©λ‹ˆλ‹€. -A **Video Processor** is a utility responsible for preparing input features for video models, as well as handling the post-processing of their outputs. It provides transformations such as resizing, normalization, and conversion into PyTorch. +λΉ„λ””μ˜€ ν”„λ‘œμ„Έμ„œλŠ” μ΄λ―Έμ§€μ™€λŠ” λ‹€λ₯Έ 인자 μ§‘ν•©μœΌλ‘œ λΉ„λ””μ˜€λ₯Ό μ²˜λ¦¬ν•  수 μžˆλ„λ‘ 이미지 ν”„λ‘œμ„Έμ„œμ˜ κΈ°λŠ₯을 ν™•μž₯ν•©λ‹ˆλ‹€. μ›μ‹œ λΉ„λ””μ˜€ 데이터와 λͺ¨λΈ μ‚¬μ΄μ˜ 닀리 역할을 ν•˜μ—¬ μž…λ ₯ νŠΉμ§•μ΄ VLM에 μ΅œμ ν™”λ˜λ„λ‘ 보μž₯ν•©λ‹ˆλ‹€. -The video processor extends the functionality of image processors by allowing the models to handle videos with a distinct set of arguments compared to images. It serves as the bridge between raw video data and the model, ensuring that input features are optimized for the VLM. +Hugging Face [Hub](https://hf.co) λ˜λŠ” 둜컬 디렉터리에 μžˆλŠ” λΉ„λ””μ˜€ λͺ¨λΈλ‘œλΆ€ν„° λΉ„λ””μ˜€ ν”„λ‘œμ„Έμ„œ ꡬ성(이미지 크기, μ •κ·œν™” 및 λ¦¬μŠ€μΌ€μΌ μ—¬λΆ€ λ“±)을 λ‘œλ“œν•˜λ €λ©΄ [`~BaseVideoProcessor.from_pretrained`]λ₯Ό μ‚¬μš©ν•˜μ„Έμš”. 각 사전 ν•™μŠ΅λœ λͺ¨λΈμ˜ ꡬ성은 [video_preprocessor_config.json] νŒŒμΌμ— μ €μž₯λ˜μ–΄μ•Ό ν•˜μ§€λ§Œ, 이전 λͺ¨λΈμ€ ꡬ성이 [preprocessor_config.json](https://huggingface.co/llava-hf/llava-onevision-qwen2-0.5b-ov-hf/blob/main/preprocessor_config.json) νŒŒμΌμ— μ €μž₯λ˜μ–΄ μžˆμ„ 수 μžˆμŠ΅λ‹ˆλ‹€. ν›„μžλŠ” ꢌμž₯λ˜μ§€ μ•ŠμœΌλ©° ν–₯ν›„ 제거될 μ˜ˆμ •μž…λ‹ˆλ‹€. -Use [`~BaseVideoProcessor.from_pretrained`] to load a video processors configuration (image size, whether to normalize and rescale, etc.) from a video model on the Hugging Face [Hub](https://hf.co) or local directory. The configuration for each pretrained model should be saved in a [video_preprocessor_config.json] file but older models might have the config saved in [preprocessor_config.json](https://huggingface.co/llava-hf/llava-onevision-qwen2-0.5b-ov-hf/blob/main/preprocessor_config.json) file. Note that the latter is less preferred and will be removed in the future. +### μ‚¬μš© μ˜ˆμ‹œ[[usage-example]] - -### Usage Example -Here's an example of how to load a video processor with [`llava-hf/llava-onevision-qwen2-0.5b-ov-hf`](https://huggingface.co/llava-hf/llava-onevision-qwen2-0.5b-ov-hf) model: +λ‹€μŒμ€ [`llava-hf/llava-onevision-qwen2-0.5b-ov-hf`](https://huggingface.co/llava-hf/llava-onevision-qwen2-0.5b-ov-hf) λͺ¨λΈκ³Ό ν•¨κ»˜ λΉ„λ””μ˜€ ν”„λ‘œμ„Έμ„œλ₯Ό λ‘œλ“œν•˜λŠ” μ˜ˆμ‹œμž…λ‹ˆλ‹€: ```python from transformers import AutoVideoProcessor @@ -33,9 +32,9 @@ from transformers import AutoVideoProcessor processor = AutoVideoProcessor.from_pretrained("llava-hf/llava-onevision-qwen2-0.5b-ov-hf") ``` -Currently, if using base image processor for videos, it processes video data by treating each frame as an individual image and applying transformations frame-by-frame. While functional, this approach is not highly efficient. Using `AutoVideoProcessor` allows us to take advantage of **fast video processors**, leveraging the [torchvision](https://pytorch.org/vision/stable/index.html) library. Fast processors handle the whole batch of videos at once, without iterating over each video or frame. These updates introduce GPU acceleration and significantly enhance processing speed, especially for tasks requiring high throughput. +ν˜„μž¬, λΉ„λ””μ˜€μ— κΈ°λ³Έ 이미지 ν”„λ‘œμ„Έμ„œλ₯Ό μ‚¬μš©ν•˜λ©΄, 각 ν”„λ ˆμž„μ„ κ°œλ³„ μ΄λ―Έμ§€λ‘œ κ°„μ£Όν•˜κ³  ν”„λ ˆμž„ λ‹¨μœ„λ‘œ λ³€ν™˜μ„ μ μš©ν•˜μ—¬ λΉ„λ””μ˜€ 데이터λ₯Ό μ²˜λ¦¬ν•©λ‹ˆλ‹€. μ΄λŠ” μΆ©λΆ„νžˆ λ™μž‘μ€ ν•˜μ§€λ§Œ 효율이 λ†’μ§€ μ•ŠμŠ΅λ‹ˆλ‹€. `AutoVideoProcessor`λ₯Ό μ‚¬μš©ν•˜λ©΄ [torchvision](https://pytorch.org/vision/stable/index.html) 라이브러리λ₯Ό ν™œμš©ν•˜λŠ” **fast video processors**의 이점을 λˆ„λ¦΄ 수 μžˆμŠ΅λ‹ˆλ‹€. Fast ν”„λ‘œμ„Έμ„œλŠ” 각 λΉ„λ””μ˜€λ‚˜ ν”„λ ˆμž„μ„ μˆœνšŒν•˜μ§€ μ•Šκ³  λΉ„λ””μ˜€ 배치λ₯Ό ν•œ λ²ˆμ— μ²˜λ¦¬ν•©λ‹ˆλ‹€. μ΄λŸ¬ν•œ κ°œμ„ μ€ GPU 가속을 λ„μž…ν•΄, 특히 높은 μ²˜λ¦¬λŸ‰μ΄ ν•„μš”ν•œ μž‘μ—…μ—μ„œ 처리 속도λ₯Ό 크게 ν–₯μƒμ‹œν‚΅λ‹ˆλ‹€. -Fast video processors are available for all models and are loaded by default when an `AutoVideoProcessor` is initialized. When using a fast video processor, you can also set the `device` argument to specify the device on which the processing should be done. By default, the processing is done on the same device as the inputs if the inputs are tensors, or on the CPU otherwise. For even more speed improvement, we can compile the processor when using 'cuda' as device. +Fast video processorsλŠ” λͺ¨λ“  λͺ¨λΈμ—μ„œ μ‚¬μš©ν•  수 있으며 `AutoVideoProcessor`λ₯Ό μ΄ˆκΈ°ν™”ν•˜λ©΄ 기본으둜 λ‘œλ“œλ©λ‹ˆλ‹€. Fast video processorsλ₯Ό μ‚¬μš©ν•  λ•ŒλŠ” 처리 λŒ€μƒ λ””λ°”μ΄μŠ€λ₯Ό μ§€μ •ν•˜κΈ° μœ„ν•΄ `device` 인자λ₯Ό μ„€μ •ν•  μˆ˜λ„ μžˆμŠ΅λ‹ˆλ‹€. μž…λ ₯이 ν…μ„œλΌλ©΄ 기본적으둜 μž…λ ₯κ³Ό λ™μΌν•œ λ””λ°”μ΄μŠ€ ν˜Ήμ€ CPUμ—μ„œ μ²˜λ¦¬κ°€ μˆ˜ν–‰λ©λ‹ˆλ‹€. 좔가적인 속도 ν–₯상을 μœ„ν•΄ λ””λ°”μ΄μŠ€λ‘œ 'cuda'λ₯Ό μ‚¬μš©ν•  λ•Œ ν”„λ‘œμ„Έμ„œλ₯Ό μ»΄νŒŒμΌν•  수 μžˆμŠ΅λ‹ˆλ‹€. ```python import torch From b20620c70f892676fac1cd8e516d476be7cbbd00 Mon Sep 17 00:00:00 2001 From: AhnJoonSung Date: Sat, 20 Sep 2025 17:04:32 +0900 Subject: [PATCH 3/8] fix: manual edits --- docs/source/ko/video_processors.md | 10 +++++----- 1 file changed, 5 insertions(+), 5 deletions(-) diff --git a/docs/source/ko/video_processors.md b/docs/source/ko/video_processors.md index c26ecd658cf1..9cb5c8eb2421 100644 --- a/docs/source/ko/video_processors.md +++ b/docs/source/ko/video_processors.md @@ -16,11 +16,11 @@ rendered properly in your Markdown viewer. # λΉ„λ””μ˜€ ν”„λ‘œμ„Έμ„œ[[video-processor]] -**Video Processor**λŠ” λΉ„λ””μ˜€ λͺ¨λΈμ„ μœ„ν•œ μž…λ ₯ νŠΉμ§•μ„ μ€€λΉ„ν•˜κ³ , 좜λ ₯의 ν›„μ²˜λ¦¬λ₯Ό λ‹΄λ‹Ήν•˜λŠ” μœ ν‹Έλ¦¬ν‹°μž…λ‹ˆλ‹€. 크기 μ‘°μ •, μ •κ·œν™”, PyTorch둜의 λ³€ν™˜κ³Ό 같은 λ³€ν™˜μ„ μ œκ³΅ν•©λ‹ˆλ‹€. +**Video Processor**λŠ” λΉ„λ””μ˜€ λͺ¨λΈμ˜ μž…λ ₯으둜 μ‚¬μš©λ  νŠΉμ§•κ°’λ“€μ„ μ€€λΉ„ν•˜κ³ , λͺ¨λΈ 좜λ ₯의 ν›„μ²˜λ¦¬λ₯Ό μ§€μ›ν•˜λŠ” μœ ν‹Έλ¦¬ν‹°μž…λ‹ˆλ‹€. 크기 μ‘°μ •, μ •κ·œν™”, PyTorch ν…μ„œ λ³€ν™˜ λ“±μ˜ κΈ°λŠ₯을 μ œκ³΅ν•©λ‹ˆλ‹€. -λΉ„λ””μ˜€ ν”„λ‘œμ„Έμ„œλŠ” μ΄λ―Έμ§€μ™€λŠ” λ‹€λ₯Έ 인자 μ§‘ν•©μœΌλ‘œ λΉ„λ””μ˜€λ₯Ό μ²˜λ¦¬ν•  수 μžˆλ„λ‘ 이미지 ν”„λ‘œμ„Έμ„œμ˜ κΈ°λŠ₯을 ν™•μž₯ν•©λ‹ˆλ‹€. μ›μ‹œ λΉ„λ””μ˜€ 데이터와 λͺ¨λΈ μ‚¬μ΄μ˜ 닀리 역할을 ν•˜μ—¬ μž…λ ₯ νŠΉμ§•μ΄ VLM에 μ΅œμ ν™”λ˜λ„λ‘ 보μž₯ν•©λ‹ˆλ‹€. +λΉ„λ””μ˜€ ν”„λ‘œμ„Έμ„œλŠ” 이미지 ν”„λ‘œμ„Έμ„œμ˜ κΈ°λŠ₯을 ν™•μž₯ν•˜μ—¬, λͺ¨λΈμ΄ μ˜μƒμ„ μ²˜λ¦¬ν•  λ•Œ μ΄λ―Έμ§€μ™€λŠ” κ΅¬λ³„λ˜λŠ” λ³„λ„μ˜ 인자λ₯Ό μ‚¬μš©ν•  수 μžˆλ„λ‘ ν•©λ‹ˆλ‹€. λ˜ν•œ 원본 λΉ„λ””μ˜€ 데이터와 λͺ¨λΈ μ‚¬μ΄μ˜ 닀리 역할을 ν•˜λ©°, μž…λ ₯ νŠΉμ§•κ°’λ“€μ΄ VLM에 μ΅œμ ν™”λ˜λ„λ‘ 보μž₯ν•©λ‹ˆλ‹€. -Hugging Face [Hub](https://hf.co) λ˜λŠ” 둜컬 디렉터리에 μžˆλŠ” λΉ„λ””μ˜€ λͺ¨λΈλ‘œλΆ€ν„° λΉ„λ””μ˜€ ν”„λ‘œμ„Έμ„œ ꡬ성(이미지 크기, μ •κ·œν™” 및 λ¦¬μŠ€μΌ€μΌ μ—¬λΆ€ λ“±)을 λ‘œλ“œν•˜λ €λ©΄ [`~BaseVideoProcessor.from_pretrained`]λ₯Ό μ‚¬μš©ν•˜μ„Έμš”. 각 사전 ν•™μŠ΅λœ λͺ¨λΈμ˜ ꡬ성은 [video_preprocessor_config.json] νŒŒμΌμ— μ €μž₯λ˜μ–΄μ•Ό ν•˜μ§€λ§Œ, 이전 λͺ¨λΈμ€ ꡬ성이 [preprocessor_config.json](https://huggingface.co/llava-hf/llava-onevision-qwen2-0.5b-ov-hf/blob/main/preprocessor_config.json) νŒŒμΌμ— μ €μž₯λ˜μ–΄ μžˆμ„ 수 μžˆμŠ΅λ‹ˆλ‹€. ν›„μžλŠ” ꢌμž₯λ˜μ§€ μ•ŠμœΌλ©° ν–₯ν›„ 제거될 μ˜ˆμ •μž…λ‹ˆλ‹€. +[`~BaseVideoProcessor.from_pretrained`]λ₯Ό μ‚¬μš©ν•˜λ©΄ Hugging Face [Hub](https://hf.co) λ˜λŠ” 둜컬 디렉토리에 μžˆλŠ” λΉ„λ””μ˜€ λͺ¨λΈλ‘œλΆ€ν„° λΉ„λ””μ˜€ ν”„λ‘œμ„Έμ„œ μ„€μ •(이미지 크기, μ •κ·œν™” 및 λ¦¬μŠ€μΌ€μΌ μ—¬λΆ€ λ“±)을 뢈러올 수 μžˆμŠ΅λ‹ˆλ‹€. 각 사전 ν•™μŠ΅λœ λͺ¨λΈμ˜ 섀정은 [video_preprocessor_config.json] νŒŒμΌμ— μ €μž₯λ˜μ–΄μ•Ό ν•˜μ§€λ§Œ, 일뢀 였래된 λͺ¨λΈμ˜ 경우 [preprocessor_config.json](https://huggingface.co/llava-hf/llava-onevision-qwen2-0.5b-ov-hf/blob/main/preprocessor_config.json) νŒŒμΌμ— μ €μž₯λ˜μ–΄ μžˆμ„ μˆ˜λ„ μžˆμŠ΅λ‹ˆλ‹€. ν›„μžμ˜ κ²½μš°λŠ” ꢌμž₯λ˜μ§€ μ•ŠμœΌλ©° ν–₯ν›„ 제거될 μ˜ˆμ •μž…λ‹ˆλ‹€. ### μ‚¬μš© μ˜ˆμ‹œ[[usage-example]] @@ -32,9 +32,9 @@ from transformers import AutoVideoProcessor processor = AutoVideoProcessor.from_pretrained("llava-hf/llava-onevision-qwen2-0.5b-ov-hf") ``` -ν˜„μž¬, λΉ„λ””μ˜€μ— κΈ°λ³Έ 이미지 ν”„λ‘œμ„Έμ„œλ₯Ό μ‚¬μš©ν•˜λ©΄, 각 ν”„λ ˆμž„μ„ κ°œλ³„ μ΄λ―Έμ§€λ‘œ κ°„μ£Όν•˜κ³  ν”„λ ˆμž„ λ‹¨μœ„λ‘œ λ³€ν™˜μ„ μ μš©ν•˜μ—¬ λΉ„λ””μ˜€ 데이터λ₯Ό μ²˜λ¦¬ν•©λ‹ˆλ‹€. μ΄λŠ” μΆ©λΆ„νžˆ λ™μž‘μ€ ν•˜μ§€λ§Œ 효율이 λ†’μ§€ μ•ŠμŠ΅λ‹ˆλ‹€. `AutoVideoProcessor`λ₯Ό μ‚¬μš©ν•˜λ©΄ [torchvision](https://pytorch.org/vision/stable/index.html) 라이브러리λ₯Ό ν™œμš©ν•˜λŠ” **fast video processors**의 이점을 λˆ„λ¦΄ 수 μžˆμŠ΅λ‹ˆλ‹€. Fast ν”„λ‘œμ„Έμ„œλŠ” 각 λΉ„λ””μ˜€λ‚˜ ν”„λ ˆμž„μ„ μˆœνšŒν•˜μ§€ μ•Šκ³  λΉ„λ””μ˜€ 배치λ₯Ό ν•œ λ²ˆμ— μ²˜λ¦¬ν•©λ‹ˆλ‹€. μ΄λŸ¬ν•œ κ°œμ„ μ€ GPU 가속을 λ„μž…ν•΄, 특히 높은 μ²˜λ¦¬λŸ‰μ΄ ν•„μš”ν•œ μž‘μ—…μ—μ„œ 처리 속도λ₯Ό 크게 ν–₯μƒμ‹œν‚΅λ‹ˆλ‹€. +ν˜„μž¬ λΉ„λ””μ˜€μ— κΈ°λ³Έ 이미지 ν”„λ‘œμ„Έμ„œλ₯Ό μ‚¬μš©ν•  경우, λΉ„λ””μ˜€ 데이터λ₯Ό 각 ν”„λ ˆμž„λ§ˆλ‹€ κ°œλ³„ μ΄λ―Έμ§€λ‘œ μ²˜λ¦¬ν•˜μ—¬ λ³€ν™˜μ„ μ μš©ν•©λ‹ˆλ‹€. 이 방식은 μΆ©λΆ„νžˆ λ™μž‘ν•˜κΈ΄ ν•˜μ§€λ§Œ νš¨μœ¨μ„±μ΄ λ†’μ§€ μ•ŠμŠ΅λ‹ˆλ‹€. 이 λŒ€μ‹  `AutoVideoProcessor`λ₯Ό μ‚¬μš©ν•˜λ©΄ [torchvision](https://pytorch.org/vision/stable/index.html) 라이브러리λ₯Ό ν™œμš©ν•œ **fast video processors**의 이점을 λˆ„λ¦΄ 수 μžˆμŠ΅λ‹ˆλ‹€. Fast ν”„λ‘œμ„Έμ„œλŠ” 각 λΉ„λ””μ˜€λ‚˜ ν”„λ ˆμž„μ„ ν•˜λ‚˜μ”© μ²˜λ¦¬ν•˜μ§€ μ•Šκ³ , 전체 λΉ„λ””μ˜€ 배치λ₯Ό ν•œ λ²ˆμ— μ²˜λ¦¬ν•©λ‹ˆλ‹€. μ΄λŠ” GPU 가속을 λ„μž…ν•˜λ©°, 특히 높은 μ²˜λ¦¬λŸ‰μ΄ ν•„μš”ν•œ μž‘μ—…μ—μ„œ 처리 속도λ₯Ό 크게 ν–₯μƒμ‹œν‚΅λ‹ˆλ‹€. -Fast video processorsλŠ” λͺ¨λ“  λͺ¨λΈμ—μ„œ μ‚¬μš©ν•  수 있으며 `AutoVideoProcessor`λ₯Ό μ΄ˆκΈ°ν™”ν•˜λ©΄ 기본으둜 λ‘œλ“œλ©λ‹ˆλ‹€. Fast video processorsλ₯Ό μ‚¬μš©ν•  λ•ŒλŠ” 처리 λŒ€μƒ λ””λ°”μ΄μŠ€λ₯Ό μ§€μ •ν•˜κΈ° μœ„ν•΄ `device` 인자λ₯Ό μ„€μ •ν•  μˆ˜λ„ μžˆμŠ΅λ‹ˆλ‹€. μž…λ ₯이 ν…μ„œλΌλ©΄ 기본적으둜 μž…λ ₯κ³Ό λ™μΌν•œ λ””λ°”μ΄μŠ€ ν˜Ήμ€ CPUμ—μ„œ μ²˜λ¦¬κ°€ μˆ˜ν–‰λ©λ‹ˆλ‹€. 좔가적인 속도 ν–₯상을 μœ„ν•΄ λ””λ°”μ΄μŠ€λ‘œ 'cuda'λ₯Ό μ‚¬μš©ν•  λ•Œ ν”„λ‘œμ„Έμ„œλ₯Ό μ»΄νŒŒμΌν•  수 μžˆμŠ΅λ‹ˆλ‹€. +Fast video processorsλŠ” λͺ¨λ“  λͺ¨λΈμ—μ„œ μ‚¬μš©ν•  수 있으며 `AutoVideoProcessor`κ°€ μ΄ˆκΈ°ν™”λ  λ•Œ 같이 λ‘œλ“œλ©λ‹ˆλ‹€. Fast video processorsλ₯Ό μ‚¬μš©ν•  λ•ŒλŠ” `device` 인자λ₯Ό μ„€μ •ν•˜μ—¬ μ–΄λ–€ μž₯μΉ˜μ—μ„œ 처리λ₯Ό μˆ˜ν–‰ν• μ§€ μ§€μ •ν•  수 μžˆμŠ΅λ‹ˆλ‹€. ν…μ„œλ₯Ό μž…λ ₯으둜 ν•˜λŠ” 경우, 기본적으둜 μž…λ ₯κ³Ό λ™μΌν•œ μž₯μΉ˜μ—μ„œ 처리되며, κ·Έλ ‡μ§€ μ•Šμ€ 경우 CPUμ—μ„œ μ²˜λ¦¬λ©λ‹ˆλ‹€. μž₯치둜 'cuda'λ₯Ό μ‚¬μš©ν•˜λŠ” 경우, 좔가적인 속도 ν–₯상을 μœ„ν•΄ ν”„λ‘œμ„Έμ„œλ₯Ό μ»΄νŒŒμΌν•˜μ—¬ μ‚¬μš©ν•  수 μžˆμŠ΅λ‹ˆλ‹€. ```python import torch From cb7137778db934f8bc593a30c5ba7f7def4671fe Mon Sep 17 00:00:00 2001 From: AhnJoonSung Date: Sat, 20 Sep 2025 17:21:56 +0900 Subject: [PATCH 4/8] fix: spelling --- docs/source/ko/video_processors.md | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/docs/source/ko/video_processors.md b/docs/source/ko/video_processors.md index 9cb5c8eb2421..535cd4dda950 100644 --- a/docs/source/ko/video_processors.md +++ b/docs/source/ko/video_processors.md @@ -16,11 +16,11 @@ rendered properly in your Markdown viewer. # λΉ„λ””μ˜€ ν”„λ‘œμ„Έμ„œ[[video-processor]] -**Video Processor**λŠ” λΉ„λ””μ˜€ λͺ¨λΈμ˜ μž…λ ₯으둜 μ‚¬μš©λ  νŠΉμ§•κ°’λ“€μ„ μ€€λΉ„ν•˜κ³ , λͺ¨λΈ 좜λ ₯의 ν›„μ²˜λ¦¬λ₯Ό μ§€μ›ν•˜λŠ” μœ ν‹Έλ¦¬ν‹°μž…λ‹ˆλ‹€. 크기 μ‘°μ •, μ •κ·œν™”, PyTorch ν…μ„œ λ³€ν™˜ λ“±μ˜ κΈ°λŠ₯을 μ œκ³΅ν•©λ‹ˆλ‹€. +**Video Processor**λŠ” λΉ„λ””μ˜€ λͺ¨λΈμ˜ μž…λ ₯으둜 μ‚¬μš©λ  νŠΉμ§• 값듀을 μ€€λΉ„ν•˜κ³ , λͺ¨λΈ 좜λ ₯의 ν›„μ²˜λ¦¬λ₯Ό μ§€μ›ν•˜λŠ” μœ ν‹Έλ¦¬ν‹°μž…λ‹ˆλ‹€. 크기 μ‘°μ •, μ •κ·œν™”, PyTorch ν…μ„œ λ³€ν™˜ λ“±μ˜ κΈ°λŠ₯을 μ œκ³΅ν•©λ‹ˆλ‹€. -λΉ„λ””μ˜€ ν”„λ‘œμ„Έμ„œλŠ” 이미지 ν”„λ‘œμ„Έμ„œμ˜ κΈ°λŠ₯을 ν™•μž₯ν•˜μ—¬, λͺ¨λΈμ΄ μ˜μƒμ„ μ²˜λ¦¬ν•  λ•Œ μ΄λ―Έμ§€μ™€λŠ” κ΅¬λ³„λ˜λŠ” λ³„λ„μ˜ 인자λ₯Ό μ‚¬μš©ν•  수 μžˆλ„λ‘ ν•©λ‹ˆλ‹€. λ˜ν•œ 원본 λΉ„λ””μ˜€ 데이터와 λͺ¨λΈ μ‚¬μ΄μ˜ 닀리 역할을 ν•˜λ©°, μž…λ ₯ νŠΉμ§•κ°’λ“€μ΄ VLM에 μ΅œμ ν™”λ˜λ„λ‘ 보μž₯ν•©λ‹ˆλ‹€. +λΉ„λ””μ˜€ ν”„λ‘œμ„Έμ„œλŠ” 이미지 ν”„λ‘œμ„Έμ„œμ˜ κΈ°λŠ₯을 ν™•μž₯ν•˜μ—¬, λͺ¨λΈμ΄ μ˜μƒμ„ μ²˜λ¦¬ν•  λ•Œ μ΄λ―Έμ§€μ™€λŠ” κ΅¬λ³„λ˜λŠ” λ³„λ„μ˜ 인자λ₯Ό μ‚¬μš©ν•  수 μžˆλ„λ‘ ν•©λ‹ˆλ‹€. λ˜ν•œ 원본 λΉ„λ””μ˜€ 데이터와 λͺ¨λΈ μ‚¬μ΄μ˜ 닀리 역할을 ν•˜λ©°, μž…λ ₯ νŠΉμ§• 값듀이 VLM에 μ΅œμ ν™”λ˜λ„λ‘ 보μž₯ν•©λ‹ˆλ‹€. -[`~BaseVideoProcessor.from_pretrained`]λ₯Ό μ‚¬μš©ν•˜λ©΄ Hugging Face [Hub](https://hf.co) λ˜λŠ” 둜컬 디렉토리에 μžˆλŠ” λΉ„λ””μ˜€ λͺ¨λΈλ‘œλΆ€ν„° λΉ„λ””μ˜€ ν”„λ‘œμ„Έμ„œ μ„€μ •(이미지 크기, μ •κ·œν™” 및 λ¦¬μŠ€μΌ€μΌ μ—¬λΆ€ λ“±)을 뢈러올 수 μžˆμŠ΅λ‹ˆλ‹€. 각 사전 ν•™μŠ΅λœ λͺ¨λΈμ˜ 섀정은 [video_preprocessor_config.json] νŒŒμΌμ— μ €μž₯λ˜μ–΄μ•Ό ν•˜μ§€λ§Œ, 일뢀 였래된 λͺ¨λΈμ˜ 경우 [preprocessor_config.json](https://huggingface.co/llava-hf/llava-onevision-qwen2-0.5b-ov-hf/blob/main/preprocessor_config.json) νŒŒμΌμ— μ €μž₯λ˜μ–΄ μžˆμ„ μˆ˜λ„ μžˆμŠ΅λ‹ˆλ‹€. ν›„μžμ˜ κ²½μš°λŠ” ꢌμž₯λ˜μ§€ μ•ŠμœΌλ©° ν–₯ν›„ 제거될 μ˜ˆμ •μž…λ‹ˆλ‹€. +[`~BaseVideoProcessor.from_pretrained`]λ₯Ό μ‚¬μš©ν•˜λ©΄ Hugging Face [Hub](https://hf.co) λ˜λŠ” 둜컬 디렉터리에 μžˆλŠ” λΉ„λ””μ˜€ λͺ¨λΈλ‘œλΆ€ν„° λΉ„λ””μ˜€ ν”„λ‘œμ„Έμ„œ μ„€μ •(이미지 크기, μ •κ·œν™” 및 λ¦¬μŠ€μΌ€μΌ μ—¬λΆ€ λ“±)을 뢈러올 수 μžˆμŠ΅λ‹ˆλ‹€. 각 사전 ν•™μŠ΅λœ λͺ¨λΈμ˜ 섀정은 [video_preprocessor_config.json] νŒŒμΌμ— μ €μž₯λ˜μ–΄μ•Ό ν•˜μ§€λ§Œ, 일뢀 였래된 λͺ¨λΈμ˜ 경우 [preprocessor_config.json](https://huggingface.co/llava-hf/llava-onevision-qwen2-0.5b-ov-hf/blob/main/preprocessor_config.json) νŒŒμΌμ— μ €μž₯λ˜μ–΄ μžˆμ„ μˆ˜λ„ μžˆμŠ΅λ‹ˆλ‹€. ν›„μžμ˜ κ²½μš°λŠ” ꢌμž₯λ˜μ§€ μ•ŠμœΌλ©° ν–₯ν›„ 제거될 μ˜ˆμ •μž…λ‹ˆλ‹€. ### μ‚¬μš© μ˜ˆμ‹œ[[usage-example]] @@ -32,7 +32,7 @@ from transformers import AutoVideoProcessor processor = AutoVideoProcessor.from_pretrained("llava-hf/llava-onevision-qwen2-0.5b-ov-hf") ``` -ν˜„μž¬ λΉ„λ””μ˜€μ— κΈ°λ³Έ 이미지 ν”„λ‘œμ„Έμ„œλ₯Ό μ‚¬μš©ν•  경우, λΉ„λ””μ˜€ 데이터λ₯Ό 각 ν”„λ ˆμž„λ§ˆλ‹€ κ°œλ³„ μ΄λ―Έμ§€λ‘œ μ²˜λ¦¬ν•˜μ—¬ λ³€ν™˜μ„ μ μš©ν•©λ‹ˆλ‹€. 이 방식은 μΆ©λΆ„νžˆ λ™μž‘ν•˜κΈ΄ ν•˜μ§€λ§Œ νš¨μœ¨μ„±μ΄ λ†’μ§€ μ•ŠμŠ΅λ‹ˆλ‹€. 이 λŒ€μ‹  `AutoVideoProcessor`λ₯Ό μ‚¬μš©ν•˜λ©΄ [torchvision](https://pytorch.org/vision/stable/index.html) 라이브러리λ₯Ό ν™œμš©ν•œ **fast video processors**의 이점을 λˆ„λ¦΄ 수 μžˆμŠ΅λ‹ˆλ‹€. Fast ν”„λ‘œμ„Έμ„œλŠ” 각 λΉ„λ””μ˜€λ‚˜ ν”„λ ˆμž„μ„ ν•˜λ‚˜μ”© μ²˜λ¦¬ν•˜μ§€ μ•Šκ³ , 전체 λΉ„λ””μ˜€ 배치λ₯Ό ν•œ λ²ˆμ— μ²˜λ¦¬ν•©λ‹ˆλ‹€. μ΄λŠ” GPU 가속을 λ„μž…ν•˜λ©°, 특히 높은 μ²˜λ¦¬λŸ‰μ΄ ν•„μš”ν•œ μž‘μ—…μ—μ„œ 처리 속도λ₯Ό 크게 ν–₯μƒμ‹œν‚΅λ‹ˆλ‹€. +ν˜„μž¬ λΉ„λ””μ˜€μ— κΈ°λ³Έ 이미지 ν”„λ‘œμ„Έμ„œλ₯Ό μ‚¬μš©ν•  경우, λΉ„λ””μ˜€ 데이터λ₯Ό 각 ν”„λ ˆμž„λ§ˆλ‹€ κ°œλ³„ μ΄λ―Έμ§€λ‘œ μ²˜λ¦¬ν•˜μ—¬ λ³€ν™˜μ„ μ μš©ν•©λ‹ˆλ‹€. 이 방식도 μΆ©λΆ„νžˆ λ™μž‘ν•˜κΈ΄ ν•˜μ§€λ§Œ 효율이 μ’‹μ§€ μ•ŠμŠ΅λ‹ˆλ‹€. 이 λŒ€μ‹  `AutoVideoProcessor`λ₯Ό μ‚¬μš©ν•˜λ©΄ [torchvision](https://pytorch.org/vision/stable/index.html) 라이브러리λ₯Ό ν™œμš©ν•œ **fast video processors**의 이점을 λˆ„λ¦΄ 수 μžˆμŠ΅λ‹ˆλ‹€. Fast ν”„λ‘œμ„Έμ„œλŠ” 각 λΉ„λ””μ˜€λ‚˜ ν”„λ ˆμž„μ„ ν•˜λ‚˜μ”© μ²˜λ¦¬ν•˜μ§€ μ•Šκ³ , 전체 λΉ„λ””μ˜€ 배치λ₯Ό ν•œ λ²ˆμ— μ²˜λ¦¬ν•©λ‹ˆλ‹€. μ΄λŠ” GPU 가속을 λ„μž…ν•˜λ©°, 특히 높은 μ²˜λ¦¬λŸ‰μ΄ ν•„μš”ν•œ μž‘μ—…μ—μ„œ 처리 속도λ₯Ό 크게 ν–₯μƒμ‹œν‚΅λ‹ˆλ‹€. Fast video processorsλŠ” λͺ¨λ“  λͺ¨λΈμ—μ„œ μ‚¬μš©ν•  수 있으며 `AutoVideoProcessor`κ°€ μ΄ˆκΈ°ν™”λ  λ•Œ 같이 λ‘œλ“œλ©λ‹ˆλ‹€. Fast video processorsλ₯Ό μ‚¬μš©ν•  λ•ŒλŠ” `device` 인자λ₯Ό μ„€μ •ν•˜μ—¬ μ–΄λ–€ μž₯μΉ˜μ—μ„œ 처리λ₯Ό μˆ˜ν–‰ν• μ§€ μ§€μ •ν•  수 μžˆμŠ΅λ‹ˆλ‹€. ν…μ„œλ₯Ό μž…λ ₯으둜 ν•˜λŠ” 경우, 기본적으둜 μž…λ ₯κ³Ό λ™μΌν•œ μž₯μΉ˜μ—μ„œ 처리되며, κ·Έλ ‡μ§€ μ•Šμ€ 경우 CPUμ—μ„œ μ²˜λ¦¬λ©λ‹ˆλ‹€. μž₯치둜 'cuda'λ₯Ό μ‚¬μš©ν•˜λŠ” 경우, 좔가적인 속도 ν–₯상을 μœ„ν•΄ ν”„λ‘œμ„Έμ„œλ₯Ό μ»΄νŒŒμΌν•˜μ—¬ μ‚¬μš©ν•  수 μžˆμŠ΅λ‹ˆλ‹€. From 0852d10b11a67997ff4cdf2bd38d0df957fc80a6 Mon Sep 17 00:00:00 2001 From: AhnJoonSung Date: Thu, 9 Oct 2025 17:44:01 +0900 Subject: [PATCH 5/8] fix: Use original terms and refine awkward expressions --- docs/source/ko/video_processors.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/docs/source/ko/video_processors.md b/docs/source/ko/video_processors.md index 535cd4dda950..0a7d1fe1f8b1 100644 --- a/docs/source/ko/video_processors.md +++ b/docs/source/ko/video_processors.md @@ -18,7 +18,7 @@ rendered properly in your Markdown viewer. **Video Processor**λŠ” λΉ„λ””μ˜€ λͺ¨λΈμ˜ μž…λ ₯으둜 μ‚¬μš©λ  νŠΉμ§• 값듀을 μ€€λΉ„ν•˜κ³ , λͺ¨λΈ 좜λ ₯의 ν›„μ²˜λ¦¬λ₯Ό μ§€μ›ν•˜λŠ” μœ ν‹Έλ¦¬ν‹°μž…λ‹ˆλ‹€. 크기 μ‘°μ •, μ •κ·œν™”, PyTorch ν…μ„œ λ³€ν™˜ λ“±μ˜ κΈ°λŠ₯을 μ œκ³΅ν•©λ‹ˆλ‹€. -λΉ„λ””μ˜€ ν”„λ‘œμ„Έμ„œλŠ” 이미지 ν”„λ‘œμ„Έμ„œμ˜ κΈ°λŠ₯을 ν™•μž₯ν•˜μ—¬, λͺ¨λΈμ΄ μ˜μƒμ„ μ²˜λ¦¬ν•  λ•Œ μ΄λ―Έμ§€μ™€λŠ” κ΅¬λ³„λ˜λŠ” λ³„λ„μ˜ 인자λ₯Ό μ‚¬μš©ν•  수 μžˆλ„λ‘ ν•©λ‹ˆλ‹€. λ˜ν•œ 원본 λΉ„λ””μ˜€ 데이터와 λͺ¨λΈ μ‚¬μ΄μ˜ 닀리 역할을 ν•˜λ©°, μž…λ ₯ νŠΉμ§• 값듀이 VLM에 μ΅œμ ν™”λ˜λ„λ‘ 보μž₯ν•©λ‹ˆλ‹€. +λΉ„λ””μ˜€ ν”„λ‘œμ„Έμ„œλŠ” 이미지 ν”„λ‘œμ„Έμ„œμ˜ κΈ°λŠ₯을 ν™•μž₯ν•˜μ—¬, λͺ¨λΈμ΄ μ˜μƒμ„ μ²˜λ¦¬ν•  λ•Œ μ΄λ―Έμ§€μ™€λŠ” κ΅¬λ³„λ˜λŠ” λ³„λ„μ˜ 인수λ₯Ό μ‚¬μš©ν•  수 μžˆλ„λ‘ ν•©λ‹ˆλ‹€. λ˜ν•œ 원본 λΉ„λ””μ˜€ 데이터와 λͺ¨λΈ 사이λ₯Ό μ—°κ²°ν•˜λŠ” 역할을 ν•˜λ©°, μž…λ ₯ νŠΉμ§• 값듀이 VLM에 μ΅œμ ν™”λ˜λ„λ‘ 보μž₯ν•©λ‹ˆλ‹€. [`~BaseVideoProcessor.from_pretrained`]λ₯Ό μ‚¬μš©ν•˜λ©΄ Hugging Face [Hub](https://hf.co) λ˜λŠ” 둜컬 디렉터리에 μžˆλŠ” λΉ„λ””μ˜€ λͺ¨λΈλ‘œλΆ€ν„° λΉ„λ””μ˜€ ν”„λ‘œμ„Έμ„œ μ„€μ •(이미지 크기, μ •κ·œν™” 및 λ¦¬μŠ€μΌ€μΌ μ—¬λΆ€ λ“±)을 뢈러올 수 μžˆμŠ΅λ‹ˆλ‹€. 각 사전 ν•™μŠ΅λœ λͺ¨λΈμ˜ 섀정은 [video_preprocessor_config.json] νŒŒμΌμ— μ €μž₯λ˜μ–΄μ•Ό ν•˜μ§€λ§Œ, 일뢀 였래된 λͺ¨λΈμ˜ 경우 [preprocessor_config.json](https://huggingface.co/llava-hf/llava-onevision-qwen2-0.5b-ov-hf/blob/main/preprocessor_config.json) νŒŒμΌμ— μ €μž₯λ˜μ–΄ μžˆμ„ μˆ˜λ„ μžˆμŠ΅λ‹ˆλ‹€. ν›„μžμ˜ κ²½μš°λŠ” ꢌμž₯λ˜μ§€ μ•ŠμœΌλ©° ν–₯ν›„ 제거될 μ˜ˆμ •μž…λ‹ˆλ‹€. @@ -32,9 +32,9 @@ from transformers import AutoVideoProcessor processor = AutoVideoProcessor.from_pretrained("llava-hf/llava-onevision-qwen2-0.5b-ov-hf") ``` -ν˜„μž¬ λΉ„λ””μ˜€μ— κΈ°λ³Έ 이미지 ν”„λ‘œμ„Έμ„œλ₯Ό μ‚¬μš©ν•  경우, λΉ„λ””μ˜€ 데이터λ₯Ό 각 ν”„λ ˆμž„λ§ˆλ‹€ κ°œλ³„ μ΄λ―Έμ§€λ‘œ μ²˜λ¦¬ν•˜μ—¬ λ³€ν™˜μ„ μ μš©ν•©λ‹ˆλ‹€. 이 방식도 μΆ©λΆ„νžˆ λ™μž‘ν•˜κΈ΄ ν•˜μ§€λ§Œ 효율이 μ’‹μ§€ μ•ŠμŠ΅λ‹ˆλ‹€. 이 λŒ€μ‹  `AutoVideoProcessor`λ₯Ό μ‚¬μš©ν•˜λ©΄ [torchvision](https://pytorch.org/vision/stable/index.html) 라이브러리λ₯Ό ν™œμš©ν•œ **fast video processors**의 이점을 λˆ„λ¦΄ 수 μžˆμŠ΅λ‹ˆλ‹€. Fast ν”„λ‘œμ„Έμ„œλŠ” 각 λΉ„λ””μ˜€λ‚˜ ν”„λ ˆμž„μ„ ν•˜λ‚˜μ”© μ²˜λ¦¬ν•˜μ§€ μ•Šκ³ , 전체 λΉ„λ””μ˜€ 배치λ₯Ό ν•œ λ²ˆμ— μ²˜λ¦¬ν•©λ‹ˆλ‹€. μ΄λŠ” GPU 가속을 λ„μž…ν•˜λ©°, 특히 높은 μ²˜λ¦¬λŸ‰μ΄ ν•„μš”ν•œ μž‘μ—…μ—μ„œ 처리 속도λ₯Ό 크게 ν–₯μƒμ‹œν‚΅λ‹ˆλ‹€. +ν˜„μž¬ λΉ„λ””μ˜€μ— κΈ°λ³Έ 이미지 ν”„λ‘œμ„Έμ„œλ₯Ό μ‚¬μš©ν•  경우, λΉ„λ””μ˜€ 데이터λ₯Ό 각 ν”„λ ˆμž„λ§ˆλ‹€ κ°œλ³„ μ΄λ―Έμ§€λ‘œ μ²˜λ¦¬ν•˜μ—¬ λ³€ν™˜μ„ μ μš©ν•©λ‹ˆλ‹€. 이 방식도 잘 λ™μž‘ν•˜κΈ΄ ν•˜μ§€λ§Œ 효율이 μ’‹μ§€ μ•ŠμŠ΅λ‹ˆλ‹€. 이 λŒ€μ‹  `AutoVideoProcessor`λ₯Ό μ‚¬μš©ν•˜λ©΄ [torchvision](https://pytorch.org/vision/stable/index.html) 라이브러리λ₯Ό ν™œμš©ν•œ **fast video processors**의 이점을 λˆ„λ¦΄ 수 μžˆμŠ΅λ‹ˆλ‹€. Fast processorsλŠ” 각 λΉ„λ””μ˜€λ‚˜ ν”„λ ˆμž„μ„ ν•˜λ‚˜μ”© μ²˜λ¦¬ν•˜μ§€ μ•Šκ³ , 전체 λΉ„λ””μ˜€ 배치λ₯Ό ν•œ λ²ˆμ— μ²˜λ¦¬ν•©λ‹ˆλ‹€. μ΄λŠ” GPU 가속을 λ„μž…ν•˜λ©°, 특히 높은 μ²˜λ¦¬λŸ‰μ΄ ν•„μš”ν•œ μž‘μ—…μ—μ„œ 처리 속도λ₯Ό 크게 ν–₯μƒμ‹œν‚΅λ‹ˆλ‹€. -Fast video processorsλŠ” λͺ¨λ“  λͺ¨λΈμ—μ„œ μ‚¬μš©ν•  수 있으며 `AutoVideoProcessor`κ°€ μ΄ˆκΈ°ν™”λ  λ•Œ 같이 λ‘œλ“œλ©λ‹ˆλ‹€. Fast video processorsλ₯Ό μ‚¬μš©ν•  λ•ŒλŠ” `device` 인자λ₯Ό μ„€μ •ν•˜μ—¬ μ–΄λ–€ μž₯μΉ˜μ—μ„œ 처리λ₯Ό μˆ˜ν–‰ν• μ§€ μ§€μ •ν•  수 μžˆμŠ΅λ‹ˆλ‹€. ν…μ„œλ₯Ό μž…λ ₯으둜 ν•˜λŠ” 경우, 기본적으둜 μž…λ ₯κ³Ό λ™μΌν•œ μž₯μΉ˜μ—μ„œ 처리되며, κ·Έλ ‡μ§€ μ•Šμ€ 경우 CPUμ—μ„œ μ²˜λ¦¬λ©λ‹ˆλ‹€. μž₯치둜 'cuda'λ₯Ό μ‚¬μš©ν•˜λŠ” 경우, 좔가적인 속도 ν–₯상을 μœ„ν•΄ ν”„λ‘œμ„Έμ„œλ₯Ό μ»΄νŒŒμΌν•˜μ—¬ μ‚¬μš©ν•  수 μžˆμŠ΅λ‹ˆλ‹€. +Fast video processorsλŠ” λͺ¨λ“  λͺ¨λΈμ—μ„œ μ‚¬μš©ν•  수 있으며 `AutoVideoProcessor`κ°€ μ΄ˆκΈ°ν™”λ  λ•Œ 같이 λ‘œλ“œλ©λ‹ˆλ‹€. Fast video processorsλ₯Ό μ‚¬μš©ν•  λ•ŒλŠ” `device` 인수λ₯Ό μ„€μ •ν•˜μ—¬ μ–΄λ–€ μž₯μΉ˜μ—μ„œ 처리λ₯Ό μˆ˜ν–‰ν• μ§€ μ§€μ •ν•  수 μžˆμŠ΅λ‹ˆλ‹€. ν…μ„œλ₯Ό μž…λ ₯으둜 ν•˜λŠ” 경우, 기본적으둜 μž…λ ₯κ³Ό λ™μΌν•œ μž₯μΉ˜μ—μ„œ 처리되며, κ·Έλ ‡μ§€ μ•Šμ€ 경우 CPUμ—μ„œ μ²˜λ¦¬λ©λ‹ˆλ‹€. μž₯치둜 'cuda'λ₯Ό μ‚¬μš©ν•˜λŠ” 경우, 좔가적인 속도 ν–₯상을 μœ„ν•΄ ν”„λ‘œμ„Έμ„œλ₯Ό μ»΄νŒŒμΌν•˜μ—¬ μ‚¬μš©ν•  수 μžˆμŠ΅λ‹ˆλ‹€. ```python import torch From ba6cf456dd7616c152f360b583881d33011737c1 Mon Sep 17 00:00:00 2001 From: AhnJoonSung Date: Thu, 9 Oct 2025 17:47:06 +0900 Subject: [PATCH 6/8] fix: Align with glossary terminology --- docs/source/ko/video_processors.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/docs/source/ko/video_processors.md b/docs/source/ko/video_processors.md index 0a7d1fe1f8b1..d77401e29131 100644 --- a/docs/source/ko/video_processors.md +++ b/docs/source/ko/video_processors.md @@ -16,9 +16,9 @@ rendered properly in your Markdown viewer. # λΉ„λ””μ˜€ ν”„λ‘œμ„Έμ„œ[[video-processor]] -**Video Processor**λŠ” λΉ„λ””μ˜€ λͺ¨λΈμ˜ μž…λ ₯으둜 μ‚¬μš©λ  νŠΉμ§• 값듀을 μ€€λΉ„ν•˜κ³ , λͺ¨λΈ 좜λ ₯의 ν›„μ²˜λ¦¬λ₯Ό μ§€μ›ν•˜λŠ” μœ ν‹Έλ¦¬ν‹°μž…λ‹ˆλ‹€. 크기 μ‘°μ •, μ •κ·œν™”, PyTorch ν…μ„œ λ³€ν™˜ λ“±μ˜ κΈ°λŠ₯을 μ œκ³΅ν•©λ‹ˆλ‹€. +**Video Processor**λŠ” λΉ„λ””μ˜€ λͺ¨λΈμ˜ μž…λ ₯으둜 μ‚¬μš©λ  νŠΉμ„± 값듀을 μ€€λΉ„ν•˜κ³ , λͺ¨λΈ 좜λ ₯의 ν›„μ²˜λ¦¬λ₯Ό μ§€μ›ν•˜λŠ” μœ ν‹Έλ¦¬ν‹°μž…λ‹ˆλ‹€. 크기 μ‘°μ •, μ •κ·œν™”, PyTorch ν…μ„œ λ³€ν™˜ λ“±μ˜ κΈ°λŠ₯을 μ œκ³΅ν•©λ‹ˆλ‹€. -λΉ„λ””μ˜€ ν”„λ‘œμ„Έμ„œλŠ” 이미지 ν”„λ‘œμ„Έμ„œμ˜ κΈ°λŠ₯을 ν™•μž₯ν•˜μ—¬, λͺ¨λΈμ΄ μ˜μƒμ„ μ²˜λ¦¬ν•  λ•Œ μ΄λ―Έμ§€μ™€λŠ” κ΅¬λ³„λ˜λŠ” λ³„λ„μ˜ 인수λ₯Ό μ‚¬μš©ν•  수 μžˆλ„λ‘ ν•©λ‹ˆλ‹€. λ˜ν•œ 원본 λΉ„λ””μ˜€ 데이터와 λͺ¨λΈ 사이λ₯Ό μ—°κ²°ν•˜λŠ” 역할을 ν•˜λ©°, μž…λ ₯ νŠΉμ§• 값듀이 VLM에 μ΅œμ ν™”λ˜λ„λ‘ 보μž₯ν•©λ‹ˆλ‹€. +λΉ„λ””μ˜€ ν”„λ‘œμ„Έμ„œλŠ” 이미지 ν”„λ‘œμ„Έμ„œμ˜ κΈ°λŠ₯을 ν™•μž₯ν•˜μ—¬, λͺ¨λΈμ΄ μ˜μƒμ„ μ²˜λ¦¬ν•  λ•Œ μ΄λ―Έμ§€μ™€λŠ” κ΅¬λ³„λ˜λŠ” λ³„λ„μ˜ 인수λ₯Ό μ‚¬μš©ν•  수 μžˆλ„λ‘ ν•©λ‹ˆλ‹€. λ˜ν•œ 원본 λΉ„λ””μ˜€ 데이터와 λͺ¨λΈ 사이λ₯Ό μ—°κ²°ν•˜λŠ” 역할을 ν•˜λ©°, μž…λ ₯ νŠΉμ„± 값듀이 VLM에 μ΅œμ ν™”λ˜λ„λ‘ 보μž₯ν•©λ‹ˆλ‹€. [`~BaseVideoProcessor.from_pretrained`]λ₯Ό μ‚¬μš©ν•˜λ©΄ Hugging Face [Hub](https://hf.co) λ˜λŠ” 둜컬 디렉터리에 μžˆλŠ” λΉ„λ””μ˜€ λͺ¨λΈλ‘œλΆ€ν„° λΉ„λ””μ˜€ ν”„λ‘œμ„Έμ„œ μ„€μ •(이미지 크기, μ •κ·œν™” 및 λ¦¬μŠ€μΌ€μΌ μ—¬λΆ€ λ“±)을 뢈러올 수 μžˆμŠ΅λ‹ˆλ‹€. 각 사전 ν•™μŠ΅λœ λͺ¨λΈμ˜ 섀정은 [video_preprocessor_config.json] νŒŒμΌμ— μ €μž₯λ˜μ–΄μ•Ό ν•˜μ§€λ§Œ, 일뢀 였래된 λͺ¨λΈμ˜ 경우 [preprocessor_config.json](https://huggingface.co/llava-hf/llava-onevision-qwen2-0.5b-ov-hf/blob/main/preprocessor_config.json) νŒŒμΌμ— μ €μž₯λ˜μ–΄ μžˆμ„ μˆ˜λ„ μžˆμŠ΅λ‹ˆλ‹€. ν›„μžμ˜ κ²½μš°λŠ” ꢌμž₯λ˜μ§€ μ•ŠμœΌλ©° ν–₯ν›„ 제거될 μ˜ˆμ •μž…λ‹ˆλ‹€. From e3bdb0ed7ac496ef433562fbf7cfc045f6716eae Mon Sep 17 00:00:00 2001 From: AhnJoonSung Date: Fri, 10 Oct 2025 09:24:12 +0900 Subject: [PATCH 7/8] fix: Make sentence more natural --- docs/source/ko/video_processors.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/source/ko/video_processors.md b/docs/source/ko/video_processors.md index d77401e29131..b13636fa38ed 100644 --- a/docs/source/ko/video_processors.md +++ b/docs/source/ko/video_processors.md @@ -32,7 +32,7 @@ from transformers import AutoVideoProcessor processor = AutoVideoProcessor.from_pretrained("llava-hf/llava-onevision-qwen2-0.5b-ov-hf") ``` -ν˜„μž¬ λΉ„λ””μ˜€μ— κΈ°λ³Έ 이미지 ν”„λ‘œμ„Έμ„œλ₯Ό μ‚¬μš©ν•  경우, λΉ„λ””μ˜€ 데이터λ₯Ό 각 ν”„λ ˆμž„λ§ˆλ‹€ κ°œλ³„ μ΄λ―Έμ§€λ‘œ μ²˜λ¦¬ν•˜μ—¬ λ³€ν™˜μ„ μ μš©ν•©λ‹ˆλ‹€. 이 방식도 잘 λ™μž‘ν•˜κΈ΄ ν•˜μ§€λ§Œ 효율이 μ’‹μ§€ μ•ŠμŠ΅λ‹ˆλ‹€. 이 λŒ€μ‹  `AutoVideoProcessor`λ₯Ό μ‚¬μš©ν•˜λ©΄ [torchvision](https://pytorch.org/vision/stable/index.html) 라이브러리λ₯Ό ν™œμš©ν•œ **fast video processors**의 이점을 λˆ„λ¦΄ 수 μžˆμŠ΅λ‹ˆλ‹€. Fast processorsλŠ” 각 λΉ„λ””μ˜€λ‚˜ ν”„λ ˆμž„μ„ ν•˜λ‚˜μ”© μ²˜λ¦¬ν•˜μ§€ μ•Šκ³ , 전체 λΉ„λ””μ˜€ 배치λ₯Ό ν•œ λ²ˆμ— μ²˜λ¦¬ν•©λ‹ˆλ‹€. μ΄λŠ” GPU 가속을 λ„μž…ν•˜λ©°, 특히 높은 μ²˜λ¦¬λŸ‰μ΄ ν•„μš”ν•œ μž‘μ—…μ—μ„œ 처리 속도λ₯Ό 크게 ν–₯μƒμ‹œν‚΅λ‹ˆλ‹€. +ν˜„μž¬ λΉ„λ””μ˜€μ— κΈ°λ³Έ 이미지 ν”„λ‘œμ„Έμ„œλ₯Ό μ‚¬μš©ν•  경우, λΉ„λ””μ˜€ λ°μ΄ν„°μ˜ 각 ν”„λ ˆμž„μ΄ κ°œλ³„ μ΄λ―Έμ§€λ‘œ μ²˜λ¦¬λ˜μ–΄ λ³€ν™˜μ΄ μ μš©λ©λ‹ˆλ‹€. 이 방식도 잘 λ™μž‘ν•˜κΈ΄ ν•˜μ§€λ§Œ 효율이 μ’‹μ§€ μ•ŠμŠ΅λ‹ˆλ‹€. 이 λŒ€μ‹  `AutoVideoProcessor`λ₯Ό μ‚¬μš©ν•˜λ©΄ [torchvision](https://pytorch.org/vision/stable/index.html) 라이브러리λ₯Ό ν™œμš©ν•œ **fast video processors**의 이점을 λˆ„λ¦΄ 수 μžˆμŠ΅λ‹ˆλ‹€. Fast processorsλŠ” 각 λΉ„λ””μ˜€λ‚˜ ν”„λ ˆμž„μ„ ν•˜λ‚˜μ”© μ²˜λ¦¬ν•˜μ§€ μ•Šκ³ , 전체 λΉ„λ””μ˜€ 배치λ₯Ό ν•œ λ²ˆμ— μ²˜λ¦¬ν•©λ‹ˆλ‹€. μ΄λŠ” GPU 가속을 λ„μž…ν•˜λ©°, 특히 높은 μ²˜λ¦¬λŸ‰μ΄ ν•„μš”ν•œ μž‘μ—…μ—μ„œ 처리 속도λ₯Ό 크게 ν–₯μƒμ‹œν‚΅λ‹ˆλ‹€. Fast video processorsλŠ” λͺ¨λ“  λͺ¨λΈμ—μ„œ μ‚¬μš©ν•  수 있으며 `AutoVideoProcessor`κ°€ μ΄ˆκΈ°ν™”λ  λ•Œ 같이 λ‘œλ“œλ©λ‹ˆλ‹€. Fast video processorsλ₯Ό μ‚¬μš©ν•  λ•ŒλŠ” `device` 인수λ₯Ό μ„€μ •ν•˜μ—¬ μ–΄λ–€ μž₯μΉ˜μ—μ„œ 처리λ₯Ό μˆ˜ν–‰ν• μ§€ μ§€μ •ν•  수 μžˆμŠ΅λ‹ˆλ‹€. ν…μ„œλ₯Ό μž…λ ₯으둜 ν•˜λŠ” 경우, 기본적으둜 μž…λ ₯κ³Ό λ™μΌν•œ μž₯μΉ˜μ—μ„œ 처리되며, κ·Έλ ‡μ§€ μ•Šμ€ 경우 CPUμ—μ„œ μ²˜λ¦¬λ©λ‹ˆλ‹€. μž₯치둜 'cuda'λ₯Ό μ‚¬μš©ν•˜λŠ” 경우, 좔가적인 속도 ν–₯상을 μœ„ν•΄ ν”„λ‘œμ„Έμ„œλ₯Ό μ»΄νŒŒμΌν•˜μ—¬ μ‚¬μš©ν•  수 μžˆμŠ΅λ‹ˆλ‹€. From 003ff7171a9540c0088e28fcae9aedcd48f7c5eb Mon Sep 17 00:00:00 2001 From: AhnJoonSung Date: Sun, 12 Oct 2025 17:01:57 +0900 Subject: [PATCH 8/8] fix: manual edits --- docs/source/ko/video_processors.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/docs/source/ko/video_processors.md b/docs/source/ko/video_processors.md index b13636fa38ed..a71f12b895fe 100644 --- a/docs/source/ko/video_processors.md +++ b/docs/source/ko/video_processors.md @@ -16,15 +16,15 @@ rendered properly in your Markdown viewer. # λΉ„λ””μ˜€ ν”„λ‘œμ„Έμ„œ[[video-processor]] -**Video Processor**λŠ” λΉ„λ””μ˜€ λͺ¨λΈμ˜ μž…λ ₯으둜 μ‚¬μš©λ  νŠΉμ„± 값듀을 μ€€λΉ„ν•˜κ³ , λͺ¨λΈ 좜λ ₯의 ν›„μ²˜λ¦¬λ₯Ό μ§€μ›ν•˜λŠ” μœ ν‹Έλ¦¬ν‹°μž…λ‹ˆλ‹€. 크기 μ‘°μ •, μ •κ·œν™”, PyTorch ν…μ„œ λ³€ν™˜ λ“±μ˜ κΈ°λŠ₯을 μ œκ³΅ν•©λ‹ˆλ‹€. +**λΉ„λ””μ˜€ ν”„λ‘œμ„Έμ„œ(Video Processor)**λŠ” λΉ„λ””μ˜€ λͺ¨λΈμ˜ μž…λ ₯으둜 μ‚¬μš©λ  νŠΉμ„± 값듀을 μ€€λΉ„ν•˜κ³ , λͺ¨λΈ 좜λ ₯의 ν›„μ²˜λ¦¬λ₯Ό μ§€μ›ν•˜λŠ” μœ ν‹Έλ¦¬ν‹°μž…λ‹ˆλ‹€. 크기 μ‘°μ •, μ •κ·œν™”, PyTorch ν…μ„œ λ³€ν™˜ λ“±μ˜ κΈ°λŠ₯을 μ œκ³΅ν•©λ‹ˆλ‹€. -λΉ„λ””μ˜€ ν”„λ‘œμ„Έμ„œλŠ” 이미지 ν”„λ‘œμ„Έμ„œμ˜ κΈ°λŠ₯을 ν™•μž₯ν•˜μ—¬, λͺ¨λΈμ΄ μ˜μƒμ„ μ²˜λ¦¬ν•  λ•Œ μ΄λ―Έμ§€μ™€λŠ” κ΅¬λ³„λ˜λŠ” λ³„λ„μ˜ 인수λ₯Ό μ‚¬μš©ν•  수 μžˆλ„λ‘ ν•©λ‹ˆλ‹€. λ˜ν•œ 원본 λΉ„λ””μ˜€ 데이터와 λͺ¨λΈ 사이λ₯Ό μ—°κ²°ν•˜λŠ” 역할을 ν•˜λ©°, μž…λ ₯ νŠΉμ„± 값듀이 VLM에 μ΅œμ ν™”λ˜λ„λ‘ 보μž₯ν•©λ‹ˆλ‹€. +λΉ„λ””μ˜€ ν”„λ‘œμ„Έμ„œλŠ” 이미지 ν”„λ‘œμ„Έμ„œμ˜ κΈ°λŠ₯을 ν™•μž₯ν•˜μ—¬, λͺ¨λΈμ΄ μ˜μƒμ„ μ²˜λ¦¬ν•  λ•Œ μ΄λ―Έμ§€μ™€λŠ” κ΅¬λ³„λ˜λŠ” λ³„λ„μ˜ 인수λ₯Ό μ‚¬μš©ν•  수 μžˆλ„λ‘ ν•©λ‹ˆλ‹€. λ˜ν•œ 원본 λΉ„λ””μ˜€ 데이터와 λͺ¨λΈ 사이λ₯Ό μ—°κ²°ν•˜λŠ” 역할을 ν•˜λ©°, μž…λ ₯ νŠΉμ„± 값듀이 VLM에 μ΅œμ ν™”λ˜λ„λ‘ 보μž₯ν•©λ‹ˆλ‹€. [`~BaseVideoProcessor.from_pretrained`]λ₯Ό μ‚¬μš©ν•˜λ©΄ Hugging Face [Hub](https://hf.co) λ˜λŠ” 둜컬 디렉터리에 μžˆλŠ” λΉ„λ””μ˜€ λͺ¨λΈλ‘œλΆ€ν„° λΉ„λ””μ˜€ ν”„λ‘œμ„Έμ„œ μ„€μ •(이미지 크기, μ •κ·œν™” 및 λ¦¬μŠ€μΌ€μΌ μ—¬λΆ€ λ“±)을 뢈러올 수 μžˆμŠ΅λ‹ˆλ‹€. 각 사전 ν•™μŠ΅λœ λͺ¨λΈμ˜ 섀정은 [video_preprocessor_config.json] νŒŒμΌμ— μ €μž₯λ˜μ–΄μ•Ό ν•˜μ§€λ§Œ, 일뢀 였래된 λͺ¨λΈμ˜ 경우 [preprocessor_config.json](https://huggingface.co/llava-hf/llava-onevision-qwen2-0.5b-ov-hf/blob/main/preprocessor_config.json) νŒŒμΌμ— μ €μž₯λ˜μ–΄ μžˆμ„ μˆ˜λ„ μžˆμŠ΅λ‹ˆλ‹€. ν›„μžμ˜ κ²½μš°λŠ” ꢌμž₯λ˜μ§€ μ•ŠμœΌλ©° ν–₯ν›„ 제거될 μ˜ˆμ •μž…λ‹ˆλ‹€. ### μ‚¬μš© μ˜ˆμ‹œ[[usage-example]] -λ‹€μŒμ€ [`llava-hf/llava-onevision-qwen2-0.5b-ov-hf`](https://huggingface.co/llava-hf/llava-onevision-qwen2-0.5b-ov-hf) λͺ¨λΈκ³Ό ν•¨κ»˜ λΉ„λ””μ˜€ ν”„λ‘œμ„Έμ„œλ₯Ό λ‘œλ“œν•˜λŠ” μ˜ˆμ‹œμž…λ‹ˆλ‹€: +λ‹€μŒμ€ [`llava-hf/llava-onevision-qwen2-0.5b-ov-hf`](https://huggingface.co/llava-hf/llava-onevision-qwen2-0.5b-ov-hf) λͺ¨λΈκ³Ό ν•¨κ»˜ λΉ„λ””μ˜€ ν”„λ‘œμ„Έμ„œλ₯Ό λ‘œλ“œν•˜λŠ” μ˜ˆμ‹œμž…λ‹ˆλ‹€. ```python from transformers import AutoVideoProcessor