Skip to content

error, Qwen3-Embedding-0.6B" does not support matryoshka representation #188

Description

@zkailinzhang

vllm部署的向量模型,模型官方支持自定义嵌套维度的,怎么报不支持
embedding_model=OpenAITextEmbedding( api_key="", model_name="Qwen3-Embedding-0.6B", base_url="http://xx:8001/v1", ), ``

Error code: 400 - {'object': 'error', 'message': 'Model "Qwen3-Embedding-0.6B" does not support matryoshka representation, changing output dimensions will lead to poor results.', 'type': 'BadRequestError', 'param': None, 'code': 400}
ERROR: Traceback (most recent call last):
File "/home/zhangkailin/.conda/envs/ascope/lib/python3.12/site-packages/starlette/routing.py", line 694, in lifespan
async with self.lifespan_context(app) as maybe_state:
File "/home/zhangkailin/.conda/envs/ascope/lib/python3.12/site-packages/fastapi/routing.py", line 241, in aenter
await self._router._startup()
File "/home/zhangkailin/.conda/envs/ascope/lib/python3.12/site-packages/fastapi/routing.py", line 4884, in _startup
await handler()
File "/appdata/zhangkailin/agent/agentscope-1.0.21/examples/functionality/rag/service_yolo_rag_mil_v2.py", line 167, in startup_event
await init_knowledge()
File "/appdata/zhangkailin/agent/agentscope-1.0.21/examples/functionality/rag/service_yolo_rag_mil_v2.py", line 148, in init_knowledge
await knowledge.add_documents(docs1)
File "/appdata/zhangkailin/agent/agentscope-1.0.21/src/agentscope/rag/_simple_knowledge.py", line 77, in add_documents
res_embeddings = await self.embedding_model(
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/appdata/zhangkailin/agent/agentscope-1.0.21/src/agentscope/embedding/_openai_embedding.py", line 94, in call
response = await self.client.embeddings.create(**kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/zhangkailin/.conda/envs/ascope/lib/python3.12/site-packages/openai/resources/embeddings.py", line 259, in create
return await self._post(
^^^^^^^^^^^^^^^^^
File "/home/zhangkailin/.conda/envs/ascope/lib/python3.12/site-packages/openai/_base_client.py", line 1884, in post
return await self.request(cast_to, opts, stream=stream, stream_cls=stream_cls)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/zhangkailin/.conda/envs/ascope/lib/python3.12/site-packages/openai/_base_client.py", line 1669, in request
raise self._make_status_error_from_response(err.response) from None
openai.BadRequestError: Error code: 400 - {'object': 'error', 'message': 'Model "Qwen3-Embedding-0.6B" does not support matryoshka representation, changing output dimensions will lead to poor results.', 'type': 'BadRequestError', 'param': None, 'code': 400}

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions