Prerequisites
Feature Description
GLM 4.6 marks the layer.nextn.shared_head_head and layer.nextn.embed_tokens tensors as not required, which prevents the model from loading with the error llama_model_load: error loading model: missing tensor 'blk.92.nextn.embed_tokens.weight'.
Motivation
Adds GLM 4.6 support and allows it to load.
Possible Implementation
A simple change to the code is needed to mark the tensors as not required, allowing the model to load. See here:
ggml-org/llama.cpp#16359
Prerequisites
Feature Description
GLM 4.6 marks the
layer.nextn.shared_head_headandlayer.nextn.embed_tokenstensors as not required, which prevents the model from loading with the errorllama_model_load: error loading model: missing tensor 'blk.92.nextn.embed_tokens.weight'.Motivation
Adds GLM 4.6 support and allows it to load.
Possible Implementation
A simple change to the code is needed to mark the tensors as not required, allowing the model to load. See here:
ggml-org/llama.cpp#16359