Fix to https://huggingface.co/tiny-random/glm-5/discussions/1
#2
by nikita-savelyev-cerebras - opened
Set index_head_dim to 128 as in the original model config https://huggingface.co/zai-org/GLM-5/blob/main/config.json#L18
yujiepan changed pull request status to merged