Search results

ggml-cpu: Build variant targeting Neoverse-V2

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Status: Open (in progress).

ggml-org/llama.cppnumber 14380

#14380 In ggml-org/llama.cpp;

· ckastner opened on Jun 25, 2025

vulkan: handle noncontig in the final case of ggml_vk_get_cpy_pipeline

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

VulkanIssues specific to the Vulkan backendIssues specific to the Vulkan backend

Status: Open (in progress).

ggml-org/llama.cppnumber 14378

#14378 In ggml-org/llama.cpp;

· jeffbolznv opened on Jun 25, 2025

Q2k interleaving implementation - x86/x64 SIMD

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Status: Open (in progress).

ggml-org/llama.cppnumber 14373

#14373 In ggml-org/llama.cpp;

· Srihari-mcw opened on Jun 25, 2025

vulkan: Add fusion support for RMS_NORM+MUL

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

testingEverything test relatedEverything test related

VulkanIssues specific to the Vulkan backendIssues specific to the Vulkan backend

Status: Draft (not ready).

ggml-org/llama.cppnumber 14366

#14366 In ggml-org/llama.cpp;

· jeffbolznv opened on Jun 24, 2025

ggml : add pointer to attach user data

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Status: Open (in progress).

ggml-org/llama.cppnumber 14365

#14365 In ggml-org/llama.cpp;

· koush opened on Jun 24, 2025

llama : add high-throughput mode

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

examples

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Status: Draft (not ready).

ggml-org/llama.cppnumber 14363

#14363 In ggml-org/llama.cpp;

· ggerganov opened on Jun 24, 2025

CUDA: add bf16 and f32 support to cublas_mul_mat_batched

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

testingEverything test relatedEverything test related

Status: Open (in progress).

ggml-org/llama.cppnumber 14361

#14361 In ggml-org/llama.cpp;

· am17an opened on Jun 24, 2025

vulkan: Increase workgroup size for GLU, for performance

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

VulkanIssues specific to the Vulkan backendIssues specific to the Vulkan backend

Status: Open (in progress).

ggml-org/llama.cppnumber 14345

#14345 In ggml-org/llama.cpp;

· jeffbolznv opened on Jun 23, 2025

vulkan: lock accesses of pinned_memory vector

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

VulkanIssues specific to the Vulkan backendIssues specific to the Vulkan backend

Status: Open (in progress).

ggml-org/llama.cppnumber 14333

#14333 In ggml-org/llama.cpp;

· jeffbolznv opened on Jun 22, 2025

ggml-cpu: Pass on tag_name to the feature scoring

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Status: Open (in progress).

ggml-org/llama.cppnumber 14332

#14332 In ggml-org/llama.cpp;

· ckastner opened on Jun 22, 2025

Conv2D: Add CPU version

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Status: Draft (not ready).

ggml-org/llama.cppnumber 14320

#14320 In ggml-org/llama.cpp;

· am17an opened on Jun 21, 2025

ggml-cpu: enable IBM NNPA Vector Intrinsics

documentationImprovements or additions to documentationImprovements or additions to documentation

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Status: Open (in progress).

ggml-org/llama.cppnumber 14317

#14317 In ggml-org/llama.cpp;

· taronaeo opened on Jun 21, 2025