Skip to content

Issues: ggml-org/llama.cpp

changelog : libllama API
#9289 opened Sep 3, 2024 by ggerganov
Open 9
changelog : llama-server REST API
#9291 opened Sep 3, 2024 by ggerganov
Open 15
tutorials : list for llama.cpp
#13523 opened May 14, 2025 by ggerganov
Open 3
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
113 Open 864 Closed
113 Open 864 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

opencl: add backend_synchronize ggml changes relating to the ggml tensor library for machine learning
#13939 opened May 31, 2025 by lhez • Draft
vulkan: fix warnings in perf logger querypool code ggml changes relating to the ggml tensor library for machine learning Vulkan Issues specific to the Vulkan backend
#13937 opened May 31, 2025 by jeffbolznv Loading…
1
vulkan: automatically deduce size of push constants ggml changes relating to the ggml tensor library for machine learning Vulkan Issues specific to the Vulkan backend
#13936 opened May 31, 2025 by jeffbolznv Loading…
[CANN]Support Acl Graph ggml changes relating to the ggml tensor library for machine learning
#13915 opened May 30, 2025 by noemotiovon • Draft
ggml-cpu : split arch-specific implementations ggml changes relating to the ggml tensor library for machine learning
#13892 opened May 29, 2025 by xctan Loading…
2
musa: extract ggml_cuda_mul_mat_batched_cublas_gemm_batched_ex ggml changes relating to the ggml tensor library for machine learning Nvidia GPU Issues specific to Nvidia GPUs
#13887 opened May 29, 2025 by yeahdongcn Loading…
3 tasks done
4
sycl: Add reorder to Q6_K mmvq implementation ggml changes relating to the ggml tensor library for machine learning SYCL https://en.wikipedia.org/wiki/SYCL - GPU programming language
#13885 opened May 29, 2025 by s-Nick Loading…
finetune.cpp command-line arg build Compilation issues examples ggml changes relating to the ggml tensor library for machine learning Nvidia GPU Issues specific to Nvidia GPUs testing Everything test related
#13873 opened May 28, 2025 by graehl Loading…
79
musa: enable fp16 mma (all) and cublas on qy2 ggml changes relating to the ggml tensor library for machine learning Nvidia GPU Issues specific to Nvidia GPUs
#13842 opened May 28, 2025 by yeahdongcn Loading…
3 tasks done
9
OpenCL: Add concat, tsembd, upscale, tanh, pad and repeat ggml changes relating to the ggml tensor library for machine learning
#13840 opened May 28, 2025 by rmatif Loading…
9
sycl: quantize and reorder the input to q8_1 when reorder is enabled ggml changes relating to the ggml tensor library for machine learning SYCL https://en.wikipedia.org/wiki/SYCL - GPU programming language
#13826 opened May 27, 2025 by AD2605 Loading…
11
ggml: improve ggml_backend_cuda_cpy_tensor_async ggml changes relating to the ggml tensor library for machine learning Nvidia GPU Issues specific to Nvidia GPUs
#13818 opened May 27, 2025 by koush Loading…
13
ggml-vulkan: adds support for op CONV_TRANSPOSE_1D ggml changes relating to the ggml tensor library for machine learning testing Everything test related Vulkan Issues specific to the Vulkan backend
#13813 opened May 26, 2025 by etasnadi Loading…
27
Add support for VK_EXT_debug_utils to add labels to Vulkan objects. ggml changes relating to the ggml tensor library for machine learning Vulkan Issues specific to the Vulkan backend
#13792 opened May 26, 2025 by mtavenrath Loading…
4
ggml : add ggml_fill() ggml changes relating to the ggml tensor library for machine learning testing Everything test related
#13772 opened May 25, 2025 by ngxson Loading…
9
SYCL: Implement few same quantized type copy kernels ggml changes relating to the ggml tensor library for machine learning SYCL https://en.wikipedia.org/wiki/SYCL - GPU programming language
#13739 opened May 24, 2025 by qnixsynapse • Draft
5
remove templates from soft_max_f32_submitter to allow SYCL graph updates ggml changes relating to the ggml tensor library for machine learning SYCL https://en.wikipedia.org/wiki/SYCL - GPU programming language
#13724 opened May 23, 2025 by lslusarczyk Loading…
8
add GGML_USE_NUMA_MIGRATE feature to optimize cross NUMA op computation examples ggml changes relating to the ggml tensor library for machine learning
#13649 opened May 20, 2025 by wenlujon Loading…
18
cuda: fix CMAKE_CUDA_COMPILER not found error (#13528) ggml changes relating to the ggml tensor library for machine learning Nvidia GPU Issues specific to Nvidia GPUs
#13625 opened May 19, 2025 by lizhenneng Loading…
1
ggml : add memset_tensor for rpc ggml changes relating to the ggml tensor library for machine learning
#13601 opened May 17, 2025 by gkpln3 Loading…
2
ggml : fix race-condition in ggml-rpc ggml changes relating to the ggml tensor library for machine learning
#13600 opened May 17, 2025 by gkpln3 Loading…
12
Granite Four Apple Metal https://en.wikipedia.org/wiki/Metal_(API) examples ggml changes relating to the ggml tensor library for machine learning python python script changes server testing Everything test related
#13550 opened May 14, 2025 by gabe-l-hart • Draft
2 tasks
cuda: set cuda compiler path (#13527) ggml changes relating to the ggml tensor library for machine learning Nvidia GPU Issues specific to Nvidia GPUs
#13528 opened May 14, 2025 by lizhenneng Loading…
3
musa: restore MUSA graph settings in CMakeLists.txt ggml changes relating to the ggml tensor library for machine learning Nvidia GPU Issues specific to Nvidia GPUs
#13382 opened May 8, 2025 by yeahdongcn • Draft
2
llama: Fix typos in multiple files ggml changes relating to the ggml tensor library for machine learning Kompute https://github.com/KomputeProject/kompute/ python python script changes SYCL https://en.wikipedia.org/wiki/SYCL - GPU programming language
#13369 opened May 8, 2025 by co63oc Loading…
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.