Skip to content

Issues: ggml-org/llama.cpp

changelog : libllama API
#9289 opened Sep 3, 2024 by ggerganov
Open 9
changelog : llama-server REST API
#9291 opened Sep 3, 2024 by ggerganov
Open 15
tutorials : list for llama.cpp
#13523 opened May 14, 2025 by ggerganov
Open 3
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
57 Open 445 Closed
57 Open 445 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

server : pad small embedding batches examples server
#13692 opened May 21, 2025 by ggerganov Loading…
1
GGML_ASSERT(seq_id < n_tokens && "seq_id cannot be larger than n_tokens with pooling_type == MEAN") failed bug Something isn't working embeddings embedding related topics server
#13689 opened May 21, 2025 by slaren
1
7
webui: Allow editing file attachments when editing messages. examples server
#13645 opened May 20, 2025 by nauful Loading…
mtmd : add ultravox audio input documentation Improvements or additions to documentation examples python python script changes server
#13623 opened May 18, 2025 by ngxson Loading…
7
server : separate the notion of position and KV tokens, remove prompt truncation breaking change Changes that break ABIs, APIs, file formats, or other forms of backwards compatibility. examples python python script changes server
#13576 opened May 15, 2025 by ngxson Loading…
24
Update python verions examples python python script changes server
#13574 opened May 15, 2025 by robbiemu Loading…
30
webui: Add editing assistant messages (#11849) examples server
#13522 opened May 14, 2025 by lr1729 Loading…
1
feat(server): Add tool call support to WebUI (LLama Server) examples server
#13501 opened May 13, 2025 by samolego Loading…
38
Webui dynamic config examples server
#13429 opened May 10, 2025 by ServeurpersoCom Loading…
8
Break down main function in llama-server examples server
#13425 opened May 10, 2025 by ericcurtin Loading…
2
server : PoC implementation of "interim" server examples server
#13400 opened May 9, 2025 by ngxson • Draft
3
Support start strings, the opposite of stop tokens. examples python python script changes server
#13214 opened Apr 30, 2025 by matteoserva • Draft
16
Support jinja extra template kwargs (Qwen3 enable_thinking feature), from command line and from client examples server
#13196 opened Apr 29, 2025 by matteoserva Loading…
1
24
set b = ub when b > ub with embedding examples server
#12940 opened Apr 14, 2025 by ahmedshakill Loading…
1
server : crash when -b > -ub with embeddings bug Something isn't working embeddings embedding related topics good first issue Good for newcomers server
#12836 opened Apr 8, 2025 by ggerganov
3
WIP: Add support for CogAgent examples python python script changes server
#12679 opened Mar 31, 2025 by Tianyue-Zhao • Draft
llama-server : implement universal assisted decoding examples server
#12635 opened Mar 28, 2025 by g2mt Loading…
1
server: streaming of tool calls and thoughts when --jinja is on documentation Improvements or additions to documentation examples python python script changes script Script related server testing Everything test related tool calling
#12379 opened Mar 14, 2025 by ochafik • Draft
5 of 10 tasks
1
44
server : improve infill stop criteria examples server
#12333 opened Mar 11, 2025 by ggerganov • Draft
tool-call: Phi-4 support android Issues specific to Android Apple Metal https://en.wikipedia.org/wiki/Metal_(API) devops improvements to build systems and github actions documentation Improvements or additions to documentation examples ggml changes relating to the ggml tensor library for machine learning Nvidia GPU Issues specific to Nvidia GPUs python python script changes server SYCL https://en.wikipedia.org/wiki/SYCL - GPU programming language testing Everything test related Vulkan Issues specific to the Vulkan backend
#12288 opened Mar 9, 2025 by jpohhhh Loading…
19
Server: openai-style lookup decoding examples python python script changes server
#12127 opened Mar 1, 2025 by eeroel • Draft
Cache based tokenization for the server input prompts demo Demonstrate some concept or idea, not intended to be merged examples server
#12067 opened Feb 25, 2025 by vnicolici Loading…
3
server webui easy config selection demo Demonstrate some concept or idea, not intended to be merged examples server
#12031 opened Feb 22, 2025 by poulphunter Loading…
10
llama : add llama_batch_ext android Issues specific to Android examples python python script changes server
#11875 opened Feb 14, 2025 by ngxson Loading…
1
89
server (webui): Fix issue with muliple <think> tags in response examples server
#11779 opened Feb 10, 2025 by stduhpf Loading…
8
ProTip! Updated in the last three days: updated:>2025-05-18.