Issues

• Update llamacpp

  thomasantony/llamacpp-python#29 · Filter by author iaalm opened on Oct 15, 2023

• batch inference?

  thomasantony/llamacpp-python#28 · Filter by author liuxiaohao-xn opened on Jun 8, 2023

• Update for llama.cpp quantization changes

  thomasantony/llamacpp-python#27 · Filter by author s7726 opened on Jun 7, 2023

• unable to convert

  thomasantony/llamacpp-python#24 · Filter by author chaltik opened on May 6, 2023

• Not work

  thomasantony/llamacpp-python#22 · Filter by author lucasjinreal opened on Apr 20, 2023
  1

• how to set customized tokenizer?

  thomasantony/llamacpp-python#21 · Filter by author lucasjinreal opened on Apr 20, 2023

• Segmentation fault for generations larger than ~512 tokens

  thomasantony/llamacpp-python#13 · Filter by author horenbergerb opened on Apr 2, 2023
  4

• Script crash with no output

  thomasantony/llamacpp-python#6 · Filter by author GrahamboJangles opened on Mar 28, 2023
  1

• Clean up llamacpp-chat interface

  enhancement
  thomasantony/llamacpp-python#4 · Filter by author thomasantony opened on Mar 20, 2023
  1

• Better command-line argument parsing for cli.py and chat.py

  enhancementgood first issue
  thomasantony/llamacpp-python#3 · Filter by author thomasantony opened on Mar 20, 2023