Discussions

• 3 You must be logged in to vote

  🙏

  What does GGML stand for?

  asweigart asked Oct 23, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  What is general.quantization_version in the GGUF spec used for?

  qskousen asked Oct 13, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙌

  start of a port of kyutai's moshi text to speech

  Codes4Fun started Oct 16, 2025 in Show and tell

  

  

  0
• 5 You must be logged in to vote

  🙌

  some notes about how ggml works using the GPT-2 example

  chunhualiao started Jan 29, 2024 in Show and tell

  

  

  

  

  6
• 1 You must be logged in to vote

  🙏

  Get tensor-> data when the tensor's backend is CUDA

  MirkoDeVita98 asked Jul 30, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Clarification on the OP_CPY operation src0->src1

  josemonsalve2 asked Jul 24, 2025 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Removing LLAMA from the AUR's ggml-vulkan build

  mohamadali-halwani asked Jul 20, 2025 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Implicit Q8_1 quantization for matrix multiplications?

  tlemo asked Jul 1, 2025 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Executing neural network using AMX backend

  jkalya asked May 22, 2025 in Q&A · Unanswered

  

  

  7
• 1 You must be logged in to vote

  🙏

  What is the difference between GGML_OP_DUP and GGML_OP_CONT?

  tlemo asked Jun 4, 2025 in Q&A · Answered

  

  

  3
• 1 You must be logged in to vote

  🙏

  Regarding Hardcoded GGML Tensor Name Length Limit (GGML_MAX_NAME)

  Ashot-dor asked May 31, 2025 in Q&A · Unanswered

  

  

  3
• 1 You must be logged in to vote

  🙏

  Broadcast semantics in GGML?

  tlemo asked May 28, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  GGML_OP_ADD1 vs GGML_OP_ADD?

  tlemo asked May 28, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Can you share (or link) the script used to make the mmproj for Scout Vision?

  justinjja asked May 20, 2025 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Question about weight layout

  pshung asked Mar 20, 2025 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  💬

  Question Regarding Operation offload & Graph Split

  akapoor3518 started Mar 12, 2025 in General

  

  

  2
• 1 You must be logged in to vote

  💬

  Calling ggml_view_3d() on quantised tensors possibly causes alignment problems?

  jukofyork started Mar 11, 2025 in General

  

  

  1
• 1 You must be logged in to vote

  🙏

  A general question on developer beginning point

  mmcheraghi asked Feb 21, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  The lifecycle of ggml tensor

  soccercheng asked Feb 11, 2025 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  💬

  GGML Shape & Strides question

  akapoor3518 started Feb 12, 2025 in General

  

  

  0
• 1 You must be logged in to vote

  💬

  Question about unsupported operation by Backend

  akapoor3518 started Feb 4, 2025 in General

  

  

  1
• 1 You must be logged in to vote

  🙏

  Kronecker product of two ggml_tensor: How to?

  stduhpf asked Jan 26, 2025 in Q&A · Answered

  

  

  3
• 1 You must be logged in to vote

  🙏

  What is the best way to support 5d tensor (or even higher dimension)?

  randxie asked Jun 1, 2024 in Q&A · Answered

  

  

  

  

  8
• 1 You must be logged in to vote

  🙏

  Would it be a bad idea to move the static inline functions used in internal asserts to the header file?

  stduhpf asked Jan 20, 2025 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Logits largely different from PyTorch

  lancelotblanchard asked Jan 5, 2025 in Q&A · Unanswered

  

  

  9