Discussions

• 1 You must be logged in to vote

  🙏

  Best model for air-gapped usage?

  MyndSpaceAI asked Oct 29, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  Any lmdeploy version can I delpoy deepseek-R1-awq (w4a16) by turbomind.

  Skyseaee started Jul 15, 2025 in General

  

  

  1
• 1 You must be logged in to vote

  🙏

  TurboMind 如何支持lora部署？未来我们会有计划去支持吗？？

  akai-shuuichi asked Jul 4, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  关于多模态模型推理启用prefix cache

  zhuchen1109 asked Nov 27, 2024 in Q&A · Unanswered

  

  

  

  

  4
• 1 You must be logged in to vote

  🙏

  显存不一样的显卡可以使用张量并行吗？

  lingyezhixing asked Jun 14, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  lmdeploy serve api_server 可以把两个模型部署到同一个端口吗？

  thomZ1 asked Jul 17, 2024 in Q&A · Answered

  

  

  

  

  3
• 1 You must be logged in to vote

  🙏

  Is there a plan to add the TurboMind engine to Qwen 2 VL?

  cuikaiGitHub asked May 16, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💡

  Add support to Video Generation Models.

  KaifAhmad1 started Apr 28, 2025 in Ideas

  

  

  0
• 1 You must be logged in to vote

  🙏

  lmdeploy 支持华为昇腾800I A2吗？InternVL3支持部署在上面吗？

  sduqlsc asked Apr 24, 2025 in Q&A · Answered

  

  

  6
• 1 You must be logged in to vote

  🙌

  Ascend CANN Image Providing

  wxsIcey started Apr 16, 2025 in Show and tell

  

  

  0
• 1 You must be logged in to vote

  🙏

  InternVL Quantization with VisualQ&A Dataset

  Aristarx-Lintter asked Apr 7, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  请问下int4 kvcache在做mma的时候是如何反量化的？

  ZL1206 asked Mar 24, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  💬

  W8A8量化VLM模型，对应的torch_dtype不一致

  zhuchen1109 started Mar 5, 2025 in General

  

  

  0
• 1 You must be logged in to vote

  🙏

  Error 804: forward compatibility was attempted on non supported HW

  Fmstrat asked Jan 13, 2025 in Q&A · Unanswered

  

  

  

  

  8
• 1 You must be logged in to vote

  🙏

  Can't utilize 4 GPU for lmdeploy

  ismailyenigul asked Jan 22, 2025 in Q&A · Unanswered

  

  

  3
• 1 You must be logged in to vote

  💬

  视觉理解模型微调的lora推理不正确的问题

  zhuchen1109 started Jan 8, 2025 in General

  

  

  4
• 1 You must be logged in to vote

  🙏

  LMdeploy支持返回prompt的logprobs？

  CSammyfd asked Dec 27, 2024 in Q&A · Answered

  

  

  

  

  11
• 1 You must be logged in to vote

  🙏

  求问: lmdeploy项目中对于显存管理中显存压缩的代码实现具体是?

  chengjixin asked Dec 23, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  如何改善Qwen2-VL的爆显存现象

  jianliao asked Oct 15, 2024 in Q&A · Answered

  

  

  

  

  5
• 1 You must be logged in to vote

  🙏

  关于 Attention 计算的疑问

  vicety asked Nov 29, 2024 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  💬

  lmdeploy支持DP吗？

  LaoWangGB started Nov 20, 2024 in General

  

  

  4
• 1 You must be logged in to vote

  💬

  请问支持推理qwen2.5的模型吗？

  lai-serena started Nov 22, 2024 in General

  

  

  1
• 1 You must be logged in to vote

  🙏

  How to specify to use flash-atten instead of flash-atten2 (GPU is v100)

  huangwei907781034 asked Nov 21, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  LMDeploy AWQ

  sitabulaixizawaluduo asked Nov 20, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  关于 iterator_sm70 文件中 copy 函数调用的作用

  vicety asked Nov 13, 2024 in Q&A · Answered

  

  

  1