Discussions

• 2 You must be logged in to vote

  🙏

  Tool Calling with mlx-community/Meta-Llama-3.1-8B-Instruct-bf16

  Pentar0o asked Nov 20, 2024 in Q&A · Closed · Unanswered

  

  

  

  

  2
• 4 You must be logged in to vote

  📣

  MLX LM has moved!

  awni announced Mar 13, 2025 in Announcements

  

  

  2
• 1 You must be logged in to vote

  🙏

  Adding model for local inference

  elijahrenner asked Apr 7, 2025 in Q&A · Answered

  

  

  7
• 1 You must be logged in to vote

  🙏

  What's the difference between Whisper-Turbo, Whisper-large-v3-turbo, Whisper-large-v3-mlx

  esphoenixc asked Mar 13, 2025 in Q&A · Answered

  

  

  3
• 1 You must be logged in to vote

  🙏

  Llama-3.3-70B-Instruct-4bit LoRA Fine-Tuning: No Change (or Instability) - Adapter Issue?

  corozcop1980 asked Dec 10, 2024 in Q&A · Answered

  

  

  7
• 1 You must be logged in to vote

  💡

  System instructions & pre-fill

  fblissjr started Nov 18, 2024 in Ideas

  

  

  

  

  3
• 1 You must be logged in to vote

  💬

  Full finetune?

  sgt101 started Feb 13, 2025 in General · Closed

  

  

  1
• 1 You must be logged in to vote

  🙏

  Unexpected Processing Times for Short vs. Long Audio Files with MLX-Whisper

  esphoenixc asked Feb 11, 2025 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  💬

  MLX and O1

  threadedblue started Feb 1, 2025 in General · Closed

  

  

  0
• 1 You must be logged in to vote

  🙏

  Long Training Times and GPU Utilization Problem

  meirm asked Jul 2, 2024 in Q&A · Unanswered

  

  

  

  

  4
• 1 You must be logged in to vote

  🙏

  Can key-value caching be used for optimizing batched retrieval of logits from inputs with common prompt prefixes?

  chimezie asked Dec 16, 2024 in Q&A · Answered

  

  

  3
• 1 You must be logged in to vote

  🙏

  Is it possible to continue fine-tuning after the training has been interrupted?

  hschaeufler asked Sep 23, 2024 in Q&A · Answered

  

  

  3
• 1 You must be logged in to vote

  🙏

  Verbatim transcription help: Tokenizer, Crisper Whisper, Prompting

  TinaTe asked Dec 17, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Please help me to understand how mlx gradients flow through the graph

  AndreiChirap asked Nov 17, 2024 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  💡

  PrefixQuant: Static Quantization Beats Dynamic through Prefixed Outliers in LLMs

  joseph777111 started Nov 17, 2024 in Ideas

  

  

  0
• 2 You must be logged in to vote

  🙌

  Nutshell 🐿️ - real time meeting transcriptions powered by MLX-Whisper

  NutshellAI started Nov 7, 2024 in Show and tell

  

  

  0
• 1 You must be logged in to vote

  💬

  iterate_batches and ignoring input tokens when calculating loss during LoRa training

  chimezie started Nov 3, 2024 in General

  

  

  0
• 1 You must be logged in to vote

  💡

  SAGE ATTENTION: 2.1 TIMES FASTER THAN FLASH ATTENTION 2 AND 2.7 TIMES FASTER THAN XFORMERS

  joseph777111 started Oct 15, 2024 in Ideas

  

  

  1
• 1 You must be logged in to vote

  🙏

  training lora flux

  azrahello asked Oct 13, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  Transcription concluded with inaccurate "Yeah" repeated 27x

  nattaylor started Oct 2, 2024 in General

  

  

  2
• 1 You must be logged in to vote

  💬

  Unexpected dramatic inference slow down after a number of LLM queries

  nickludlam started Oct 1, 2024 in General · Closed

  

  

  8
• 2 You must be logged in to vote

  💬

  This project, once production-ready, may be the reason I buy a new Macbook.

  Jonathan-Dobson started Sep 4, 2024 in General

  

  

  0
• 1 You must be logged in to vote

  💬

  Performance tracing and tuning code

  wangkuiyi started Aug 16, 2024 in General

  

  

  0
• 1 You must be logged in to vote

  🙏

  Is there a way to save the training log as a txt file with mlx_lm

  Satyam7166-tech asked Aug 16, 2024 in Q&A · Closed · Answered

  

  

  3
• 14 You must be logged in to vote

  💡

  Adopt SAM2 in MLX and enable ANE support

  Silviu-Preoteasa started Aug 2, 2024 in Ideas

  

  

  1