Search results

Add support od airllm to mlx - engine

Status: Open.

#237�?In lyogavin/airllm;

· Isaina opened on Oct 5, 2025

ARM Linux distributions

Status: Open.

#236�?In lyogavin/airllm;

· cometta opened on Sep 26, 2025

AttributeError: type object 'AirLLMLlama2' has no attribute '_is_stateful'

Status: Open.

#235�?In lyogavin/airllm;

· JoshuaPK opened on Sep 25, 2025

Support for transformers>=4.50.0?

Status: Open.

#216�?In lyogavin/airllm;

· deep1401 opened on Mar 26, 2025

QvQ-72B support?

Status: Open.

#215�?In lyogavin/airllm;

· carlos-havier opened on Mar 21, 2025

Hardcoded model shard filenames cause file not found error

Status: Open.

#214�?In lyogavin/airllm;

· autonomous1 opened on Mar 9, 2025

Does AirLLM Support Running Quantized Models (e.g., unsloth/Qwen2-72B-bnb-4bit)?

Status: Open.

#213�?In lyogavin/airllm;

· NEWbie0709 opened on Feb 24, 2025

Deepseek?

Status: Open.

#211�?In lyogavin/airllm;

· Mirko185 opened on Jan 29, 2025

How to use CPU inference?

Status: Open.

#210�?In lyogavin/airllm;

· tanbw opened on Jan 25, 2025

should move ‘lm_head’ when splitting Qwen2.5-3B-Instruct

Status: Open.

#209�?In lyogavin/airllm;

· DemonDamon opened on Nov 27, 2024

AttributeError: 'list' object has no attribute 'quant_type'

Status: Open.

#208�?In lyogavin/airllm;

· fallbernana123456 opened on Nov 22, 2024

low vram usage

Status: Open.

#207�?In lyogavin/airllm;

· simonegiuliani opened on Nov 20, 2024