Search results

Lorax-launcher version

Status: Open.

#745�?In predibase/lorax;

· neelnj opened on Jan 21, 2025

Add model LGAI-EXAONE/EXAONE

Status: Open.

#743�?In predibase/lorax;

· sadra-barikbin opened on Jan 20, 2025

Getting error with LoRA adapters for Qwen 2.5 0.5B Instruct

Status: Open.

#733�?In predibase/lorax;

· iddogino opened on Jan 9, 2025

Quantization appears to be broken, at least for AWQ and BnB

Status: Open.

#722�?In predibase/lorax;

· codybum opened on Dec 21, 2024

Not able to preload local adapters

Status: Open.

#699�?In predibase/lorax;

· xyang16 opened on Nov 28, 2024

Attention not working properly in FlashRobertaModel and FlashBertModel

Status: Open.

#694�?In predibase/lorax;

· sgiorgis opened on Nov 22, 2024

why prune in mergeStrategy no rescale remaining?

Status: Open.

#685�?In predibase/lorax;

· zhujianwei-ops opened on Nov 19, 2024

Not able to host Llama3.2-11b on Azure A100 80GB server

Status: Open.

#679�?In predibase/lorax;

· alokgupta1996 opened on Nov 13, 2024

Cannot run a FP8 quantized model with LoraX

Status: Open.

#671�?In predibase/lorax;

· Aktsvigun opened on Nov 11, 2024

Throughput and Latency degradation with a single LoRA adapter on A100 40 GB

Status: Open.

#670�?In predibase/lorax;

· kaushikmitr opened on Nov 8, 2024

Multi-responses for a single inference

Status: Open.

#665�?In predibase/lorax;

· mrcchef opened on Nov 5, 2024

Things started failing after new commit into main

Status: Open.

#661�?In predibase/lorax;

· gane5hvarma opened on Oct 30, 2024