IST Austria Distributed Algorithms and Systems Lab

university

https://ist.ac.at/en/research/alistarh-group/

https://github.com/IST-DASLab

AI & ML interests

None defined yet.

Recent Activity

softmax authored a paper 29 days ago

WUSH: Near-Optimal Adaptive Transforms for LLM Quantization

BlackSamorez new activity about 1 month ago

ISTA-DASLab/Meta-Llama-3.1-70B-Instruct-AQLM-PV-2Bit-1x16:VLLM error

SpiridonSunRotator updated a model about 1 month ago

ISTA-DASLab/Kimi-K2-Thinking-GPTQ-2b-32g-experts

View all activity

Papers

WUSH: Near-Optimal Adaptive Transforms for LLM Quantization

CAGE: Curvature-Aware Gradient Estimation For Accurate Quantization-Aware Training

View all Papers

ISTA-DASLab 's models 146

ISTA-DASLab/Llama-2-7b-AQLM-1Bit-1x8-hf

1B • Updated Mar 20 • 33 • 1

ISTA-DASLab/gemma-3-27b-it-GPTQ-4b-128g

Image-Text-to-Text • 5B • Updated Mar 20 • 11k • 43

ISTA-DASLab/QuEST-800M-INT4

Text Generation • Updated Feb 19

ISTA-DASLab/QuEST-800M-INT1

ISTA-DASLab/QuEST-800M-sparse-INT4

ISTA-DASLab/DeepSeek-R1-Distill-Qwen-14B-HIGGS-4bit

Text Generation • 5B • Updated Feb 14 • 9

ISTA-DASLab/DeepSeek-R1-HIGGS-4bit

182B • Updated Feb 14 • 9

ISTA-DASLab/DeepSeek-R1-Distill-Qwen-32B-HIGGS-4bit

Text Generation • 9B • Updated Feb 14 • 9

ISTA-DASLab/DeepSeek-R1-Distill-Llama-70B-HIGGS-4bit

Text Generation • 19B • Updated Feb 12 • 7

ISTA-DASLab/QuEST-800M-BF16

ISTA-DASLab/Llama-3.3-70B-Instruct-HIGGS-GPTQ-4bit

19B • Updated Dec 12, 2024 • 15 • 7

ISTA-DASLab/Llama-3.1-8B-HIGGS-GPTQ-4bit

Text Generation • 3B • Updated Dec 10, 2024 • 8

ISTA-DASLab/Llama-3.1-8B-HIGGS-GPTQ-3bit

Text Generation • 2B • Updated Dec 10, 2024 • 11

ISTA-DASLab/Llama-3.1-8B-Instruct-HIGGS-GPTQ-3bit

Text Generation • 2B • Updated Dec 10, 2024 • 8

ISTA-DASLab/Llama-3.1-8B-Instruct-HIGGS-GPTQ-4bit

Text Generation • 3B • Updated Dec 10, 2024 • 8

ISTA-DASLab/Llama-3.3-70B-Instruct-HIGGS-4bit

Text Generation • 19B • Updated Dec 9, 2024 • 7 • 3

ISTA-DASLab/Llama-3.3-70B-Instruct-HIGGS-3bit

Text Generation • 15B • Updated Dec 6, 2024 • 3

ISTA-DASLab/Llama-3.1-70B-Instruct-HIGGS-4bit

Text Generation • 19B • Updated Dec 6, 2024 • 5

ISTA-DASLab/Llama-3.1-70B-Instruct-HIGGS-3bit

Text Generation • 15B • Updated Dec 6, 2024 • 7

ISTA-DASLab/Llama-3.1-8B-Instruct-HIGGS-3bit

Text Generation • 2B • Updated Dec 6, 2024 • 8

ISTA-DASLab/Llama-3.1-8B-Instruct-HIGGS-4bit

Text Generation • 3B • Updated Dec 6, 2024 • 12

ISTA-DASLab/Llama-3.1-8B-HIGGS-3bit

Text Generation • 2B • Updated Dec 6, 2024 • 10

ISTA-DASLab/Llama-3.1-8B-HIGGS-4bit

Text Generation • 3B • Updated Dec 6, 2024 • 4

ISTA-DASLab/gemma-2-9b-HIGGS-3bit

Text Generation • 3B • Updated Dec 6, 2024 • 7

ISTA-DASLab/gemma-2-9b-HIGGS-4bit

Text Generation • 3B • Updated Dec 6, 2024 • 9

ISTA-DASLab/gemma-2-9b-it-HIGGS-3bit

Text Generation • 3B • Updated Dec 6, 2024 • 6

ISTA-DASLab/gemma-2-9b-it-HIGGS-4bit

Text Generation • 3B • Updated Dec 6, 2024 • 6 • 1

ISTA-DASLab/Llama-3.2-3B-Instruct-AQLM-PV-2Bit-2x8

Text Generation • 1B • Updated Nov 8, 2024 • 6

ISTA-DASLab/Llama-3.2-1B-Instruct-AQLM-PV-2Bit-2x8

Text Generation • 0.5B • Updated Nov 8, 2024 • 5 • 1

ISTA-DASLab/Llama-3.2-1B-AQLM-PV-2Bit-2x8

Text Generation • 0.5B • Updated Nov 8, 2024 • 6