Skip to content

Issues: OpenGVLab/OmniQuant

New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

25 Open 63 Closed
25 Open 63 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

I encounter a error: "AttributeError: 'LlamaAttention' object has no attribute 'rotary_emb'",when i run code with llama-1-7b. It happened in int_llama_layer.py: self.rotary_emb = copy.deepcopy(org_module.rotary_emb)
#104 opened Jan 5, 2025 by WX-yh
1
I encounter a error: "AttributeError: 'LlamaAttention' object has no attribute 'rotary_emb'",when i run code with llama-1-7b.
#103 opened Jan 5, 2025 by WX-yh
Fail to reproduce the result of w2a16 using llama2 7b
#102 opened Dec 16, 2024 by stackByStack
1
Obtained different PPL for Wikitext and C4 compared to results reported in the paper
#95 opened Sep 12, 2024 by yc2367
2
Error when evaluating MMLU
#91 opened Sep 4, 2024 by zjq0455
2
how to enable llama3-8b int4 awq models
#90 opened Aug 29, 2024 by FlexLaughing
RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0! (when checking argument for argument mat2 in method wrapper_CUDA_bmm)
#89 opened Aug 5, 2024 by mcpaulgeorge
4
The version of transformers, auto_gptq, autoawq
#88 opened Aug 5, 2024 by zhangfzR
Quantify tinyllama-1.1B-Chat-v1.0, a CUDA assertion error occurred
#87 opened Jul 12, 2024 by causeof-you
[New Feature] Seek MLA Supported by Smooth
#86 opened Jul 10, 2024 by RanchiZhao
question about let
#85 opened Jul 8, 2024 by mxjmtxrm
[Model Request] MiniCPM
#84 opened Jul 2, 2024 by RanchiZhao
Questions about quantization
#81 opened Jun 10, 2024 by mxjmtxrm
1
Which bug do you fix for auto_gptq
#79 opened Jun 2, 2024 by BaohaoLiao
1
Questions regarding Infusing Omniquant into MLC
#77 opened Apr 29, 2024 by BuildBackBuehler
3
OPT-30B
#76 opened Apr 26, 2024 by Arthur-Ling
Llama-3-8B
#75 opened Apr 22, 2024 by hsb1995
5
TypeError: FalconRotaryEmbedding.forward() missing 1 required positional argument: position_ids
#72 opened Apr 11, 2024 by luchangli03
Other Task
#67 opened Mar 20, 2024 by hsb1995
1
The ckpt of Quantized OPT model is not be found
#53 opened Jan 12, 2024 by liuxy1103
6
AttributeError: 'Attention' object has no attribute 'W_pack'
#39 opened Dec 7, 2023 by yrf200112
RuntimeError when quantize bloom using our code
#29 opened Nov 3, 2023 by Louym
Cannot compile with mlc-llm
#21 opened Oct 10, 2023 by 0x1997
2
Model File Formats: .pth, .bin vs. GGUF
#20 opened Sep 27, 2023 by sebvannistel
Lazy loading
#6 opened Sep 8, 2023 by Ar57m
ProTip! Find all open issues with in progress development work with linked:pr.