Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

Merge LoRA and base model #802

Merged
merged 20 commits into from
Apr 30, 2024
Merged

Merge LoRA and base model #802

merged 20 commits into from
Apr 30, 2024

Conversation

wheresmyhair
Copy link
Collaborator

@wheresmyhair wheresmyhair commented Apr 30, 2024 •
edited
Loading

Users can now merge LoRA weight and the base model into one using:

./scripts/run_merge_lora.sh \
  --model_name_or_path Qwen/Qwen1.5-1.8B \
  --lora_model_path output_models/lora \
  --output_model_path output_models/lora_merged \

wheresmyhair and others added 20 commits April 29, 2024 00:12
@wheresmyhair
Qwen lora test shell
58963b1
@wheresmyhair
Add merge lora script
af64349
@wheresmyhair
Add merge lora weight script
c0cda1c
@wheresmyhair
Add dtype when loading peft adapters
9b4d4b6
@wheresmyhair
Merge lora shell bug fix
2332b47
@wheresmyhair
Merge lora gpu support
6e40320
@wheresmyhair
Merge lora script update
71ab5a4
@wheresmyhair
Qwen lora test shell
38f8f74
@wheresmyhair
Add merge lora script
c2b9f0c
@wheresmyhair
Add merge lora weight script
d378656
@wheresmyhair
Add dtype when loading peft adapters
25e5cad
@wheresmyhair
Merge lora shell bug fix
1ae1e1c
@wheresmyhair
Merge lora gpu support
c6bcee3
@wheresmyhair
Merge lora script update
fa28cc0
@wheresmyhair
Merge branch 'yizhenjia-qwen-support' of https://github.com/OptimalSc…
3ecb69a 
…ale/LMFlow into yizhenjia-qwen-support
@wheresmyhair
Merge LoRA weight README update and revert irrelevant changes
7d47137
@wheresmyhair
Revert irrelevant changes
6ff0896
@wheresmyhair
Revert irrelevant changes
414a74e
@wheresmyhair
Revert irrelevant changes
fc521d0
@wheresmyhair
Merge lora typo fix
b28fc04
research4pan
research4pan reviewed Apr 30, 2024
View reviewed changes
Copy link
Contributor

@research4pan research4pan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

README.md

  • line 189: typo: redundant "="

scripts/run_merge_lora.sh

  • line 43-55: can be removed since error is raised inside python.

research4pan
research4pan approved these changes Apr 30, 2024
View reviewed changes
Copy link
Contributor

@research4pan research4pan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@research4pan research4pan merged commit ffc527e into main Apr 30, 2024
2 checks passed
@wheresmyhair wheresmyhair deleted the yizhenjia-qwen-support branch May 1, 2024 15:02
# for free to join this conversation on GitHub. Already have an account? # to comment
Reviewers

@research4pan research4pan research4pan approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@wheresmyhair @research4pan