Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

[feature]add tensor folder map to graph #10525

Draft
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

crazy-JiangDongHua
Copy link
Contributor

给 graph 增加了 folder tensor map 这个结构,包含了所有经由 folder op 做的优化 pass 的输入输出 tensor 的名字,以及可以用来做等价计算的函数。

这个特征的应用场景是,在 sd 模型中,存在两个权重不同,但结构完全一样的 unet ,在第一次编译完以后,第二次加载不同的权重,可以手动计算图优化以后的权重,而不是再做一次图编译,节省时间。

@crazy-JiangDongHua crazy-JiangDongHua requested a review from mosout May 13, 2024 14:53
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant