Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

whats the difference between albert_tiny_zh and albert_tiny_google_zh #167

Open
zheyuye opened this issue Dec 20, 2021 · 1 comment
Open

whats the difference between albert_tiny_zh and albert_tiny_google_zh #167

zheyuye opened this issue Dec 20, 2021 · 1 comment

Comments

@zheyuye
Copy link

zheyuye commented Dec 20, 2021

我注意到这两个tiny版本略有不同， 从config里看到模型size保持了一致， 但是模型文件参数ckpt.data大小有差异（17.2MB vs 49.7MB）

想请教一下brightmart版本是在预训练的具体什么阶段做了哪些优化
@brightmart
Copy link
Owner

只是模型有一点差异。具体你可以看看model的代码。

# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@brightmart @zheyuye