Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

bert上添加ONLSTM #2

Open
WBWhiteBeard opened this issue Oct 22, 2021 · 0 comments
Open

bert上添加ONLSTM #2

WBWhiteBeard opened this issue Oct 22, 2021 · 0 comments

Comments

@WBWhiteBeard
Copy link

你好,请问一下。
在bert上添加ONLSTM网络层,如何更好的设置参数呀。
这是我的设置,实验效果提升了一点,但是不高。

# config.hidden_size =768
        self.on_lstm = OnLSTM(input_size=config.hidden_size,
                              hidden_size=rnn_dim,
                              level_hidden_size=10,
                              num_layers=2,
                              bidirectional=True)
        out_dim = rnn_dim*2
```
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant