Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Question about Small and medium model for graph classification #6

Open
Dbgsaoge opened this issue Jul 20, 2024 · 1 comment
Open

Question about Small and medium model for graph classification #6

Dbgsaoge opened this issue Jul 20, 2024 · 1 comment

Comments

@Dbgsaoge
Copy link

Hi, I am interested in your work. But I have a question about your medium_model.py; it seems that in your SpecformerMedium class, you didn't apply
```
mha_eig = self.mha_norm(eig)
mha_eig, attn = self.mha(mha_eig, mha_eig, mha_eig, key_padding_mask=e_mask)
eig = eig + self.mha_dropout(mha_eig)

    ffn_eig = self.ffn_norm(eig)
    ffn_eig = self.ffn(ffn_eig)
    eig = eig + self.ffn_dropout(ffn_eig)
     ```

the encoding process. Instead, you directly apply decoder to the EE representation. Is it the right process?

@bdy9527
Copy link
Collaborator

bdy9527 commented Oct 7, 2024

Hi, thanks for your interest!

I comment these codes for ablation studies and forget to uncomment them.

Feel free to use these codes directly.

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants