zhouhaoyi / JAT2022 Public

Notifications You must be signed in to change notification settings
Fork 3
Star 9

The GitHub repository for the paper "JAT" accepted by NeurIPS 2022.

9 stars 3 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 4 Commits
metrics		metrics
transformers		transformers
LICENSE		LICENSE
README.md		README.md
requirements.txt		requirements.txt
run_glue.py		run_glue.py

Repository files navigation

Jump Self-attention: Capturing High-order Statistics in Transformers (NIPS 2022)

Requirements

Python 3.7
transformers == 4.0.0
torch == 1.10.1
datasets == 1.15.1
huggingface-hub == 0.1.2
scipy == 1.6.2
scikit_learn == 0.24.1

Dependencies can be installed using the following command:

pip install -r requirements.txt

Data

Usage

python run_glue.py

About

The GitHub repository for the paper "JAT" accepted by NeurIPS 2022.

Report repository

Releases

No releases published

Packages

No packages published

Contributors 2

Languages

Python 100.0%