Popular repositories Loading

1. lp-ft_ntk lp-ft_ntk Public

   Code for "Understanding Linear Probing then Fine-tuning Language Models from NTK Perspective"

   Python 5 3

2. gradient-descent-the-ultimate-optimizer gradient-descent-the-ultimate-optimizer Public

   Forked from kach/gradient-descent-the-ultimate-optimizer

   Python

3. gradient-heterogeneity gradient-heterogeneity Public

   Code for "Understanding Why Adam Outperforms SGD: Gradient Heterogeneity in Transformers"

   Python