Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Development for fl-nlp-hetero-tasks #410

Merged
merged 39 commits into from
Jan 9, 2023
Merged

Conversation

cheneydon
Copy link
Contributor

@cheneydon cheneydon commented Oct 25, 2022

The implementation of FL-hetero-nlp-tasks, including:

  • Some NLP datasets: AGNews, CNN/DM, IMDB, MSQG, NewsQA, SQuAD;
  • Some metrics for NLP tasks: ROUGE, BLEU, METEOR;
  • Label smoothing and warm-up learning rate schedule;
  • New Model, Trainer, Aggregator, Server/Client for Assign-Then-Contrast framework (https://arxiv.org/abs/2212.05789) for FL-hetero-nlp-tasks;
  • Configurations, scripts and unittest

@xieyxclack xieyxclack self-requested a review October 25, 2022 04:14
@xieyxclack xieyxclack added the Feature New feature label Oct 25, 2022
@cheneydon cheneydon changed the title update dataset for hetero-fednlp update codes for hetero-fednlp Oct 26, 2022
@xieyxclack xieyxclack changed the title update codes for hetero-fednlp [WIP] development for fl-nlp-hetero Dec 14, 2022
@xieyxclack xieyxclack added the FedNLP Federated learning in NLP label Dec 14, 2022
Copy link
Collaborator

@xieyxclack xieyxclack left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

federatedscope/core/trainers/utils.py Show resolved Hide resolved
@xieyxclack xieyxclack changed the title [WIP] development for fl-nlp-hetero Development for fl-nlp-hetero-tasks Jan 6, 2023
@xieyxclack xieyxclack merged commit 061cc9d into alibaba:master Jan 9, 2023
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
Feature New feature FedNLP Federated learning in NLP
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants