Research

Current Research Topics

Previous Research Topics

Useful papers

1. Measuring Data Influnece

Title Team/Authors Venue/Year Note
Counterfactual Memorization in Neural Language Models Chiyuan Zhang et. al. NeurIPS 2023 A low-complexity method for measuring impact of a data (or a subset)

2. Optimization Papers

Title Team/Authors Venue/Year Note
signSGD with Majority Vote is Communication Efficient And Fault Tolerant Jeremy Bernstein ICLR 2019 A majority voting signSGD is proposed, which is more Fault Tolerant compared to baseline signSGD

3. Differential Privacy

Title Team/Authors Venue/Year Note
Additive Logistic Mechanism for Privacy-Preserving Self-Supervised Learning Yunhao Yang, et. al. arxiv 2022 This paper proposes a new additive noise mechanism: Logistic mechanism.

4. Adversarial Example

Title Team/Authors Venue/Year Note
Hiding Visual Information via Obfuscating Adversarial Perturbations Zhigang Su, et. al. ICCV 2023 hiding visual information via type-I adversarial attack

5. Federated Learning

Title Team/Authors Venue/Year Note
Federated Unlearning via Active Forgetting Yuyuan Li, et. al. arxiv 2023 This paper proposes a federated unlearning framework.
One-shot Empirical Privacy Estimation for Federated Learning Galen Andrew, et. el. arxiv 2023 This paper introduces a canary-based DP auditing method for FL environment (slides)
SplitFed: When Federated Learning Meets Split Learning Chandra Thapa, et. al. AAAI 2022 This paper proposes a combination of FL and SL
One the Convergence of FedAvg on Non-IID Data Xiang Li, et. al. ICLR 2020 This paper proves the convergence of FedAvg on Non-IID data (full/partial participation)
Communication-Efficient Learning of Deep Networks from Decentralized Data Google AISTATS 2017 This paper proposes FedAvg
Adaptive Federated Learning in Resource Constrained Edge Computing Systems Shiqiang Wang, et .al. IEEE JSAC 2019 Investigates how the number of update per commun. round affect the convergence.