Iβm a Ph.D. student at State Key Lab of CAD&CG, Zhejiang University , under the supervision of Prof. Wei Chen. I am also fortunate to work closely with Qian Liu, Tianyu Pang, Haozhe Feng and Minfeng Zhu.
Iβm currently insterested in Trustworthy AI and LLMs.
π₯ News
- 2024.05: ππ One paper gets accepted by ACL 2024
.
π Publications
ACL 2024
![SDFT image](../files/sdft/sdft.png)
Self-Distillation Bridges Distribution Gap in Language Model Fine-Tuning
Zhaorui Yang, Tianyu Pang, Haozhe Feng, Han Wang, Wei Chen, Minfeng Zhu, Qian Liu
- In this work, we propose a novel fine-tuning approach to mitigate the catastrophic forgetting during the fine-tuning of language models.
arxiv:2304.06627
![CoSDA setting image](../files/cosda/cosda_setting.png)
CoSDA: Continual Source-Free Domain Adaptation
PDF |
Haozhe Feng*, Zhaorui Yang*, Hesun Chen*, Tianyu Pang, Chao Du, Minfeng Zhu, Wei Chen, Shuicheng Yan
- In this work, we investigate the mechanism of catastrophic forgetting of previous Source-Free Domain Adaptation (SFDA) approaches. Motivated by the findings, we propose CoSDA which outperforms SOTA approaches in continuous adaptation.
π Honors and Awards
- 2022.12 China National Scholarship (Undergraduate).
- 2021.12 China National Scholarship (Undergraduate).
π Education
- 2023.09 - Present
Ph.D. student in Software Engineering at State Key Lab of CAD&CG, Zhejiang University.
- 2019.09 - 2023.06
B.E. in Software Engineering, Xiβan Jiaotong University.
π» Internships
None yet.