I’m a Ph.D. student at State Key Lab of CAD&CG, Zhejiang University , under the supervision of Prof. Wei Chen. I am also fortunate to work closely with Qian Liu, Tianyu Pang, Haozhe Feng and Minfeng Zhu.

I’m currently insterested in Trustworthy AI and LLMs.

🔥 News

2024.05: 🎉🎉 One paper gets accepted by ACL 2024 .

📝 Publications

ACL 2024

Self-Distillation Bridges Distribution Gap in Language Model Fine-Tuning

PDF | | Poster | Slides

Zhaorui Yang, Tianyu Pang, Haozhe Feng, Han Wang, Wei Chen, Minfeng Zhu, Qian Liu

In this work, we propose a novel fine-tuning approach to mitigate the catastrophic forgetting during the fine-tuning of language models.

arxiv:2304.06627

CoSDA: Continual Source-Free Domain Adaptation

PDF |

Haozhe Feng*, Zhaorui Yang*, Hesun Chen*, Tianyu Pang, Chao Du, Minfeng Zhu, Wei Chen, Shuicheng Yan

In this work, we investigate the mechanism of catastrophic forgetting of previous Source-Free Domain Adaptation (SFDA) approaches. Motivated by the findings, we propose CoSDA which outperforms SOTA approaches in continuous adaptation.

🎖 Honors and Awards

2022.12 China National Scholarship (Undergraduate).
2021.12 China National Scholarship (Undergraduate).

📖 Education

2023.09 - Present
Ph.D. student in Software Engineering at State Key Lab of CAD&CG, Zhejiang University .
2019.09 - 2023.06
B.E. in Software Engineering, Xi’an Jiaotong University .

💻 Internships

None yet.