- 👋 Hi, I’m Yung-Sung (@voidism) I am a final-year PhD student in Electrical Engineering and Computer Science at CSAIL, Massachusetts Institute of Technology, where I work with Jim Glass.
- My research focuses on large language models: hallucinations, factuality, and retrieval-augmented generation. In addition, I worked on pre-training MetaCLIP 2, a multilingual vision-language model pre-trained on worldwide web-scale data, during my internship at Meta FAIR.
- My research has introduced several approaches for improving LLM factuality. DoLa enhances factuality through layer-wise knowledge contrasting during decoding. Lookback Lens detects and mitigates hallucinations by analyzing attention patterns under RAG settings. Most recently, SelfCite enables LLMs to generate accurate citations without external supervision.
- I also used to work on retrieval methods, developing DiffCSE for better sentence embeddings and Query Reranking for more accurate passage retrieval.
[Google Scholar] [CV] [Twitter] [Github] [DBLP] [Blog] [Linkedin] [Instagram]