Portrait of Kwangjun Ahn

Kwangjun Ahn

Senior Researcher

News & features

Three white icons on a gradient background transitioning from blue to green. From left to right: a network of interconnected nodes, a speedometer with the needle pointing right, and a flowchart with squares and a diamond shape.
Microsoft Research Blog

| Kwangjun Ahn and John Langford

Dion is a new AI model optimization method that boosts scalability and performance over existing leading methods by orthonormalizing only a top rank subset of singular vectors, enabling more efficient training of large models such as LLaMA-3 with reduced overhead.