Graphics and multimedia - Microsoft Research

Publication

GeoGen: Geometry-Aware Generative Modeling via Signed Distance Functions

Salvatore Esposito, Qingshan Xu, Kacper Kania, Charlie Hewitt, Octave Mariotti, Lohit Petikam, Julien Valentin, Arno Onken, Oisin Mac Aodha

Computer Vision and Pattern Recognition 2024 Workshops | June 2024

Download

Kahani

“Kahani” is a research prototype that allows the user to create stories with visually striking and culturally nuanced images (visuals/scenes) just by describing them in their local languages. This web-based tool will also allow users…

Download Video Project

Podcast

What’s Your Story: Ivan Tashev

February 1, 2024

Partner Software Architect Ivan Tashev talks about applying his expertise in audio signal processing to the design and study of audio components for Microsoft products such as Kinect and shares how a focus on what…

Dataset Source Code

LLMR

This repo contains the code described in LLMR, implementing the Large Language Model for Mixed Reality framework. This package serves as a prototype for “Speaking the world into existence”, which allows the real time creation of…

GitHub

Publication

COLE: A Hierarchical Generation Framework for Multi-Layered and Editable Graphic Design

Peidong Jia, Chenxuan Li, Yuhui Yuan, Zeyu Liu, Yichao Shen, Bohan Chen, Xingru Chen, Yinglin Zheng, Dong Chen, Ji Li, Xiaodong Xie, Shanghang Zhang, Baining Guo

November 2023

Microsoft Research Blog

Research Focus: Week of November 22, 2023

November 22, 2023

A new deep-learning compiler for dynamic sparsity; Tongue Tap could make tongue gestures viable for VR/AR headsets; Ranking LLM-Generated Loop Invariants for Program Verification; Assessing the limits of zero-shot foundation models in single-cell biology.

Project

CCEdit

Creative and Controllable AI Video Editing Demo (opens in new tab) Paper (opens in new tab) CCEdit is a comprehensive generative video editing framework meticulously designed to strike a harmonious balance between controllability and creativity…

Publication

TongueTap: Multimodal Tongue Gesture Recognition with Head-Worn Devices

Tan Gemicioglu, R. Michael Winters, Yu-Te Wang, Thomas M. Gable, Ivan Tashev

25th ACM International Conference on Multimodal Interaction | October 2023

Project

Publication

Reality Distortion Room: A Study of User Locomotion Responses to Spatial Augmented Reality Effects

You-Jin Kim, Andrew D. Wilson, Jennifer Jacobs, Tobias Hollerer

International Symposium on Mixed and Augmented Reality (ISMAR) | October 2023

Publication

LayoutDiffusion: Improving Graphic Layout Generation by Discrete Diffusion Probabilistic Models

Junyi Zhang, Jiaqi Guo, Shizhao Sun, Jian-Guang Lou, Dongmei Zhang

ICCV 2023 | October 2023