Shikhar Sharma

Senior Research Software Development Engineer

Publications

View by:

- MS-nowcasting: Operational Precipitation Nowcasting with Convolutional LSTMs at Microsoft Weather
  
  Sylwester Klocek, Haiyu Dong, Matthew Dixon, Panashe Kanengoni, Najeeb Kazmi, Pete Luferenko, Zhongjian Lv, Shikhar Sharma, Jonathan Weyn, Siqi Xiang
  
  NeurIPS 2021 Workshop on Tackling Climate Change with Machine Learning | December 2021
  
  Publication Publication
- Object-Centric Image Generation from Layouts
  
  Tristan Sylvain, Pengchuan Zhang, Yoshua Bengio, Devon Hjelm, Shikhar Sharma
  
  AAAI | February 2021
  
  PDF PDF Publication Publication Publication Publication
- Tell, Draw, and Repeat: Generating and Modifying Images Based on Continual Linguistic Instruction
  
  Alaaeldin El-Nouby, Shikhar Sharma, Hannes Schulz, Devon Hjelm, Layla El Asri, Samira Ebrahimi Kahou, Yoshua Bengio, Graham Taylor
  
  The IEEE International Conference on Computer Vision (ICCV) | October 2019
  
  Publication Github Github Project
- Dead-ends and Secure Exploration in Reinforcement Learning
  
  Mehdi Fatemi, Shikhar Sharma, Harm van Seijen, Samira Ebrahimi Kahou
  
  Proceedings of the 36th International Conference on Machine Learning (ICML) | June 2019
  
  Spotlight Presentation
  
  Publication Github
- Multi-Domain Task-Completion Dialog Challenge
  
  Sungjin Lee, Hannes Schulz, Adam Atkinson, Jianfeng Gao, Kaheer Suleman, Layla El Asri, Mahmoud Adada, Minlie Huang, Shikhar Sharma, Wendy Tay, Xiujun Li
  
  Dialog System Technology Challenges 8 | March 2019
  
  PDF Project Project
- From FiLM to Video: Multi-turn Question Answering with Multi-modal Context
  
  Dat Tien Nguyen, Shikhar Sharma, Hannes Schulz, Layla El Asri
  
  AAAI 2019 Dialog System Technology Challenge (DSTC7) Workshop | December 2018
  
  Publication
- Keep Drawing It: Iterative language-based image generation and editing
  
  Alaaeldin El-Nouby, Shikhar Sharma, Hannes Schulz, Devon Hjelm, Layla El Asri, Samira Ebrahimi Kahou, Yoshua Bengio, Graham W. Taylor
  
  Neural Information Processing Systems (NeurIPS) Visually-Grounded Interaction and Language (ViGIL) Workshop | November 2018
  
  Author's Version PDF Github Project
- ChatPainter: Improving Text to Image Generation using Dialogue
  
  Shikhar Sharma, Dendi Suhubdy, Vincent Michalski, Samira Ebrahimi Kahou, Yoshua Bengio
  
  International Conference on Learning Representations (ICLR) Workshop | February 2018
  
  Publication
- Frames: A Corpus for Adding Memory to Goal-Oriented Dialogue Systems
  
  Layla El Asri, Hannes Schulz, Shikhar Sharma, Jeremie Zumer, Justin Harris, Emery Fine, Rahul Mehrotra, Kaheer Suleman
  
  Proceedings of the 18th Annual SIGdial Meeting on Discourse and Dialogue | August 2017
  
  Publication Download Project
- A Frame Tracking Model for Memory-Enhanced Dialogue Systems
  
  Hannes Schulz, Jeremie Zumer, Layla El Asri, Shikhar Sharma
  
  Proceedings of the 2nd Workshop on Representation Learning for NLP | August 2017
  
  Proceedings of the 2nd Workshop on Representation Learning for NLP
  
  Publication Project
- Relevance of Unsupervised Metrics in Task-Oriented Dialogue for Evaluating Natural Language Generation
  
  Shikhar Sharma, Layla El Asri, Hannes Schulz, Jeremie Zumer
  
  arXiv preprint arXiv:1706.09799 | June 2017
  
  Publication Github
- Natural Language Generation in Dialogue using Lexicalized and Delexicalized Data
  
  Shikhar Sharma, Jing He, Kaheer Suleman, Hannes Schulz, Philip Bachman
  
  International Conference on Learning Representations (ICLR) Workshop | April 2017
  
  Publication
- Action Recognition using Visual Attention
  
  Shikhar Sharma, Ryan Kiros, Ruslan Salakhutdinov
  
  International Conference on Learning Representations (ICLR) Workshop | May 2016
  
  Publication
- Beyond Geometric Path Planning: Learning Context-Driven Trajectory Preferences via Sub-optimal Feedback
  
  Ashesh Jain, Shikhar Sharma, Ashutosh Saxena
  
  Robotics Research: The 16th International Symposium ISRR | Published by Springer International Publishing | 2016
  
  ISBN: 978-3-319-28872-7
  
  Publication Publication
- Action Recognition and Video Description using Visual Attention
  
  Shikhar Sharma
  
  February 2016
  
  February 2016
  
  University of Toronto
  
  Publication
- Action Recognition using Visual Attention
  
  Shikhar Sharma, Ryan Kiros, Ruslan Salakhutdinov
  
  Neural Information Processing Systems (NIPS) Time Series Workshop | December 2015
  
  Publication
- Learning preferences for manipulation tasks from online coactive feedback
  
  Shikhar Sharma
  
  The International Journal of Robotics Research | September 2015, Vol 34: pp. 1296-1313
  
  Publication Publication

- MS-nowcasting: Operational Precipitation Nowcasting with Convolutional LSTMs at Microsoft Weather
  
  Sylwester Klocek, Haiyu Dong, Matthew Dixon, Panashe Kanengoni, Najeeb Kazmi, Pete Luferenko, Zhongjian Lv, Shikhar Sharma, Jonathan Weyn, Siqi Xiang
  
  NeurIPS 2021 Workshop on Tackling Climate Change with Machine Learning | December 2021
  
  Publication Publication
- Object-Centric Image Generation from Layouts
  
  Tristan Sylvain, Pengchuan Zhang, Yoshua Bengio, Devon Hjelm, Shikhar Sharma
  
  AAAI | February 2021
  
  PDF PDF Publication Publication Publication Publication
- Tell, Draw, and Repeat: Generating and Modifying Images Based on Continual Linguistic Instruction
  
  Alaaeldin El-Nouby, Shikhar Sharma, Hannes Schulz, Devon Hjelm, Layla El Asri, Samira Ebrahimi Kahou, Yoshua Bengio, Graham Taylor
  
  The IEEE International Conference on Computer Vision (ICCV) | October 2019
  
  Publication Github Github Project
- Dead-ends and Secure Exploration in Reinforcement Learning
  
  Mehdi Fatemi, Shikhar Sharma, Harm van Seijen, Samira Ebrahimi Kahou
  
  Proceedings of the 36th International Conference on Machine Learning (ICML) | June 2019
  
  Spotlight Presentation
  
  Publication Github
- Multi-Domain Task-Completion Dialog Challenge
  
  Sungjin Lee, Hannes Schulz, Adam Atkinson, Jianfeng Gao, Kaheer Suleman, Layla El Asri, Mahmoud Adada, Minlie Huang, Shikhar Sharma, Wendy Tay, Xiujun Li
  
  Dialog System Technology Challenges 8 | March 2019
  
  PDF Project Project
- From FiLM to Video: Multi-turn Question Answering with Multi-modal Context
  
  Dat Tien Nguyen, Shikhar Sharma, Hannes Schulz, Layla El Asri
  
  AAAI 2019 Dialog System Technology Challenge (DSTC7) Workshop | December 2018
  
  Publication
- Keep Drawing It: Iterative language-based image generation and editing
  
  Alaaeldin El-Nouby, Shikhar Sharma, Hannes Schulz, Devon Hjelm, Layla El Asri, Samira Ebrahimi Kahou, Yoshua Bengio, Graham W. Taylor
  
  Neural Information Processing Systems (NeurIPS) Visually-Grounded Interaction and Language (ViGIL) Workshop | November 2018
  
  Author's Version PDF Github Project
- ChatPainter: Improving Text to Image Generation using Dialogue
  
  Shikhar Sharma, Dendi Suhubdy, Vincent Michalski, Samira Ebrahimi Kahou, Yoshua Bengio
  
  International Conference on Learning Representations (ICLR) Workshop | February 2018
  
  Publication
- Frames: A Corpus for Adding Memory to Goal-Oriented Dialogue Systems
  
  Layla El Asri, Hannes Schulz, Shikhar Sharma, Jeremie Zumer, Justin Harris, Emery Fine, Rahul Mehrotra, Kaheer Suleman
  
  Proceedings of the 18th Annual SIGdial Meeting on Discourse and Dialogue | August 2017
  
  Publication Download Project
- A Frame Tracking Model for Memory-Enhanced Dialogue Systems
  
  Hannes Schulz, Jeremie Zumer, Layla El Asri, Shikhar Sharma
  
  Proceedings of the 2nd Workshop on Representation Learning for NLP | August 2017
  
  Proceedings of the 2nd Workshop on Representation Learning for NLP
  
  Publication Project
- Relevance of Unsupervised Metrics in Task-Oriented Dialogue for Evaluating Natural Language Generation
  
  Shikhar Sharma, Layla El Asri, Hannes Schulz, Jeremie Zumer
  
  arXiv preprint arXiv:1706.09799 | June 2017
  
  Publication Github
- Natural Language Generation in Dialogue using Lexicalized and Delexicalized Data
  
  Shikhar Sharma, Jing He, Kaheer Suleman, Hannes Schulz, Philip Bachman
  
  International Conference on Learning Representations (ICLR) Workshop | April 2017
  
  Publication
- Action Recognition using Visual Attention
  
  Shikhar Sharma, Ryan Kiros, Ruslan Salakhutdinov
  
  International Conference on Learning Representations (ICLR) Workshop | May 2016
  
  Publication
- Beyond Geometric Path Planning: Learning Context-Driven Trajectory Preferences via Sub-optimal Feedback
  
  Ashesh Jain, Shikhar Sharma, Ashutosh Saxena
  
  Robotics Research: The 16th International Symposium ISRR | Published by Springer International Publishing | 2016
  
  ISBN: 978-3-319-28872-7
  
  Publication Publication
- Action Recognition and Video Description using Visual Attention
  
  Shikhar Sharma
  
  February 2016
  
  February 2016
  
  University of Toronto
  
  Publication
- Action Recognition using Visual Attention
  
  Shikhar Sharma, Ryan Kiros, Ruslan Salakhutdinov
  
  Neural Information Processing Systems (NIPS) Time Series Workshop | December 2015
  
  Publication
- Learning preferences for manipulation tasks from online coactive feedback
  
  Shikhar Sharma
  
  The International Journal of Robotics Research | September 2015, Vol 34: pp. 1296-1313
  
  Publication Publication
- MS-nowcasting: Operational Precipitation Nowcasting with Convolutional LSTMs at Microsoft Weather
  
  Sylwester Klocek, Haiyu Dong, Matthew Dixon, Panashe Kanengoni, Najeeb Kazmi, Pete Luferenko, Zhongjian Lv, Shikhar Sharma, Jonathan Weyn, Siqi Xiang
  
  NeurIPS 2021 Workshop on Tackling Climate Change with Machine Learning | December 2021
  
  Publication Publication
- Object-Centric Image Generation from Layouts
  
  Tristan Sylvain, Pengchuan Zhang, Yoshua Bengio, Devon Hjelm, Shikhar Sharma
  
  AAAI | February 2021
  
  PDF PDF Publication Publication Publication Publication
- Tell, Draw, and Repeat: Generating and Modifying Images Based on Continual Linguistic Instruction
  
  Alaaeldin El-Nouby, Shikhar Sharma, Hannes Schulz, Devon Hjelm, Layla El Asri, Samira Ebrahimi Kahou, Yoshua Bengio, Graham Taylor
  
  The IEEE International Conference on Computer Vision (ICCV) | October 2019
  
  Publication Github Github Project
- From FiLM to Video: Multi-turn Question Answering with Multi-modal Context
  
  Dat Tien Nguyen, Shikhar Sharma, Hannes Schulz, Layla El Asri
  
  AAAI 2019 Dialog System Technology Challenge (DSTC7) Workshop | December 2018
  
  Publication
- Keep Drawing It: Iterative language-based image generation and editing
  
  Alaaeldin El-Nouby, Shikhar Sharma, Hannes Schulz, Devon Hjelm, Layla El Asri, Samira Ebrahimi Kahou, Yoshua Bengio, Graham W. Taylor
  
  Neural Information Processing Systems (NeurIPS) Visually-Grounded Interaction and Language (ViGIL) Workshop | November 2018
  
  Author's Version PDF Github Project
- ChatPainter: Improving Text to Image Generation using Dialogue
  
  Shikhar Sharma, Dendi Suhubdy, Vincent Michalski, Samira Ebrahimi Kahou, Yoshua Bengio
  
  International Conference on Learning Representations (ICLR) Workshop | February 2018
  
  Publication
- Action Recognition using Visual Attention
  
  Shikhar Sharma, Ryan Kiros, Ruslan Salakhutdinov
  
  International Conference on Learning Representations (ICLR) Workshop | May 2016
  
  Publication
- Beyond Geometric Path Planning: Learning Context-Driven Trajectory Preferences via Sub-optimal Feedback
  
  Ashesh Jain, Shikhar Sharma, Ashutosh Saxena
  
  Robotics Research: The 16th International Symposium ISRR | Published by Springer International Publishing | 2016
  
  ISBN: 978-3-319-28872-7
  
  Publication Publication
- Action Recognition and Video Description using Visual Attention
  
  Shikhar Sharma
  
  February 2016
  
  February 2016
  
  University of Toronto
  
  Publication
- Action Recognition using Visual Attention
  
  Shikhar Sharma, Ryan Kiros, Ruslan Salakhutdinov
  
  Neural Information Processing Systems (NIPS) Time Series Workshop | December 2015
  
  Publication
- Learning preferences for manipulation tasks from online coactive feedback
  
  Shikhar Sharma
  
  The International Journal of Robotics Research | September 2015, Vol 34: pp. 1296-1313
  
  Publication Publication
- MS-nowcasting: Operational Precipitation Nowcasting with Convolutional LSTMs at Microsoft Weather
  
  Sylwester Klocek, Haiyu Dong, Matthew Dixon, Panashe Kanengoni, Najeeb Kazmi, Pete Luferenko, Zhongjian Lv, Shikhar Sharma, Jonathan Weyn, Siqi Xiang
  
  NeurIPS 2021 Workshop on Tackling Climate Change with Machine Learning | December 2021
  
  Publication Publication
- Tell, Draw, and Repeat: Generating and Modifying Images Based on Continual Linguistic Instruction
  
  Alaaeldin El-Nouby, Shikhar Sharma, Hannes Schulz, Devon Hjelm, Layla El Asri, Samira Ebrahimi Kahou, Yoshua Bengio, Graham Taylor
  
  The IEEE International Conference on Computer Vision (ICCV) | October 2019
  
  Publication Github Github Project
- Multi-Domain Task-Completion Dialog Challenge
  
  Sungjin Lee, Hannes Schulz, Adam Atkinson, Jianfeng Gao, Kaheer Suleman, Layla El Asri, Mahmoud Adada, Minlie Huang, Shikhar Sharma, Wendy Tay, Xiujun Li
  
  Dialog System Technology Challenges 8 | March 2019
  
  PDF Project Project
- Multi-Domain Task-Completion Dialog Challenge
  
  Sungjin Lee, Hannes Schulz, Adam Atkinson, Jianfeng Gao, Kaheer Suleman, Layla El Asri, Mahmoud Adada, Minlie Huang, Shikhar Sharma, Wendy Tay, Xiujun Li
  
  Dialog System Technology Challenges 8 | March 2019
  
  PDF Project Project
- From FiLM to Video: Multi-turn Question Answering with Multi-modal Context
  
  Dat Tien Nguyen, Shikhar Sharma, Hannes Schulz, Layla El Asri
  
  AAAI 2019 Dialog System Technology Challenge (DSTC7) Workshop | December 2018
  
  Publication
- Keep Drawing It: Iterative language-based image generation and editing
  
  Alaaeldin El-Nouby, Shikhar Sharma, Hannes Schulz, Devon Hjelm, Layla El Asri, Samira Ebrahimi Kahou, Yoshua Bengio, Graham W. Taylor
  
  Neural Information Processing Systems (NeurIPS) Visually-Grounded Interaction and Language (ViGIL) Workshop | November 2018
  
  Author's Version PDF Github Project
- Frames: A Corpus for Adding Memory to Goal-Oriented Dialogue Systems
  
  Layla El Asri, Hannes Schulz, Shikhar Sharma, Jeremie Zumer, Justin Harris, Emery Fine, Rahul Mehrotra, Kaheer Suleman
  
  Proceedings of the 18th Annual SIGdial Meeting on Discourse and Dialogue | August 2017
  
  Publication Download Project
- A Frame Tracking Model for Memory-Enhanced Dialogue Systems
  
  Hannes Schulz, Jeremie Zumer, Layla El Asri, Shikhar Sharma
  
  Proceedings of the 2nd Workshop on Representation Learning for NLP | August 2017
  
  Proceedings of the 2nd Workshop on Representation Learning for NLP
  
  Publication Project
- Relevance of Unsupervised Metrics in Task-Oriented Dialogue for Evaluating Natural Language Generation
  
  Shikhar Sharma, Layla El Asri, Hannes Schulz, Jeremie Zumer
  
  arXiv preprint arXiv:1706.09799 | June 2017
  
  Publication Github
- Natural Language Generation in Dialogue using Lexicalized and Delexicalized Data
  
  Shikhar Sharma, Jing He, Kaheer Suleman, Hannes Schulz, Philip Bachman
  
  International Conference on Learning Representations (ICLR) Workshop | April 2017
  
  Publication

- MS-nowcasting: Operational Precipitation Nowcasting with Convolutional LSTMs at Microsoft Weather
  
  Sylwester Klocek, Haiyu Dong, Matthew Dixon, Panashe Kanengoni, Najeeb Kazmi, Pete Luferenko, Zhongjian Lv, Shikhar Sharma, Jonathan Weyn, Siqi Xiang
  
  NeurIPS 2021 Workshop on Tackling Climate Change with Machine Learning | December 2021
  
  Publication Publication
- Object-Centric Image Generation from Layouts
  
  Tristan Sylvain, Pengchuan Zhang, Yoshua Bengio, Devon Hjelm, Shikhar Sharma
  
  AAAI | February 2021
  
  PDF PDF Publication Publication Publication Publication
- Tell, Draw, and Repeat: Generating and Modifying Images Based on Continual Linguistic Instruction
  
  Alaaeldin El-Nouby, Shikhar Sharma, Hannes Schulz, Devon Hjelm, Layla El Asri, Samira Ebrahimi Kahou, Yoshua Bengio, Graham Taylor
  
  The IEEE International Conference on Computer Vision (ICCV) | October 2019
  
  Publication Github Github Project
- Dead-ends and Secure Exploration in Reinforcement Learning
  
  Mehdi Fatemi, Shikhar Sharma, Harm van Seijen, Samira Ebrahimi Kahou
  
  Proceedings of the 36th International Conference on Machine Learning (ICML) | June 2019
  
  Spotlight Presentation
  
  Publication Github
- Multi-Domain Task-Completion Dialog Challenge
  
  Sungjin Lee, Hannes Schulz, Adam Atkinson, Jianfeng Gao, Kaheer Suleman, Layla El Asri, Mahmoud Adada, Minlie Huang, Shikhar Sharma, Wendy Tay, Xiujun Li
  
  Dialog System Technology Challenges 8 | March 2019
  
  PDF Project Project
- From FiLM to Video: Multi-turn Question Answering with Multi-modal Context
  
  Dat Tien Nguyen, Shikhar Sharma, Hannes Schulz, Layla El Asri
  
  AAAI 2019 Dialog System Technology Challenge (DSTC7) Workshop | December 2018
  
  Publication
- Keep Drawing It: Iterative language-based image generation and editing
  
  Alaaeldin El-Nouby, Shikhar Sharma, Hannes Schulz, Devon Hjelm, Layla El Asri, Samira Ebrahimi Kahou, Yoshua Bengio, Graham W. Taylor
  
  Neural Information Processing Systems (NeurIPS) Visually-Grounded Interaction and Language (ViGIL) Workshop | November 2018
  
  Author's Version PDF Github Project
- ChatPainter: Improving Text to Image Generation using Dialogue
  
  Shikhar Sharma, Dendi Suhubdy, Vincent Michalski, Samira Ebrahimi Kahou, Yoshua Bengio
  
  International Conference on Learning Representations (ICLR) Workshop | February 2018
  
  Publication
- Frames: A Corpus for Adding Memory to Goal-Oriented Dialogue Systems
  
  Layla El Asri, Hannes Schulz, Shikhar Sharma, Jeremie Zumer, Justin Harris, Emery Fine, Rahul Mehrotra, Kaheer Suleman
  
  Proceedings of the 18th Annual SIGdial Meeting on Discourse and Dialogue | August 2017
  
  Publication Download Project
- A Frame Tracking Model for Memory-Enhanced Dialogue Systems
  
  Hannes Schulz, Jeremie Zumer, Layla El Asri, Shikhar Sharma
  
  Proceedings of the 2nd Workshop on Representation Learning for NLP | August 2017
  
  Proceedings of the 2nd Workshop on Representation Learning for NLP
  
  Publication Project
- Natural Language Generation in Dialogue using Lexicalized and Delexicalized Data
  
  Shikhar Sharma, Jing He, Kaheer Suleman, Hannes Schulz, Philip Bachman
  
  International Conference on Learning Representations (ICLR) Workshop | April 2017
  
  Publication
- Action Recognition using Visual Attention
  
  Shikhar Sharma, Ryan Kiros, Ruslan Salakhutdinov
  
  International Conference on Learning Representations (ICLR) Workshop | May 2016
  
  Publication
- Action Recognition using Visual Attention
  
  Shikhar Sharma, Ryan Kiros, Ruslan Salakhutdinov
  
  Neural Information Processing Systems (NIPS) Time Series Workshop | December 2015
  
  Publication
- Action Recognition and Video Description using Visual Attention
  
  Shikhar Sharma
  
  February 2016
  
  February 2016
  
  University of Toronto
  
  Publication
- Beyond Geometric Path Planning: Learning Context-Driven Trajectory Preferences via Sub-optimal Feedback
  
  Ashesh Jain, Shikhar Sharma, Ashutosh Saxena
  
  Robotics Research: The 16th International Symposium ISRR | Published by Springer International Publishing | 2016
  
  ISBN: 978-3-319-28872-7
  
  Publication Publication
- Relevance of Unsupervised Metrics in Task-Oriented Dialogue for Evaluating Natural Language Generation
  
  Shikhar Sharma, Layla El Asri, Hannes Schulz, Jeremie Zumer
  
  arXiv preprint arXiv:1706.09799 | June 2017
  
  Publication Github
- Learning preferences for manipulation tasks from online coactive feedback
  
  Shikhar Sharma
  
  The International Journal of Robotics Research | September 2015, Vol 34: pp. 1296-1313
  
  Publication Publication