From Object Interactions to Fine-grained Video Understanding

Video understanding tasks such as action recognition and caption generation are crucial for various real-world applications in surveillance, video retrieval, human behavior understanding, etc. In this work, we present a generic recurrent module to detect relationships and interactions between arbitrary object groups for fine-grained video understanding. Our work is applicable to various open domain video […]

Read More From Object Interactions to Fine-grained Video Understanding

The Minds of the New Machines | Research Horizons | Georgia Tech’s Research News

Georgia Tech’s Research Horizons Magazine has done a very nice write-up of the ML@GT center, featuring many of our research projects. Machine learning has been around for decades, but the advent of big data and more powerful computers has increased its impact significantly — ­moving machine learning beyond pattern recognition and natural language processing into a […]

Read More The Minds of the New Machines | Research Horizons | Georgia Tech’s Research News

Ethics Highlight ‘Day of Machine Learning Discussion’ | College of Computing

Machine learning at Georgia Tech was in the spotlight recently as The Center for Machine Learning at Georgia Tech (ML@GT) hosted its spring seminar on Feb. 22 in the Klaus Advanced Computing Building.Billed as a “day of discussions around machine learning,” more than 200 students and faculty from across campus registered for the daylong event.“AI is […]

Read More Ethics Highlight ‘Day of Machine Learning Discussion’ | College of Computing

Embodied Question Answering

Embodied Question Answering is a new AI task where an agent is spawned at a random location in a 3D environment and asked a question (“What color is the car?”). In order to answer, the agent must first intelligently navigate to explore the environment, gather information through first-person (egocentric) vision, and then answer the question (“orange”).

Read More Embodied Question Answering

Visualizing Deep Learning Models at Facebook

This post summarizes the latest joint research between researchers at Georgia Tech and  Facebook on using visualization to make sense of deep learning models, published at IEEE VIS’17, a top visualization conference. While powerful deep learning models have significantly improved prediction accuracy, understanding these models remains a big challenge. Deep learning models are more difficult […]

Read More Visualizing Deep Learning Models at Facebook