Tag: NLP

New Algorithm Follows Human Intuition to Make Visual Captioning More Grounded

Machine Learning Center at Georgia TechLeave a comment

Annotating and labeling datasets for machine learning problems is an expensive and time-consuming process for computer vision and natural language scientists. However, a new deep learning approach is being used to decode, localize, and reconstruct image and video captions in seconds, making the machine-generated captions more reliable and trustworthy. To solve this problem, researchers at… Continue reading New Algorithm Follows Human Intuition to Make Visual Captioning More Grounded

Embodied Question Answering

abhshkdz2 Comments

Embodied Question Answering is a new AI task where an agent is spawned at a random location in a 3D environment and asked a question ("What color is the car?"). In order to answer, the agent must first intelligently navigate to explore the environment, gather information through first-person (egocentric) vision, and then answer the question ("orange").