Visual Dialog based search and rescue agent

Advisor: Prof. Katia Sycara, School of Computer Science, Carnegie Mellon University

  • Working on a simulated agent capable of exploring a disaster hit environment while having a dialog with a guiding human
  • Currently working on the neural network architecture of the vision to dialog, and vision to mapping module, synthetic data generation, and integrating these module with a central simulator