The DARPA Visual Media Reasoning Program [DoD News] was a multi-year [2012-2016], multi-million dollar project with an objective to create visual exploitation and indexing tools to rapidly extract mission-relevant visual intelligence from large quantities of diverse, ill-defined, unstructured imagery captured from multiple adversary sources.
- I was the technical lead on the large-scale image clustering effort and developed novel algorithms to perform unsupervised clustering on millions of unstructured images and videos into inherent semantic groups that allowed fast discovery and search. I designed a novel real-time spectral algorithm for large-scale unsupervised clustering of images using SIFT Bag-of-Words and Convolutional Neural Network (CNN) features.
- I designed and developed novel algorithms for feature-fusion and feature matching for large-scale semantic image search.
- I led the effort to develop and deploy the full image ingestion to discovery and visualization system to a high profile Federal Entity, and received the “SRI Technical Innovation Award”.