Overview
This work is the second part of the project - "DeepArt", an analytic framework is proposed in the first part of the project, details can be found in this Page.
In this work, we want to do an comprehensive research on high performance computing system to support our analytic framework. The research can cover three directions:
1. Investigate deep hashing techniques for fast large scale image retrieval.
2. Investigate deep network architectures for computing resources limited devices (mobile, wearable device), in which an interactive system associated with external equipment (Beacon) can be implemented.
3. Estimate and tune hyperparameters of models using more efficient methods (Bayesion method).
System Architecture
We implemented a real-world system for digital artworks retrieval and annotation. (a) is the coordinate server which contains webserver, image server and database, (b) is the online computational unit which can encode query image real-time, (c) is the offline computational unit which can encode images, cluster feature vectors and rank result.
More details are coming soon...
Live Demo
Based on the proposed framework and the collected large number of dataset (Art500K), we implement an artwork retrieval and annotation system which can be tried out by clicking the demo button:
Some Results
TBD
Publications
TBD
[PDF]
Acknowledgements
This work is supported by the HKUST-NIE Social Media Lab.