Current Research
Hand Gesture Recognition for a Swarm of Mobile Robots
The developed system is demonstrated (with audio commentary), in the following video. It describes a demo which has been accepted for a paper at IROS 2012, and demonstration videos at AAMAS 2012 and HRI 2012.
A Swarm of Mobile Robots Counting Fingers of Hand Gestures
This additional video demonstrates our developed system recognizing finger counts of hand gestures.
Human-Swarm Interaction (HSI) Dataset
The Human-Swarm Interaction (HSI) dataset is made available publicly, and is downloadable from: Gesture Dataset
To cite this dataset in your manuscript, using the following (in BIBTEX):
@inproceedings{HSI_dataset,
author = {A. Giusti
and J. Nagi
and L. Gambardella and G. A. {Di Caro}},
title = {Cooperative sensing and recognition by a swarm of mobile robots},
booktitle
= {Proc. of the 25th IEEE/RSJ
International Conference on Intelligent Robots and Systems (IROS)},
address = {Vilamoura,
Portugal, October 7--12},
pages = {551--558},
year = {2012}
}
Related Publications
J. Nagi and G. Di Caro, A. Giusti, F. Nagi, L. Gambardella, Convolutional Neural Support Vector Machines: Hybrid visual pattern classifiers for multi-robot systems, in Proc. of the 11th International Conference on Machine Learning and Applications (ICMLA), Boca Raton, Florida, USA, Dec. 12-15, 2012, pp. 27–32. [pdf]
A. Giusti, J. Nagi, L. Gambardella, G. A. Di Caro, Cooperative Sensing and Recognition by a Swarm of Mobile Robots, in Proc. of the 25th IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Vilamoura, Portugal, Oct. 7-12, 2012, pp. 551–558. [pdf]
J. Nagi, H. Ngo, A. Giusti, L. M. Gambardella, J. Schmidhuber, G. A. Di Caro, Incremental Learning using Partial Feedback for Gesture-based Human-Swarm Interaction, in Proc. of the 21st IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), Paris, France, Sept. 9-13, 2012, pp. 898–905. [pdf]
A. Giusti, J. Nagi, L. Gambardella, G. A. Di Caro, Distributed Consensus for Interaction between Humans and Mobile Robot Swarms, in Proc. of the 11th International Conference on Autonomous Agents and Multiagent Systems (AAMAS) (Demonstration Track), Valencia, Spain, Jun. 4-8, 2012, pp. 1503–1504. [pdf]
A. Giusti, J. Nagi, L. Gambardella, S. Bonardi, G. A. Di Caro, Human-Swarm Interaction through Distributed Cooperative Gesture Recognition, in Proc. of the 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI) (Video Session), Boston, USA, Mar. 5-8, 2012, pp. 401–402. [pdf]
J. Nagi, F. Ducatelle, G. A. Di Caro, D. Ciresan, U. Meier, A. Giusti, F. Nagi, J. Schmidhuber and L. M. Gambardella, Max-Pooling Convolutional Neural Networks for Vision-based Hand Gesture Recognition, in Proc. of the 2nd IEEE International Conference on Signal and Image Processing and Applications (ICSIPA), Kuala Lumpur, Malaysia, Nov. 16-18, 2011, pp. 342–347. [pdf]