Niculae Sebe

Formazione
Ph.D., Computer Science, Leiden University, The Netherlands, 28 Marzo 2001
Tesi: Improving Visual Matching - Similarity Noise Distribution and Optimal Metrics
Advisor: Prof. Dr. Frans J. Peters, Philips Research, The Netherlands
Co-advisor: Prof. Dr. Thomas S. Huang, Univ. of Illinois at Urbana-Champaign, USA

Laurea, Ingegneria Elettronica, “Politehnica” University of Bucharest, Romania, Giugno 1996
Tesi: Image Compression Using Vector Quantization with a Kohonen Neural Network
Advisor: Prof. Dr. Victor Neagoe

Esperienza professionale

Universita' degli Studi di Trento
Professore Associato, Dipartimento di Ingegneria e Scienza dell'Informazione/Facolta di Scienze Cognitive, dal 01/12/2008
University of Amsterdam, The Netherlands, Faculty of Science, ISLA Group, 01/05/2003- 30/11/2008

University of Illinois at Urbana-Champaign, USA
Visiting Professor, Beckman Institute, 5/2003 - 9/2003

Leiden University, The Netherlands
Researcher, LIACS Media Lab, 01/04/2001 – 30/04/2003

Leiden University, The Netherlands
Ph.D. Research, LIACS Media Lab, 01/04/1997 – 31/03/2001

Insegnamento
Corsi di Laurea
Universita' degli Studi di Trento, dal 2009
- Computational Vision
- Machine Learning
- Multimedia Systems

University of Amsterdam, Faculty of Science, 2003 - 2008
- Multimedia Information Systems

Leiden University, Computer Science Department, 2001 - 2003
- Multimedia Systems
- Computer Graphics
- Information Theory

Corsi di Dottorato
Technical University of Valencia, 5/2012, 5/2013 e 5/2014
Universita' degli Studi di Pisa, 4/2011
University of Lugano, 1/2008
University of Modena, 6/2007
Vienna Institute of Technology, Computer Science Department, 12/2005
- Human-centered Multimedia Systems

My current research addresses the problem of sensing and understanding users’ interactive actions and intentions for achieving multimodal human-computer interaction in natural settings. A critical issue here is that human face and body exhibit complex and rich dynamic behavior that is all non-linear, time varying, and context dependent (person, task, mood/affect dependent). Thus, the main focus of my research is on multimodal human-computer interaction models from multi-sensory observations. The research done so far addressed the area of analyzing the user’s behavior (e.g., facial expressions, body and head pose, eye tracking, etc.) in his personal environment (e.g., home or office) as well as bimodal emotion recognition from facial expressions and audio information. Another important aspect is the analysis of multimedia information retrieval techniques toward extracting affective information from the multimedia data (e.g., movies).

Progetti di ricerca
European Projects
- CrossLingual crossMedia knowledge extraction (xLiMe): FP7 STREP (11/2013-11/2016), WP Leader, funding: 500.7 keuro
- Devices for Assisted Living (DALI): FP7 STREP (11/2012-11/2015), Scientific Leader CV group UNITN, 146.7 keuro
- Social Annotation and eXperiences: (S-MAX) EIT ICT Labs (2013), Scientific Leader UNITN, 59 keuro
- Video Quality Driven Multimedia Streaming in Mobile Wireless Networks (QoSTREAM), FP7 Marie Curie Action, Scientific Leader UNITN, 70.4 keuro
- The Interaction Toolkit II (TIK2), EIT ICT Labs (2013), Scientific Leader UNITN, 10 keuro
- Event-centric Multimedia content Access Platform (EventMAP), EIT ICT Labs (2012), Coordinator, 58 keuro
- The Interaction Toolkit (TIK), EIT ICT Labs (2012), Scientific Leader UNITN, 35 keuro
- Event-based Retrieval of Networked Media (Glocal), FP7 IP (12/2009-12/2012), WP Leader, 125.5 keuro
- Coordinated Approach to the European Effort on Audio-Visual Search Engines (CHORUS+), FP7 CA (1/2010-1/2013), WP Leader, 129.2 keuro
- Multimodal Interactions Analysis and Exploration of Users with a Controlled Environment (MIAUCE), FP6 STREP (9/2006-6/2009), WP Leades, 552.6 keuro
- Coordinated Approach to the European Effort on Audio-Visual Search Engines (CHORUS): FP6 CA (11/2006-5/2009), WP Leader, 122.2 keuro
- Measuring Feelings and Expectations Associated with Texture (SYNTEX): FP6 STREP (11/2006-11/2009), WP Leader, 133.7 keuro
- Perceptual Consciousness – Explication and Testing (PERCEPT): FP6 STREP (11/2006-11/2009), WP Leader, 217.2 keuro
- Multimedia Understanding through Semantics, Computation, and Learning (MUSCLE), FP5 NoE (3/2004-3/2008), WP Leader, 210 keuro

Progetti nazionali e locali
- Active Ageing at Home, Tecnologie per gli Ambienti di Vita, Cluster MIUR CTN01_00128 (2014-2017), Scientific Leader UNITN, 1290 keuro
- Monitoring ART Museum Experience (MART-ME), TRP-TrentoRISE (2014-2016), Coordinator, 152.5 keuro
- Discovering, Relating and Reasoning about Events in Multi-Modal Data (EventStream), JRP-TrentoRISE (2014-2016), Scientific Leader UNITN, 188 keuro
- Mobile Data for Community and Individual Empowerment & Change (BeHave), TRP-TrentoRISE (2014-2016), Scientific Leader UNITN, 60 keuro
- FIRB 2008: Social Patterns: Modeling & Analysis (S-PATTERNS) (12/2010 – 12/2014), Coordinator, 307 keuro
- Persuasion Technologies (PERTE), Trento RISE (2012-2015), Scientific Leader, 133.4 keuro
- Observing Attention (OZ) - Universiade, Coordinaton, 14 keuro
- Brain Decoding of Affective Multimedia Stimuli with MEG (DECAF), CiMeC (1/2012-12/2013), Coordinator, 10 keuro

Progetti industriali
- Analysis of Heterogeneous Data – Telecom Italia (12/2013-6/2014), Coordinator, 10 keuro

- Fellow International Association for Pattern Recognition (IAPR) – 2012
- Senior Member IEEE – 2011
- Senior Member ACM – 2009.
- Director of Conferences, ACM SIGMM (elected officer 2013-2016).
- Co-chair of the IEEE Computer Society task force on Human-centered Computing (with Alejandro Jaimes, Nahum Gerhon, Daniel Gatica-Perez)
- Member of the IEEE Signal Processing Society Multimedia Signal Processing Technical Committee (MMSP TC)

Attivita' professionali

- Coordinatore del corso di dottorato in Information and Communication Technology, Universita' degli Studi di Trento, dall'ottobre 2012
- Fellow International Association for Pattern Recognition (IAPR) – 2012
- Senior Member IEEE – 2011
- Senior Member ACM – 2009.
- Director of Conferences, ACM SIGMM (elected officer 2013-2016).
- Co-chair of the IEEE Computer Society task force on Human-centered Computing (with Alejandro Jaimes, Nahum Gerhon, Daniel Gatica-Perez)
- Member of the IEEE Signal Processing Society Multimedia Signal Processing Technical Committee (MMSP TC)

Premi e scholarships

- Best honorable mention – ACM Conference on Designing Interactive Systems (DIS’12), Newcastle, UK, June 2012
- Best Associate Editor award – Image and Vision Computing, 2010
- Best reviewer award – Asian Conference on Computer Vision (ACCV), 2007
- Research fellowship at British Telecomm Labs, UK, 2002.
- Best paper runner up – British Machine Vision Conference (BMVC), Manchester, UK, September 2001.
- Best paper award - 4th International Conference on Advances in Visual Information Systems (Visual'00), Lyon, France, November 2000.
- Visiting research grant (6 months) offered by Darmstadt University of Technology (1996-1997).
- Best Student Paper Award – IEEE International Conference on Semiconductors (CAS’96).

Organizzazione di convegni
- Program Chair, International Conference on Computer Vision (ICCV), Venice, October 2017
- Program Chair, European Conference on Computer Vision (ECCV), Amsterdam, October 2016
- General Chair, ACM Multimedia, Barcelona, October 2013
- General Chair, International Conference on Affective Computing and Intelligent Interaction (ACII), Geneva, September 2013
- Program Chair, International Conference on Multimedia Modelling, Huangshan, January 2013
- Program Chair for the International Conference on Multimodal Interfaces (ICMI), Alicante, November 2011
- Program Chair, ACM Multimedia, Scottsdale, December 2011
- Area Chair for the Asian Conference on Computer Vision (ACCV), Queenstown (NZ), November 2010
- Track Chair International Conference on Pattern Recognition (ICPR), Istanbul, August 2010
- General Chair of the International Conference on Image and Video Retrieval (CIVR), Beijing, July 2010
- Area Chair European Conference on Computer Vision (ECCV), Heraklion, September 2010
- Area Chair Asian Conference on Computer Vision (ACCV), Xian, September 2009
- Track Chair for the International World Wide Web conference (WWW), Madrid, April 2009
- General Chair 8th IEEE International Conference on Automatic Face and Gesture Recognition, Amsterdam, September 2008
- Area Chair IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Anchorage, USA, June 2008
- Program Chair ACM Multimedia, Augsburg, September 2007
- General Chair International Conference on Image and Video Retrieval (CIVR), Amsterdam, July 2007
- General Chair IS&T/SPIE Conference on Storage and Retrieval Methods and Applications for Multimedia, San Jose, CA, January 2007
- General Chair IS&T/SPIE Conference on Storage and Retrieval Methods and Applications for Multimedia, San Jose, CA, January 2006
- Program chair of the 2nd International Conference on Image and Video Retrieval, CIVR’2003, Urbana-Champaign, USA, July 24-25, 2003

Organizzazione di workshop

- Chair International Workshop on Human Behavior Understanding - in conjunction with the International Conference on Pattern Recognition (ICPR), Istanbul, August 2010
- Chair 5th International Workshop on Human Computer Interaction (HCI09) - in conjunction with the IEEE International Conference on Computer Vision (ICCV 2009), Kyoto, Japan, September 2009
- General Co-Chair 10th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS), London, May 2009
- Chair 4th International Workshop on Human Computer Interaction (HCI07) - in conjunction with the IEEE International Conference on Computer Vision (ICCV 2007), Rio de Janeiro, Brazil, October 20, 2007
- Chair Human-centered Multimedia Workshop (HCM’07) – in conjunction with the ACM Multimedia Conference (ACM MM 2007), Augsburg, Germany, September 2007
- Program Co-Chair International Workshop on Multimedia Content Analysis and Mining (MCAM), WeiHai, China, June 2007
- Chair Human-centered Multimedia Workshop (HCM’06) – in conjunction with the ACM Multimedia Conference (ACM MM 2006), Santa Barbara, USA, October 2006
- Chair 3rd International Workshop on Human Computer Interaction (HCI06) - in conjunction with the European Conference on Computer Vision (ECCV 2006), Graz, Austria, May 13, 2006
- Chair 2nd IEEE International Workshop on Human Computer Interaction (HCI05) - in conjunction with the International Conference on Computer Vision (ICCV 2005), Beijing, China, October 21, 2005
- Chair 6th ACM SIGMM International Workshop on Multimedia Information Retrieval (MIR04) - in conjunction with ACM Multimedia 2004, New York, USA, October 2004
- Chair 1st International Workshop on Human Computer Interaction (HCI04) - in conjunction with the European Conference on Computer Vision (ECCV 2004), Prague, Czech Republic, May 15, 2004
- Chair 5th ACM SIGMM International Workshop on Multimedia Information Retrieval (MIR03) - in conjunction with ACM Multimedia 2003, Berkeley, USA, November 7, 2003

Tutorials e corsi

- Short course on Human-centered Computing: Challenges and Perspectives, SSPNet Summer School, Vietri sul Mare, June 2013.
- Short course on Human-centered Computing: Challenges and Perspectives, 11th Summer School on Advanced Studies on Biometrics for Secure Authentication, Alghero, June 2012.
- Tutorial on Human-centered Vision Systems, Asian Conference on Computer Vision, Queenstown, November 2010
- Tutorial on Human-centered Vision Systems: Context-driven Algorithm Design, IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, June 2010
- Tutorial on Human-centered Vision Systems, IEEE International Conference on Computer Vision, Kyoto, September 2009
- Tutorial on Human-centered Vision Systems, International Conference on Image Analysis and Processing (ICIAP), Vietri sul Mare, September 2009
- Tutorial on Human-centered Computer Vision Systems, IEEE International Conference on Computer Vision, Rio de Janeiro, October 2007
- Tutorial on Image and Video Retrieval, IEEE International Conference on Computer Vision, Rio de Janeiro, October 2007
- Tutorial on Human-centered Multimedia, ACM Multimedia, Augsburg, September 2007
- Tutorial on Image and Video Retrieval, International Conference on Image Processing (ICIP), San Antonio, September 2007
- Tutorial on Image and Video Retrieval, International Conference on Image Analysis and Processing (ICIAP), Modena, September 2007
- Tutorial on Human-centered Multimedia, IEEE International Conference on Multimedia and Expo (ICME), Beijing, July 2007
- Tutorial on Image and Video Retrieval, IEEE International Conference on Multimedia and Expo (ICME), Beijing, July 2007
- Tutorial on Human-Centered Methods, International Conference on Pattern Recognition (ICPR), Hong Kong, August 2006
- Tutorial on Image and Video Retrieval, International Conference on Pattern Recognition (ICPR), Hong Kong, August 2006
- Intensive course on Multimedia Information Systems, 13th International Summer School in Novel Computing, Joensuu, Finland, August 2006
- Tutorial on Human-Centered Vision Systems, IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), New York, June 2006
- Intensive course on Feature Extraction and Content Description, joint DELOS-MUSCLE summer school on Multimedia Digital Libraries, San Vincenzo, Italy, June 2006
- Tutorial on Image and Video Retrieval, IS&T/SPIE Conference on Internet Imaging, San Jose, CA, January 2006
- Tutorial on Human-Centered Multimedia Information Systems, ACM Multimedia, Singapore, November 2005
- Tutorial on Human-Centered Vision Systems, IEEE International Conference on Computer Vision (ICCV), Beijing, October 2005
- Tutorial on Human-Centered Multimedia Information Systems, IEEE Conference on Multimedia and Expo (ICME), Amsterdam, The Netherlands, July 2005
- Tutorial on Image and Video Retrieval, IS&T/SPIE Conference on Internet Imaging, San Jose, CA, January 2005
- Tutorial on Human-Centered Multimedia Information Systems, 5th Pacific Rim Conference on Multimedia, Tokyo, Japan, December 2004

Keynotes
- “Things and stuff: A Computer Vision Perspective”, Ninth Conference on Image Information Mining, Bucharest, March 2014.
- French Image Processing and Pattern Recognition Conference, RFIA, Caen, France, January 2010
- Audio-Visual Signal processing for Advanced Multimodal Interfaces Workshop, Malaga, Spain, February 2008.
- IEEE International Workshop on Ambient Intelligence, Media, and Sensing (AIMS07), Istanbul, Turkey, April 2007.
- European Commission Workshop on Multimodal Interfaces, Luxembourg, December 2006
- IS&T/SPIE Conference on Internet Imaging, San Jose, CA, January 2005.

Attivita' editoriale
- International Journal of Human Computer Studies – Associate Editor (since November 2013)
- Computer Vision and Image Understanding – Associate Editor (since June 2012)
- Journal of Multimedia – Associate Editor (since June 2010)
- IEEE Transactions on Multimedia – Associate Editor (since April 2009)
- Machine Vision and Applications - Associate Editor (since July 2007)
- Image and Vision Computing – Associate Editor (since September 2006)
- Journal of Electronic Imaging – Associate Editor (October 2008 – April 2012)
- Journal of Ambient Intelligence and Smart Environments – Advisory Board

- Guest Editor for IEEE MultiMedia, Special Issue on Large Scale Geo-Social Multimedia Computing (with R. Ji, Y. Yang, K. Aizawa, L. Cao), Summer 2014.
- Guest Editor for IEEE Transactions on Multimedia, Special Issue on Socio-Mobile Media Analysis and Retrieval (together with A. Del Bimbo, K. Selcuk Candan, Y-G. Jiang, J. Luo, T. Mei, H.T. Shen, C. Snoek, and R. Yan), Spring 2014.
- Guest Editor for Machine Vision and Applications, Special Issue on Contextual Visual Computing (together with R. Hong and Q. Tian), Spring 2014.
- Guest Editor for Computer Vision and Image Understanding, Special Issue on Learning from Multiple Evidences for Large Scale Multimedia Analysis (together with Y. Yang, C. Snoek, X-S. Hua, and Y. Zhuang), vol. 118, issue 1, January 2014.
- Guest Editor for International Journal of Computer Vision, Special Issue on Human-Computer Interaction: Real-Time Vision Aspects of Natural User Interfaces (together with Z. Zivkovic, H. Aghajan, and B. Kisacanin), vol. 101, issue 3, February 2013.
- Guest Editor for the Journal of Visual Communication and Image Representation, Special Issue on Large-Scale Multimedia Search (together with K. Aizawa, T. Mei, M. Wang, and J. Li), vol. 21, issue 8, November 2010.
- Guest Editor for the IEEE Transactions on Multimedia, Special issue on Multimodal Affective Interaction (together with H. Aghajan, T. Huang, N. Magnenat-Thalmann, C. Shan), vol. 12, issue 6, October 2010.
- Guest Editor for the Image and Vision Computing Journal, Special Issue on Face and Gesture Recognition (together with Maja Pantic), vol. 28, nr. 5, May 2010.
- Guest Editor for the ACM Transactions on Multimedia Computing, Communications, and Applications, Special Issue on Multimedia Analysis (together with A. Hanjalic and B. Bailey), vol. 5, nr. 1, October 2008.
- Guest Editor for Computer Vision and Image Understanding, Special Issue on Similarity Matching in Computer Vision and Multimedia (together with Qi Tian, Michael S. Lew, and Thomas S. Huang), vol. 110, nr. 3, June 2008.
- Guest Editor for the Image and Vision Computing Journal, Special Issue on Human-computer Interaction in Computer Vision (together with Michael S. Lew and Thomas S. Huang), vol. 25, issue 12, December 2007.
- Guest Editor for the IEEE Computer, Special Issue on Human-centered Computing (together with Alejandro Jaimes, Daniel Gatica-Perez, and Thomas S. Huang), vol. 40, nr. 5, May 2007.
- Guest Editor for the ACM Transactions on Multimedia Computing, Communications, and Applications, Special Issue on Multimedia Information Systems (together with Michael S. Lew and Chabane Djeraba), vol. 2, nr. 1, February 2006.
- Guest Editor for the ACM Multimedia Systems Journal, Special Issue on Systems and Architectures of Multimedia Information Retrieval (together with Michael S. Lew and Chabane Djeraba), vol. 10, nr. 6, October 2005.
- Guest Editor for Computer Vision and Image Understanding, Special Issue on Video Retrieval and Summarization (together with Michael S. Lew and Arnold Smeulders), vol. 92, nr. 2-3, November/December 2003.