About

I am a researcher, a software designer and engineer, and an interactive media artist. I am mainly interested in Human-Computer Interaction, interactive machine learning, interactive audiovisual art, digitally-enhanced performance, and innovation in the music business and creative industries.

I hold a PhD in Computer Science from Goldsmiths, University of London. I hold a B.S. in Computer Science and Systems Engineering and an MSc in Mobile Systems, both from University of Minho. I also hold an M.A. in Management of Creative Industries, from Portuguese Catholic University, with specialism in Creativity and Innovation in the Music Industry.

I have worked in the software industry as a front-end engineer for about 8 years, in Interactive Digital Signage, Corporate TV (Ubisign) and Business Intelligence (PRIMAVERA BSS) products. I designed and developed front-end architectures for SaaS services. I did software engineering, interaction design and project management for public screen, web, mobile and augmented reality applications. I was also an Alpha Developer for Google ATAP Project Soli, for which I developed software and interaction design for new application concepts.

Since 2013, I have been working on applied research or R&D in public-funded research projects at the interface between academia and industry. In the EU Horizon 2020-funded Innovation Action RAPID-MIX, in the Embodied Audiovisual Interaction (EAVI) group, at Goldsmiths, University of London. I applied Human-Computer Interaction to the design and development of the RAPID-MIX API, a user-friendly machine learning toolkit for creative developers.

Previously, I developed prototypes for Augmented Reality and Natural User Interfaces in project VisualyzARt, at CITAR/UCP. At the Ubicomp group at University of Minho, I developed context-aware middleware and client applications for multimodal and situated interaction with pervasive public displays.

Currently, I work in the UKRI/AHRC project MIMIC as a Postdoctoral Research Fellow, at University of Sussex, in the School of Media, Film and Music. I am the co-creator and developer of Sema, a web-based, on-line playground for live code language design and performance, which integrates real-time interactive machine learning and machine listening with an on-line reactive compiler for signal processing.

Selected work

Research

Projects

2019–2020 — MIMIC: Musically Intelligent Machines Interacting Collectivelly
Project ID: AH/R002657/1, funded by UKRI/AHRC

2015–2018 — RAPID-MIX: Realtime Adaptive Prototyping for Industrial Design of Multimodal Interactive eXpressive Technology
Project ID: 644862, funded by EU Horizon 2020 ICT-2014-1

2013–2014 — VisualYsART: Visual Programming Framework for Augmented Reality and Ubiquitous Natural User Interfaces
Ref: 23201, funded by FEDER, through COMPETE program (POFC)

2006–2007 — SITUACTION: Situated Web Portal for Local Awareness and Transient Interaction
Ref: POS-C/EIA/58832/2004, UbiComp group, ALGORITMI Center, University of Minho

Publications

Bernardo, F., Kiefer, C., Magnusson, T. (2020). Designing for a Pluralist and User-Friendly Live Code Language Ecosystem with Sema
5th International Conference on Live Coding
University of Limerick, Limerick, Ireland

Bernardo, F., Kiefer, C., Magnusson, T. (2019). An AudioWorklet-based Signal Engine for a Live Coding Language Ecosystem
Best Paper Award at Web Audio Conference 2019. In Proceedings of Web Audio Conference 2019
Norwegian University of Science and Technology (NTNU), Trondheim, Norway

Bernardo, F., Grierson, M., Fiebrink, R. (2018). User-Centred Design Actions for Lightweight Evaluation of an Interactive Machine Learning Toolkit
Journal of Science and Technology of the Arts (CITARj), v. 10, n. 2, p. 2- 25-38, jul. 2018. ISSN 2183-0088.
DOI: http://dx.doi.org/10.7559/citarj.v10i2.509

Bernardo, F., Zbyszyński, M., Fiebrink, R., Grierson, M. (2017). Interactive Machine Learning for End-User Innovation
Designing the User Experience of Machine Learning Systems
Proceedings of Association for the Advancement of Artificial Inteligence (AAAI) Spring Symposium,
Stanford University, Palo Alto, CA

Bernardo, F., Arner, N., Batchelor, P. (2017). O Soli Mio: Exploring Millimeter Wave Radar for Musical Interaction
Proceedings of New Interfaces for Musical Expression 2017, Aalborg University, Copenhagen, Denmark

publications ++

Tilmanne, J., d’Alessandro, N., Barborka, P., Bayansar, F., Bernardo, F., Fiebrink, R., Heloir, A., Hemery, E.,
Laraba, S., Moinet, A., Nunnari, F., Ravet, T., Reboursière, L., Sarasua, A., Tits, M., Tits, N., Zajéga, F. (2018).
Prototyping a New Audio-Visual Instrument Based on Extraction of High-Level Features on Full-Body Motion
Technical Report, in Proceedings of eNTERFACE 2015 Workshop on Intelligent Interfaces, Mons, Belgium

Parkinson, A., Zbyszyński, M., Bernardo, F. (2017). Demonstrating Interactive Machine Learning Tools for Rapid Prototyping of Gestural Instruments in the Browser
Proceedings of Web Audio Conference 2017, Queen Mary University of London, London, UK

Ward, N., Ortiz, M., Bernardo, F., Tanaka, A. (2016). Designing and measuring gesture using Laban Movement Analysis and Electromyogram
3rd Workshop on Full-Body and Multisensory Experience (BodySenseUX@UbiComp'16), Heidelberg, Germany

Bernardo, F., Pestana, P., Martins, L. (2015). The Smart Stage: Designing 3D Interaction Metaphors for Immersive and Ubiquitous Music Systems
International Conference on New Music Concepts (ICNMC 2015), Treviso, Italy - ISBN: 978-88-6551-188-6

Bernardo, F., Martins, L. (2014). Disintermediation Effects on Independent Approaches to Music Business
International Journal of Music Business Research (IJMBR) – issn 2227-5789

Bernardo, F. (2014). Music video games in live performance: Catachresis or an emergent approach?
Videojogos 2014 - Conferência de Ciências e Artes dos Videojogos, Barcelos, Portugal

Bernardo, F. (2014). Dodging the Middleman: Insights on Disintermediation in the Independent Music Sector
KISMIF International Conference on Underground music scenes and DIY cultures, Porto, Portugal

Bernardo, F., Martins, L. (2013). Disintermediation effects in the music business – A return to old times?
Music Business Research Days 2013, Vienna, Austria.
Best Paper award at the Young Scholars Workshop.

José, R., Bernardo, F. (2009). Extended Bluetooth naming for empowered presence and situated interaction with public displays
3th Symposium of Ubiquitous Computing and Ambient Intelligence 2008


Teaching + Invited Lectures

2019 — Interactive Music Systems
2nd-year module of the Music Technology undergraduate degree
School of Media, Film and Music
University of Sussex, Brighton, United Kingdom

2019 — Designing with Data and Interactive Machine Learning
5-day intensive course at the Creative Computing Institute
University of the Arts, London, United Kingdom

2018 — Designing with Data and Interactive Machine Learning (1-day lecture)
Master in Product Design
Royal College of Art, London, United Kingdom

2014 — Research Strategy and Methodology Design
Master in Management for the Creative Industries
Portuguese Catholic University, Porto, Portugal

teaching ++

2014 — Interactive Sound Design and Dataflow Programming with PureData
Post graduation in Digital Design
Portuguese Catholic University, Porto, Portugal

2014 — Research Strategy and Methodology Design
Master in Music Teaching
Portuguese Catholic University, Porto, Portugal

2013 — Research methodology design
Science and Technology of the Arts Doctoral Programme
Portuguese Catholic University, Porto, Portugal


Workshops + Presentations + Talks

2019 — Designing and Performing with Live Coding Languages for Signal Processing and Machine Intelligence on the Web
Workshop organiser and facilitator with Chris Kiefer and Thor Magnusson
Web Audio Conference 2019, Norwegian University of Science and Technology (NTNU),
Trondheim, Norway

2019 — MIMIC Artist Summer Workshop
Workshop organiser and facilitator with Chris Kiefer and Thor Magnusson
Sussex Humanities Lab – School of Media, Sound and Music
University of Sussex, Brighton, United Kingdom

2019 — Live Coding Machine Learning
Workshop leader with Chris Kiefer and Thor Magnusson
4th International Conference on Live Coding
MediaLab Prado, Madrid

2018 — Fostering synergies between Art and Innovation
Invited speaker @ "El Arte como herramienta de innovación y emprendimiento"
ETSIDI-UPM, Madrid, Spain

workshops + talks ++

2017 — The RAPID-MIX API: a toolkit for fostering innovation in the creative industries with Multimodal, Interactive and eXpressive (MIX) technologies
Workshop leader with Joseph Larralde (IRCAM), Sebastian Mealla and Panos Papiotis (MTG/UPF)
eNTERFACE'17 - 13th International Summer Workshop on Multimodal Interfaces, 3 – 28 July, Porto, Portugal

2017 — Sound Design In The Cloud
Workshop facilitator with Visda Goudarzi, Mathieu Barthet, Miguel Ceriani, Johan Pauwels, György Fazekas and Rebecca Fiebrink
AudioMostly 2017: Augmented and Participatory Sound and Music Experiences, 23-26 August
Queen Mary University of London, UK

2016 — SoliDSPFeatures2OSC: Feature Selection Tool for Prototyping Creative Audiovisuals with Soli
Presenter - Soli Alpha Developers Workshop, Google, Mountain View, California

2016 — Interactive Applications in Machine Learning
Workshop co-presenter with Atau Tanaka
Porto International Conference on Musical Gesture as Creative Interface, Porto, Portugal

2015 — Design de Tecnologias Wearable para Performance Expressiva e Musical
Workshop co-presenter with Michael Zbyszyński
MakerFaire Lisbon 2015, Lisbon, Portugal

2014 — The Smart Stage: Designing interaction for immersive and ubiquitous music systems
Presenter – Encontro Nacional de Investigação em Música (ENIM) 2014, Lisbon, Portugal

2013 — Disintermediation effects in the music business - A return to old times?
Presenter - Vienna Music Business Research Days 2013 - Vienna, Austria

2008 — Bluetooth Naming for Situated Interaction in Ubiquitous Environments
Presenter - UCAMI 2008 - Salamanca, Spain


Dissertations

Bernardo, Francisco (2020). Interactive Machine Learning for User-Innovation Toolkits: An Action Research approach,
PhD Thesis. Goldsmiths, University of London, United Kingdom
advisors: Rebecca Fiebrink and Mick Grierson

Bernardo, Francisco (2013). The Impact of Disintermediation in Independent Music Business Models,
Master in Management of Creative Industries. Universidade Católica Portuguesa, Porto, Portugal
advisors: Luis Gustavo Martins and Ricardo Morais

Bernardo, Francisco (2009). Bluetooth Naming for Situated Interaction in Ubiquitous Environments ,
Master in Mobile Systems. Universidade do Minho, Braga, Portugal
advisor: Rui José

Say hello