I am a researcher, a software designer and engineer, and an interactive media artist. I am mainly interested in Human-Computer Interaction, interactive machine learning, interactive audiovisual art, digitally-enhanced performance, and innovation in the music business and creative industries.

I hold a PhD in Computer Science from Goldsmiths, University of London. I hold a B.S. in Computer Science and Systems Engineering and an MSc in Mobile Systems, both from University of Minho. I also hold an M.A. in Management of Creative Industries, from Portuguese Catholic University, with specialism in Creativity and Innovation in the Music Industry.

I have worked in the software industry as a front-end engineer for about 8 years, in Interactive Digital Signage, Corporate TV (Ubisign) and Business Intelligence (PRIMAVERA BSS) products. I designed and developed front-end architectures for SaaS services. I did software engineering, interaction design and project management for public screen, web, mobile and augmented reality applications. I was also an Alpha Developer for Google ATAP Project Soli, for which I developed software and interaction design for new application concepts.

Since 2013, I have been working on applied research or R&D in public-funded research projects at the interface between academia and industry. In the EU Horizon 2020-funded Innovation Action RAPID-MIX, in the Embodied Audiovisual Interaction (EAVI) group, at Goldsmiths, University of London. I applied Human-Computer Interaction to the design and development of the RAPID-MIX API, a user-friendly machine learning toolkit for creative developers.

Previously, I developed prototypes for Augmented Reality and Natural User Interfaces in project VisualyzARt, at CITAR/UCP. At the Ubicomp group at University of Minho, I developed context-aware middleware and client applications for multimodal and situated interaction with pervasive public displays.

Currently, I work in the UKRI/AHRC project MIMIC as a Postdoctoral Research Fellow, at University of Sussex, in the School of Media, Film and Music. I am the co-creator and developer of Sema, a web-based, on-line playground for live code language design and performance, which integrates real-time interactive machine learning and machine listening with an on-line reactive compiler for signal processing.

CV

Short CV

Blog

Projects

2019–2020 — MIMIC: Musically Intelligent Machines Interacting Collectivelly
Project ID: AH/R002657/1, funded by UKRI/AHRC

2015–2018 — RAPID-MIX: Realtime Adaptive Prototyping for Industrial Design of Multimodal Interactive eXpressive Technology
Project ID: 644862, funded by EU Horizon 2020 ICT-2014-1

2013–2014 — VisualYsART: Visual Programming Framework for Augmented Reality and Ubiquitous Natural User Interfaces
Ref: 23201, funded by FEDER, through COMPETE program (POFC)

2006–2007 — SITUACTION: Situated Web Portal for Local Awareness and Transient Interaction
Ref: POS-C/EIA/58832/2004, UbiComp group, ALGORITMI Center, University of Minho

Publications

Bernardo, F., Kiefer, C., Magnusson, T. (2020). Designing for a Pluralist and User-Friendly Live Code Language Ecosystem with Sema
5th International Conference on Live Coding
University of Limerick, Limerick, Ireland

Bernardo, F., Kiefer, C., Magnusson, T. (2019). An AudioWorklet-based Signal Engine for a Live Coding Language Ecosystem
Best Paper Award at Web Audio Conference 2019. In Proceedings of Web Audio Conference 2019
Norwegian University of Science and Technology (NTNU), Trondheim, Norway

Bernardo, F., Grierson, M., Fiebrink, R. (2018). User-Centred Design Actions for Lightweight Evaluation of an Interactive Machine Learning Toolkit
Journal of Science and Technology of the Arts (CITARj), v. 10, n. 2, p. 2- 25-38, jul. 2018. ISSN 2183-0088.
DOI: http://dx.doi.org/10.7559/citarj.v10i2.509

Bernardo, F., Zbyszyński, M., Fiebrink, R., Grierson, M. (2017). Interactive Machine Learning for End-User Innovation
Designing the User Experience of Machine Learning Systems
Proceedings of Association for the Advancement of Artificial Inteligence (AAAI) Spring Symposium,
Stanford University, Palo Alto, CA

Bernardo, F., Arner, N., Batchelor, P. (2017). O Soli Mio: Exploring Millimeter Wave Radar for Musical Interaction
Proceedings of New Interfaces for Musical Expression 2017, Aalborg University, Copenhagen, Denmark

Dissertations

Bernardo, Francisco (2020). Interactive Machine Learning for User-Innovation Toolkits: An Action Research approach,
PhD Thesis. Goldsmiths, University of London, United Kingdom
advisors: Rebecca Fiebrink and Mick Grierson

Bernardo, Francisco (2013). The Impact of Disintermediation in Independent Music Business Models,
Master in Management of Creative Industries. Universidade Católica Portuguesa, Porto, Portugal
advisors: Luis Gustavo Martins and Ricardo Morais

Bernardo, Francisco (2009). Bluetooth Naming for Situated Interaction in Ubiquitous Environments ,
Master in Mobile Systems. Universidade do Minho, Braga, Portugal
advisor: Rui José