I am a researcher, a software designer and an interactive media artist. I am mainly interested in Human-Computer Interaction, interactive machine learning, interactive audiovisual art, digitally enhanced performance, and innovation in the music business and creative industries.

I am a PhD candidate in Computer Science at Goldsmiths, University of London, in the Embodied Audiovisual Interaction (EAVI) group. I hold a B.S. in Computer Science and Systems Engineering and an MSc in Mobile Systems, both from University of Minho. I also hold an M.A. in Management of Creative Industries, from Portuguese Catholic University, with specialism in Creativity and Innovation in the Music Industry.

I have worked in the software industry as front-end engineer for about 8 years, in Interactive Digital Signage, Corporate TV (Ubisign) and Business Intelligence (PRIMAVERA BSS) products. I designed and developed front-end architectures for SaaS services, and did software engineering and interaction design for public screen, web, mobile and augmented reality applications. I was also an Alpha Developer for Google ATAP Project Soli, for which I developed software and interaction design for new application concepts.

Since 2013, I have been working at the interface between academia and industry, mostly on applied research or R&D in large-scale, public-funded research projects. In the EU Horizon 2020-funded Innovation Action RAPID-MIX, I applied Action Research and Human-Computer Interaction methodologies to the design and development of the RAPID-MIX API, a user-friendly machine learning toolkit for creative developers. I developed prototypes and proofs-of-concept for Augmented Reality and Natural User Interfaces in project VisualyzARt, at CITAR/UCP. In project SituAction, I developed context-aware middleware and applications for situated and multimodal interaction with pervasive public displays (Ubicomp@UMinho).

Currently, I work in the UKRI/AHRC project MIMIC as a Postdoctoral Research Fellow, at University of Sussex, in the School of Media, Film and Music. I am the co-creator and developer of Sema, a web-based, on-line playground for live code language design and performance, which integrates real-time interactive machine learning, machine listening and signal processing.

CV

Short CV

Blog

Projects

2019–2020 — MIMIC: Musically Intelligent Machines Interacting Collectivelly
Project ID: AH/R002657/1, funded by UKRI/AHRC

2015–2018 — RAPID-MIX: Realtime Adaptive Prototyping for Industrial Design of Multimodal Interactive eXpressive Technology
Project ID: 644862, funded by EU Horizon 2020 ICT-2014-1

2013–2014 — VisualYsART: Visual Programming Framework for Augmented Reality and Ubiquitous Natural User Interfaces
Ref: 23201, funded by FEDER, through COMPETE program (POFC)

2006–2007 — SITUACTION: Situated Web Portal for Local Awareness and Transient Interaction
Ref: POS-C/EIA/58832/2004, UbiComp group, ALGORITMI Center, University of Minho

Publications

Bernardo, F., Kiefer, C., Magnusson, T. (forthcoming). Designing for a Pluralist and User-Friendly Live Code Language Ecosystem with Sema
5th International Conference on Live Coding
University of Limerick, Limerick, Ireland

Bernardo, F., Kiefer, C., Magnusson, T. (2019). An AudioWorklet-based Signal Engine for a Live Coding Language Ecosystem
Best Paper Award at Web Audio Conference 2019. In Proceedings of Web Audio Conference 2019
Norwegian University of Science and Technology (NTNU), Trondheim, Norway

Bernardo, F., Grierson, M., Fiebrink, R. (2018). User-Centred Design Actions for Lightweight Evaluation of an Interactive Machine Learning Toolkit
Journal of Science and Technology of the Arts (CITARj), v. 10, n. 2, p. 2- 25-38, jul. 2018. ISSN 2183-0088.
DOI: http://dx.doi.org/10.7559/citarj.v10i2.509

Bernardo, F., Zbyszyński, M., Fiebrink, R., Grierson, M. (2017). Interactive Machine Learning for End-User Innovation
Designing the User Experience of Machine Learning Systems
Proceedings of Association for the Advancement of Artificial Inteligence (AAAI) Spring Symposium,
Stanford University, Palo Alto, CA

Bernardo, F., Arner, N., Batchelor, P. (2017). O Soli Mio: Exploring Millimeter Wave Radar for Musical Interaction
Proceedings of New Interfaces for Musical Expression 2017, Aalborg University, Copenhagen, Denmark

Dissertations

Bernardo, Francisco (2013). The Impact of Disintermediation in Independent Music Business Models,
Master in Management of Creative Industries, Universidade Católica Portuguesa, Porto, Portugal, advised by Luis Gustavo Martins and Ricardo Morais

Bernardo, Francisco (2009). Bluetooth Naming for Situated Interaction in Ubiquitous Environments ,
Master in Mobile Systems, Universidade do Minho, Braga, Portugal, advised by Rui José