Talks and presentations

Federating Large Language Models from Scratch @ Alan Turing Institute

October 07, 2024

Talk, Alan Turing Institute, London, London, UK

The Research Engineering Team at the Alan Turing Institute invited me to present our work on federated learning of large language models. This talk was inserted in the seminar series titled “Robots in Disguise”. I presented our work on federated learning of large language models, in particular, how we can train large language models from scratch in a federated manner. A wider introduction to federate learning and its main challenges was also presented.

Federating Everything with Flower @ iEDGE Symposium - FOUNDATION MODELS AT THE EDGE

July 09, 2024

Keynote, Interncontinental Shenzhen Hotel (remote), Shenzhen, China

On the 7th July 2024, I helped Javier Fernandez-Marques presenting a keytone with the title “Federating Everything with Flower” at iEDGE Symposium - FOUNDATION MODELS AT THE EDGE. In particular, I presented a few insights of our earlier work on large language models and how Flower can be used to federate them. For more details regarding this project please visit the project page.