Research Presentation, Vancouver Convention Centre, Vancouver, BC, Canada
On the 15th of December 2024, I presented our work on federated pre-training of large language models at the NeurIPS workshop on Federated Learning for Foundational Models @ Federated Laerning.
On the 20th of November 2024, I presented our work on federated learning of large language models at the Flower AMA session. With the help of Prof. Nicholas D. Lane, Alexandru-Andrei Iacob and Preslav Aleksandrov, we discussed some critical aspects of pre-training language models and their relevancy to the federated approach.
Talk, Alan Turing Institute, London, London, UK
The Research Engineering Team at the Alan Turing Institute invited me to present our work on federated learning of large language models. This talk was inserted in the seminar series titled “Robots in Disguise”. I presented our work on federated learning of large language models, in particular, how we can train large language models from scratch in a federated manner. A wider introduction to federate learning and its main challenges was also presented.
Talk, Online, Google Research, Seattle, Seattle, WA, USA
I was invited by Zachary Charles to present our work on federated learning of large language models to the Google Research team working on privacy and federated learning.
Keynote, Online, IGSG Bologna, Bologna, Italy
I was invited by Eleonora Ferrari to discuss the future of AI and the impact of related emerging technologies on the juridical field. The workshop was organized by the IGSG Bologna.
Talk, MobiUK '24 @ University of Southampton, Southampton, UK
I attended MobiUK ‘24 in Southampton presenting the work “Worldwide Edge-SILO Federated Training of Language Models” on behalf of Alex Iacob who couldn’t attend. For more details regarding this project please visit the project page.
Keynote, Interncontinental Shenzhen Hotel (remote), Shenzhen, China
On the 7th July 2024, I helped Javier Fernandez-Marques presenting a keytone with the title “Federating Everything with Flower” at iEDGE Symposium - FOUNDATION MODELS AT THE EDGE. In particular, I presented a few insights of our earlier work on large language models and how Flower can be used to federate them. For more details regarding this project please visit the project page.
Tutorial, Columbia University, New York NY, USA
On the 6th of March 2023, Scott Zhao invited the CaMLSys group to run a tutorial about the Flower framework.