Theory, Practice, and Security of Foundation Models (Boninchi)
from
Monday, 29 September 2025 (08:05)
to
Friday, 3 October 2025 (20:05)
Monday, 29 September 2025
09:00
Welcome & intro
-
Slava Voloshynovskiy
(UniGE)
Welcome & intro
Slava Voloshynovskiy
(UniGE)
09:00 - 09:30
09:30
Large Models in Low Precision: Power, Limits and Scaling Laws
-
Dan Alistarh
( ISTA, Austria)
Large Models in Low Precision: Power, Limits and Scaling Laws
(Compression, searching and information-theoretic insights)
Dan Alistarh
( ISTA, Austria)
09:30 - 10:40
10:40
Coffee break ☕️🫖🥐
Coffee break ☕️🫖🥐
10:40 - 11:00
11:00
Short-term attention enables long term memorization & Stochastic activations
-
Hervé Jégou
(META)
Short-term attention enables long term memorization & Stochastic activations
(Compression, searching and information-theoretic insights)
Hervé Jégou
(META)
11:00 - 12:10
12:10
Lunch
Lunch
12:10 - 13:10
13:10
AI through the Information-Theoretic lens
-
Slava Voloshynovskiy
(UniGE)
AI through the Information-Theoretic lens
(Compression, searching and information-theoretic insights)
Slava Voloshynovskiy
(UniGE)
13:10 - 14:10
14:10
Coffee break☕️🫖
Coffee break☕️🫖
14:10 - 14:30
14:30
TwinTURBO: Semi-Supervised Fine-Tuning of Foundation Models via Mutual Information Decompositions
-
Quetant Guillaume
(UNIGE)
TwinTURBO: Semi-Supervised Fine-Tuning of Foundation Models via Mutual Information Decompositions
(Compression, searching and information-theoretic insights)
Quetant Guillaume
(UNIGE)
14:30 - 15:00
15:00
Llama4 in 4 bits
-
Brian Pulfer
(University of Geneva)
Llama4 in 4 bits
Brian Pulfer
(University of Geneva)
15:00 - 15:30
15:30
Coffee break☕️🫖
Coffee break☕️🫖
15:30 - 15:50
15:50
Diffusion LM and Compression
-
Pavlo Molchanov
(NVIDIA, USA)
Diffusion LM and Compression
Pavlo Molchanov
(NVIDIA, USA)
15:50 - 17:00
17:00
Apero on Lake Board: discussions/networking/free time
Apero on Lake Board: discussions/networking/free time
17:00 - 18:00
18:00
18:00 - 18:30
18:30
Dinner
Dinner
18:30 - 22:00
Tuesday, 30 September 2025
09:00
☕️ 🫖 🥐
☕️ 🫖 🥐
09:00 - 09:30
09:30
The Watermark Awakens
-
Pierre Fernandez
(Meta, France)
The Watermark Awakens
(Security)
Pierre Fernandez
(Meta, France)
09:30 - 10:40
10:40
☕️ 🫖
☕️ 🫖
10:40 - 11:00
11:00
The power of small language models
-
Pavlo Molchanov
(NVIDIA, USA)
The power of small language models
Pavlo Molchanov
(NVIDIA, USA)
11:00 - 12:10
12:10
Lunch
Lunch
12:10 - 13:40
13:40
Handcrafted vs. Learned: A Comparative Evaluation of Digital Watermarking Techniques
-
Vitaliy Kinakh
Handcrafted vs. Learned: A Comparative Evaluation of Digital Watermarking Techniques
(Security)
Vitaliy Kinakh
13:40 - 14:10
14:10
Attacking and Defending Vision Foundation Models
-
Yury Belousov
Attacking and Defending Vision Foundation Models
(Security)
Yury Belousov
14:10 - 14:40
14:40
☕️ 🫖
☕️ 🫖
14:40 - 15:00
15:00
TBD
-
Brian Pulfer
(University of Geneva)
TBD
(Security)
Brian Pulfer
(University of Geneva)
15:00 - 15:30
15:30
☕️ 🫖
☕️ 🫖
15:30 - 15:50
15:50
TBD
-
Seyed Mohsen Moosavi-Dezfooli
(Apple, CH)
TBD
(Security)
Seyed Mohsen Moosavi-Dezfooli
(Apple, CH)
15:50 - 17:00
17:00
☕️ 🫖
☕️ 🫖
17:00 - 17:20
17:20
Round table - industrial perspective of model security and privacy
Round table - industrial perspective of model security and privacy
17:20 - 18:00
Wednesday, 1 October 2025
10:45
Boat trip to Yvoire
Boat trip to Yvoire
10:45 - 12:25
https://maps.app.goo.gl/5xWLTmPKiUcsABdm6
12:30
Lunch & Discussion
Lunch & Discussion
12:30 - 16:30
16:45
Boat trip -Return to Geneva
Boat trip -Return to Geneva
16:45 - 18:20
Thursday, 2 October 2025
09:00
☕️🫖🥐
☕️🫖🥐
09:00 - 09:30
09:30
Generative World Models for Sample-Efficient Reinforcement Learning
-
Eloi Alonso
Vincent Micheli
Generative World Models for Sample-Efficient Reinforcement Learning
(GenAI and World Model)
Eloi Alonso
Vincent Micheli
09:30 - 10:40
10:40
☕️🫖
☕️🫖
10:40 - 11:00
11:00
Energy-Based Transformers and the Future of Scaling
-
Alexi Gladstone
(University of Illinois Urbana-Champaign/META, the USA)
Energy-Based Transformers and the Future of Scaling
(GenAI and World Model)
Alexi Gladstone
(University of Illinois Urbana-Champaign/META, the USA)
11:00 - 12:10
12:10
Lunch
Lunch
12:10 - 13:40
13:40
Mini-Bang Detection and Interpretation: Benchmarking Reasoning on Emergent and Open-Ended Dynamics
-
Andrey Ustuzanin
(Constructor University, Germany)
Mini-Bang Detection and Interpretation: Benchmarking Reasoning on Emergent and Open-Ended Dynamics
(GenAI and World Model)
Andrey Ustuzanin
(Constructor University, Germany)
13:40 - 14:30
14:30
☕️🫖
☕️🫖
14:30 - 14:50
14:50
Improving mid-resource language performance in open LLMs
-
Hanna Yukhymenko
(Hugging Face, CH)
Improving mid-resource language performance in open LLMs
(GenAI and World Model)
Hanna Yukhymenko
(Hugging Face, CH)
14:50 - 15:40
15:40
☕️🫖
☕️🫖
15:40 - 16:00
16:00
TBD
-
Yury Belousov
TBD
Yury Belousov
16:00 - 16:30
16:30
Binary Diffusion Probabilistic Model
-
Vitaliy Kinakh
Binary Diffusion Probabilistic Model
Vitaliy Kinakh
16:30 - 17:00
17:00
Discussion & Brainstorm & Free time
Discussion & Brainstorm & Free time
17:00 - 18:00
Friday, 3 October 2025
09:00
☕️🫖🥐
☕️🫖🥐
09:00 - 09:30
09:30
DINOv3
-
Federico Baldassarre
(Meta, France)
DINOv3
(Vision Foundation Models \& Reasoning)
Federico Baldassarre
(Meta, France)
09:30 - 10:30
10:30
How perception got solved (albeit unsatisfyingly)
-
Lucas Beyer
Xiaohua Zhaị
How perception got solved (albeit unsatisfyingly)
Lucas Beyer
Xiaohua Zhaị
10:30 - 11:30
11:30
☕️🫖
☕️🫖
11:30 - 11:45
11:45
Reasoning by thinking compositionally
-
Emmanuel Abbe
(EPFL / Apple, CH)
Reasoning by thinking compositionally
(Vision Foundation Models \& Reasoning)
Emmanuel Abbe
(EPFL / Apple, CH)
11:45 - 12:45
12:45
Lunch
Lunch
12:45 - 14:00
14:00
World Models for Code
-
Taco Cohen
(Meta, the UK)
World Models for Code
(Vision Foundation Models \& Reasoning)
Taco Cohen
(Meta, the UK)
14:00 - 15:00
15:00
☕️🫖
☕️🫖
15:00 - 15:20
15:20
The free transformer
-
François Fleuret
(University of Geneva /Meta, CH/France)
The free transformer
(Vision Foundation Models \& Reasoning)
François Fleuret
(University of Geneva /Meta, CH/France)
15:20 - 16:20
16:20
☕️🫖
☕️🫖
16:20 - 16:40
16:40
Vision-language models: in-context learning and adaptation for radio-astronomy
-
Mariia Drozdova
(Universite de Geneve (CH))
Vision-language models: in-context learning and adaptation for radio-astronomy
(Vision Foundation Models \& Reasoning)
Mariia Drozdova
(Universite de Geneve (CH))
16:40 - 17:10
17:10
Radio Astronomy in the Era of Large Models
-
Erica Lastufka
(University of Geneva, CH)
Radio Astronomy in the Era of Large Models
(Vision Foundation Models \& Reasoning)
Erica Lastufka
(University of Geneva, CH)
17:10 - 17:40
17:40
Summary/Conclusion/Outlook
-
Slava Voloshynovskiy
(UniGE)
Summary/Conclusion/Outlook
Slava Voloshynovskiy
(UniGE)
17:40 - 18:00
18:05
Afterparty by subscription
Afterparty by subscription
18:05 - 20:00