This session will provide an overview of Large Language Models (LLMs), the technology behind applications such as ChatGPT and other solutions in the areas of Natural Language Processing and Understanding.

After a brief description of the main underlying technology (Transformer architecture) and the different versions or approaches of LLMs that are in use today, the workshop will focus upon the main requirements needed to develop LLMs, the capabilities of current technologies and the main limitations, for example, with regard to factuality (“hallucinations”) but also legal aspects.

Additionally, the event will highlight current European initiatives towards the development of Open Source LLMs and collection of data and datasets that cover all European languages.

Speakers & Agenda:

• Introduction to LLM's – Philippe Gelin (Head of Sector "Multilingualism", European Commission)
• EC policies landscape on Language Technologies – Yvo Volman (Director G Data, European Commission)
• Overview, Basic Concepts, Capabilities – Georg Rehm, Pedro Ortiz, Malte Ostendorff (German Research Centre for Artificial Intelligence, DFKI, Germany)
• Limitations and Evaluation – Ondrej Bojar (Charles University, Czech Republic)
• Legal Aspects in a Nutshell – Mickael Rigault (Evaluations and Language Resources Distribution Agency, ELDA, France)
• Data Governance – Anna Rogers (IT University of Copenhagen, Denmark)
• Ethical Aspects and Biases – Karën Fort (LORIA, Sorbonne University, France)
• Enabling New and Boosting Existing Applications – Peter Sarlin (Silo.AI, Sweden)

This workshop is organised together with the European Language Data Space (LDS).