Course catalog

19334617

WiSe 24/25: Seminar/Proseminar: Multi-Agent Reinforcement Learning

Tim Landgraf

Comments

This seminar provides an exploration of large language models (LLMs), covering both foundational concepts and the latest advancements in the field. Participants will gain a comprehensive understanding of the architecture, training, and applications of LLMs, based on seminal research papers. The course will be organised as a journal club: students present individual papers, which are then discussed in the group to make sure we all get the ideas presented.

### Potential Topics

- Neural networks and deep learning basics

- Sequence modeling and RNNs (Recurrent Neural Networks)

- Vaswani et al.'s "Attention is All You Need" paper

- Self-attention mechanism

- Multi-head attention and positional encoding

- GPT-1: Radford et al.'s pioneering work

- GPT-2: Scaling and implications

- GPT-3: Architectural advancements and few-shot learning

- BERT (Bidirectional Encoder Representations from Transformers)

- T5 (Text-To-Text Transfer Transformer)

- DistilBERT and efficiency improvements

- Mamba:l and other SSMs: Design principles and performance

- Flash Attention et al: Improving efficiency and scalability

- Training regimes and resource requirements

- Fine-tuning and transfer learning

- Emergence of new capabilities

close

16 Class schedule

Regular appointments

Mon, 10:00 - 12:00 Seminar/Proseminar: Large Language Models 16 Class schedule

Mon, 2024-10-14 10:00 - 12:00

Seminar/Proseminar: Large Language Models

Lecturers:
Prof. Dr. Tim Landgraf

Location:
A6/SR 007/008 Seminarraum (Arnimallee 6)

Mon, 2024-10-21 10:00 - 12:00

Seminar/Proseminar: Large Language Models

Lecturers:
Prof. Dr. Tim Landgraf

Location:
A6/SR 007/008 Seminarraum (Arnimallee 6)

Mon, 2024-10-28 10:00 - 12:00

Seminar/Proseminar: Large Language Models

Lecturers:
Prof. Dr. Tim Landgraf

Location:
A6/SR 007/008 Seminarraum (Arnimallee 6)

Mon, 2024-11-04 10:00 - 12:00

Seminar/Proseminar: Large Language Models

Lecturers:
Prof. Dr. Tim Landgraf

Location:
A6/SR 007/008 Seminarraum (Arnimallee 6)

Mon, 2024-11-11 10:00 - 12:00

Seminar/Proseminar: Large Language Models

Lecturers:
Prof. Dr. Tim Landgraf

Location:
A6/SR 007/008 Seminarraum (Arnimallee 6)

Mon, 2024-11-18 10:00 - 12:00

Seminar/Proseminar: Large Language Models

Lecturers:
Prof. Dr. Tim Landgraf

Location:
A6/SR 007/008 Seminarraum (Arnimallee 6)

Mon, 2024-11-25 10:00 - 12:00

Seminar/Proseminar: Large Language Models

Lecturers:
Prof. Dr. Tim Landgraf

Location:
A6/SR 007/008 Seminarraum (Arnimallee 6)

Mon, 2024-12-02 10:00 - 12:00

Seminar/Proseminar: Large Language Models

Lecturers:
Prof. Dr. Tim Landgraf

Location:
A6/SR 007/008 Seminarraum (Arnimallee 6)

Mon, 2024-12-09 10:00 - 12:00

Seminar/Proseminar: Large Language Models

Lecturers:
Prof. Dr. Tim Landgraf

Location:
A6/SR 007/008 Seminarraum (Arnimallee 6)

Mon, 2024-12-16 10:00 - 12:00

Seminar/Proseminar: Large Language Models

Lecturers:
Prof. Dr. Tim Landgraf

Location:
A6/SR 007/008 Seminarraum (Arnimallee 6)

Mon, 2025-01-06 10:00 - 12:00

Seminar/Proseminar: Large Language Models

Lecturers:
Prof. Dr. Tim Landgraf

Location:
A6/SR 007/008 Seminarraum (Arnimallee 6)

Mon, 2025-01-13 10:00 - 12:00

Seminar/Proseminar: Large Language Models

Lecturers:
Prof. Dr. Tim Landgraf

Location:
A6/SR 007/008 Seminarraum (Arnimallee 6)

Mon, 2025-01-20 10:00 - 12:00

Seminar/Proseminar: Large Language Models

Lecturers:
Prof. Dr. Tim Landgraf

Location:
A6/SR 007/008 Seminarraum (Arnimallee 6)

Mon, 2025-01-27 10:00 - 12:00

Seminar/Proseminar: Large Language Models

Lecturers:
Prof. Dr. Tim Landgraf

Location:
A6/SR 007/008 Seminarraum (Arnimallee 6)

Mon, 2025-02-03 10:00 - 12:00

Seminar/Proseminar: Large Language Models

Lecturers:
Prof. Dr. Tim Landgraf

Location:
A6/SR 007/008 Seminarraum (Arnimallee 6)

Mon, 2025-02-10 10:00 - 12:00

Seminar/Proseminar: Large Language Models

Lecturers:
Prof. Dr. Tim Landgraf

Location:
A6/SR 007/008 Seminarraum (Arnimallee 6)

More search results for 'landgraf'

Location: A6/SR 007/008 Seminarraum (Arnimallee 6)

Schedule: Mo 10:00-12:00

Class starts on: 2024-10-14

Course language: English

Contact hours: 2

Number of participants: 20

Limited attendance: Yes

Attendance required: Yes

Modules where this course belongs

Information for pregnant and nursing students