The MSc module Deep Learning for Text Analytics (DELTA) is offered at the Humboldt-University of Berlin by the Chair of Information Systems.
DELTA introduces students to deep learning and natural language processing. We discuss algorithmic foundations, several deep learning methodologies, and their applications in business and society.
The module draws inspiration from several excellent resources including but not limited to:
- Natural Language Processing with Deep Learning by Stanford University
- Several awesome educational posts in Jay Alammar's blog
- The fantastic interactive e-book Dive into Deep Learning
We greatly appreciate the provision of this excellent content and highlight its contributions to the design of DELTA.
The module is offered every summer semester. Weekly sessions split into a two hour lecture session and a two hour tutorial session. The lecture introduces relevant concepts. Tutorial sessions illustrate these concepts and provide exercises for students to practice their deep learning skills.
Schedule for summer 2026:
Lecture: Thu, 10.15 - 11.45, room 202
Tutorial: Tue, 12:15 - 14:45, room 22
Topics covered in DELTA include but are not limited to:
- Fundamentals of artificial neural networks
- Fundamentals of natural language processing (NLP)
- NLP tasks and use cases
- Early forms of NLP (dictionaries, bag of word model)
- Word embeddings
- Neural network architectures for sequential and unstructured data
- Recurrent and gated neural networks
- RNNs for language modeling
- State-of-the-art NLP approaches
- Attention and Transformers
- NLP transfer learning
The repository provides the slides used in lecture sessions in the folder lecture_slides. The folder tutorial_notebooks provides the Jupyter notebooks that we discuss in the tutorial sessions. The notebooks starts with a short demo, which serves revision purposes. Their remaining part suggests programming tasks, which the students should try to solve themselves; possibly together with peers in their study group.
More detailed information on the course format, organization, and logistics is available on the DELTA Moodle page. That page also provides slides for lecture sessions and video recordings.