SS19 InfTheory

Information Theory SS2019

Information Theory

Lecture:      

held by:           Prof. Dr. Vera Demberg

                       Prof. Dr. Matthew Crocker

Location:          see moodle for details    

time:               04.04. - 12.04.2019 (see moodle for details)

start:               04.04.2019

            

suitable for:      M.Sc. in Computerlinguistik

______________________________________________________________

I m p o r t a n t   I n f o r m a t i o n

  • Moodle

All information regarding schedule, location and topics can be found in the Moodle.

Before the first lecture:   Sign up to the Moodle before 04 April, and enrol in the course.

 

_______________________________________________________________

C o n t e n t   o f   l e c t u r e

This course will cover the mathematical basis of information theory, and then proceed to information theoretic approaches to the study of language, with respect to language comprehension, language production and language evolution. We will also discuss methodologies for testing hypotheses related to these information-theoretic concepts.

The course will include tutorials where we look at ways to estimate surprisal from text corpora, in order to test for effects of surprisal or uniform information density.

 

R e q u i r e m e n t s

Each student needs to attend the meetings and prticipate in discussions. Grades will be determined based on a poster project. Posters will  be presented at the last meeting on Friday, 12 April 2019.

Students will form groups of two or three to prepare a poster. Each group of students should prepare a research proposal of what linguistic phenomenon could be investigated using surprisal or the UID hypothesis. In particular, students should propose what kind of research method to use for tackling the question, what results they would expect, and what it would mean to find different results than the expected ones (The research does not actually have to be carried out; the posters are about application ideas /proposals.)

 

H o w   t o   p r e p a r e

For the first tutorial, students will need:

  • R installed on their laptops
  • A terminal application
  • Logins for the Coli servers
  • Basic knowledge of Unix

 

 

Last modified 2019-03-14 by gabi

Impressum - Haftungsausschluss