Modern Channel Coding, Inference and Learning, 6 credits (TSKS12)

Modern kanalkodning, inferens och inlärning, 6 hp

Main field of study

Electrical Engineering

Level

Second cycle

Course type

Programme course

Examiner

Danyo Danev

Director of studies or equivalent

Klas Nordberg

Available for exchange students

Yes
Course offered for Semester Period Timetable module Language Campus VOF
6CDDD Computer Science and Engineering, M Sc in Engineering (Communication) 9 (Autumn 2017) 1 1 English Linköping v
6CDDD Computer Science and Engineering, M Sc in Engineering 9 (Autumn 2017) 1 1 English Linköping v
6CIEI Industrial Engineering and Management - International, M Sc in Engineering (Specialization Electrical Engineering) 9 (Autumn 2017) 1 1 English Linköping v
6CIEI Industrial Engineering and Management - International, M Sc in Engineering 9 (Autumn 2017) 1 1 English Linköping v
6CIEI Industrial Engineering and Management - International, M Sc in Engineering (Master Profile Telecommunication) 9 (Autumn 2017) 1 1 English Linköping v
6CIEI Industrial Engineering and Management - International, M Sc in Engineering (Specialization Electrical Engineering) 9 (Autumn 2017) 1 1 English Linköping v
6CIEI Industrial Engineering and Management - International, M Sc in Engineering 9 (Autumn 2017) 1 1 English Linköping v
6CIEI Industrial Engineering and Management - International, M Sc in Engineering (Master Profile Telecommunication) 9 (Autumn 2017) 1 1 English Linköping v
6CIEI Industrial Engineering and Management - International, M Sc in Engineering (Specialization Electrical Engineering) 9 (Autumn 2017) 1 1 English Linköping v
6CIEI Industrial Engineering and Management - International, M Sc in Engineering 9 (Autumn 2017) 1 1 English Linköping v
6CIEI Industrial Engineering and Management - International, M Sc in Engineering (Master Profile Telecommunication) 9 (Autumn 2017) 1 1 English Linköping v
6CIEI Industrial Engineering and Management - International, M Sc in Engineering (Specialization Electrical Engineering) 9 (Autumn 2017) 1 1 English Linköping v
6CIEI Industrial Engineering and Management - International, M Sc in Engineering 9 (Autumn 2017) 1 1 English Linköping v
6CIEI Industrial Engineering and Management - International, M Sc in Engineering (Master Profile Telecommunication) 9 (Autumn 2017) 1 1 English Linköping v
6CIEI Industrial Engineering and Management - International, M Sc in Engineering (Specialization Electrical Engineering) 9 (Autumn 2017) 1 1 English Linköping v
6CIEI Industrial Engineering and Management - International, M Sc in Engineering 9 (Autumn 2017) 1 1 English Linköping v
6CIEI Industrial Engineering and Management - International, M Sc in Engineering (Master Profile Telecommunication) 9 (Autumn 2017) 1 1 English Linköping v
6CIII Industrial Engineering and Management, M Sc in Engineering 9 (Autumn 2017) 1 1 English Linköping v
6CIII Industrial Engineering and Management, M Sc in Engineering (Specialization Electrical Engineering) 9 (Autumn 2017) 1 1 English Linköping v
6CIII Industrial Engineering and Management, M Sc in Engineering (Master Profile Telecommunication) 9 (Autumn 2017) 1 1 English Linköping v
6CYYY Applied Physics and Electrical Engineering, M Sc in Engineering (Communication) 9 (Autumn 2017) 1 1 English Linköping v
6CYYY Applied Physics and Electrical Engineering, M Sc in Engineering 9 (Autumn 2017) 1 1 English Linköping v
6MCSY Communication Systems, Master's programme 3 (Autumn 2017) 1 1 English Linköping o
6MDAV Computer Science, Master's programme 3 (Autumn 2017) 1 1 English Linköping v
6MMAT Mathematics, Master's programme (Computer Science) 3 (Autumn 2017) 1 1 English Linköping v
6MMAT Mathematics, Master's programme 3 (Autumn 2017) 1 1 English Linköping v
6CITE Information Technology, M Sc in Engineering 9 (Autumn 2017) 1 1 English Linköping v
6CITE Information Technology, M Sc in Engineering (Communication) 9 (Autumn 2017) 1 1 Swedish Linköping v
6CYYI Applied Physics and Electrical Engineering - International, M Sc in Engineering (Communication) 9 (Autumn 2017) 1 1 English Linköping v
6CYYI Applied Physics and Electrical Engineering - International, M Sc in Engineering 9 (Autumn 2017) 1 1 English Linköping v
6CYYI Applied Physics and Electrical Engineering - International, M Sc in Engineering (Communication) 9 (Autumn 2017) 1 1 English Linköping v
6CYYI Applied Physics and Electrical Engineering - International, M Sc in Engineering 9 (Autumn 2017) 1 1 English Linköping v
6CYYI Applied Physics and Electrical Engineering - International, M Sc in Engineering (Communication) 9 (Autumn 2017) 1 1 English Linköping v
6CYYI Applied Physics and Electrical Engineering - International, M Sc in Engineering 9 (Autumn 2017) 1 1 English Linköping v
6CYYI Applied Physics and Electrical Engineering - International, M Sc in Engineering (Communication) 9 (Autumn 2017) 1 1 English Linköping v
6CYYI Applied Physics and Electrical Engineering - International, M Sc in Engineering 9 (Autumn 2017) 1 1 English Linköping v
6CYYI Applied Physics and Electrical Engineering - International, M Sc in Engineering (Communication) 9 (Autumn 2017) 1 1 English Linköping v
6CYYI Applied Physics and Electrical Engineering - International, M Sc in Engineering 9 (Autumn 2017) 1 1 English Linköping v
6CMJU Computer Science and Software Engineering, M Sc in Engineering 9 (Autumn 2017) 1 1 English Linköping v
6MICS Computer Science, Master's programme 3 (Autumn 2017) 1 1 English Linköping v

Main field of study

Electrical Engineering

Course level

Second cycle

Advancement level

A1X

Course offered for

  • Computer Science and Engineering, M Sc in Engineering
  • Industrial Engineering and Management - International, M Sc in Engineering
  • Industrial Engineering and Management, M Sc in Engineering
  • Applied Physics and Electrical Engineering, M Sc in Engineering
  • Communication Systems, Master's programme
  • Computer Science, Master's programme
  • Mathematics, Master's programme
  • Information Technology, M Sc in Engineering
  • Applied Physics and Electrical Engineering - International, M Sc in Engineering
  • Computer Science and Software Engineering, M Sc in Engineering

Entry requirements

Note: Admission requirements for non-programme students usually also include admission requirements for the programme and threshold requirements for progression within the programme, or corresponding.

Prerequisites

Linear algebra, Probability, Statistics and basic programming skills. Knowledge in algorithms, data structures and communication systems is desirable but not a requirement.

Intended learning outcomes

After completed course the student should be able to:

  • define correctly and explain about the following notions: Hamming distance, linear error-correcting code, LDPC code, “Turbo” code, optimal decoding, iterative decoding, decoding region, channel capacity, density evolution, Monte Carlo simulations, marginalization, neural network;
  • passably implement decoding algorithms for modern channel codes as well as plot and analyze performance of those;
  • fairly well handle necessary mathematical tools: random variables variables, Bayesian inference, Monte Carlo methods, neural networks;
  • independently use advanced channel coding techniques in practical applications;
  • implement K-means clustering algorithms for sets of data points;

Course content

  • Introduction to information theory and fundamental limits for communication over noisy channels;
  • Modern error-correcting codes: LDPC codes and "Turbo" codes;
  • Optimal decoding: ML- och MAP- decoding;
  • Iterative decoding algorithms and analysis av their performance;
  • Bayesian inference and examples of its applications;
  • K-means clustering algorithms;
  • Exact marginalization;
  • Monte Carlo methods for simulation of physical systems;
  • Introduction to neural networks: single neurons and examples;
  • Capacity of a single neuron;

Teaching and working methods

Teaching is organized in lectures, exercises and laboratory work. The laboratory work consists of programming tasks connected to the theory presented during the lectures. The programming can be carried out in R, C++, Python, Matlab or similar programming language.

Examination

TEN1Written examinationU, 3, 4, 54 credits
LAB1Laboratory workU, G2 credits

Grades

Four-grade scale, LiU, U, 3, 4, 5

Department

Institutionen för systemteknik

Director of Studies or equivalent

Klas Nordberg

Examiner

Danyo Danev

Course website and other links

Education components

Preliminary scheduled hours: 48 h
Recommended self-study hours: 112 h

Course literature

Additional literature

Books
David J.C. MacKay, (2003) Information Theory, Inference and Learning Algorithms
ISBN: 0521642981

Cambridge University Press

Additional literature

Books

David J.C. MacKay, (2003) Information Theory, Inference and Learning Algorithms

ISBN: 0521642981

Cambridge University Press

TEN1 Written examination U, 3, 4, 5 4 credits
LAB1 Laboratory work U, G 2 credits

Regulations (apply to LiU in its entirety)

The university is a government agency whose operations are regulated by legislation and ordinances, which include the Higher Education Act and the Higher Education Ordinance. In addition to legislation and ordinances, operations are subject to several policy documents. The Linköping University rule book collects currently valid decisions of a regulatory nature taken by the university board, the vice-chancellor and faculty/department boards.

LiU’s rule book for education at first-cycle and second-cycle levels is available at http://styrdokument.liu.se/Regelsamling/Innehall/Utbildning_pa_grund-_och_avancerad_niva. 

This tab contains public material from the course room in Lisam. The information published here is not legally binding, such material can be found under the other tabs on this page. There are no files available for this course.

Page responsible: Study information, bilda@uf.liu.se