Course: Fundamentals of Information Theory

« Back
Course title Fundamentals of Information Theory
Course code KIV/ZTI
Organizational form of instruction Lecture + Tutorial
Level of course Bachelor
Year of study not specified
Semester Winter
Number of ECTS credits 6
Language of instruction Czech
Status of course Compulsory, Compulsory-optional, Optional
Form of instruction Face-to-face
Work placements This is not an internship
Recommended optional programme components None
Lecturer(s)
  • Vávra František, Doc. Ing. CSc.
  • Marek Patrice, Ing. Ph.D.
Course content
Finite-state machine and its usage. Basic concept of information theory, usage for classification and experiment planning. Data compression and error-correcting code. Communication channel and its capacity. Gambling and portfolio theory. Basic stochastic processes, Markov models and queuing theory. Statistics and information theory, maximum entropy principle. Languages, finite-state machine, basic concepts. Finite-state machine operations, non-deterministic finite-state machine. Entropy, relative entropy, mutual information. Typical sequences, experiment planning and evaluation, data compression. Error-correcting code, connection with questionnaire construction. Channel capacity, classification as a communication channel. Gambling and connection with information theory. Gambling and portfolio theory. Queuing theory ? basic concepts. Queuing theory ? basic models. Information theory and statistics. Maximum entropy principle and its usage for estimation.

Learning activities and teaching methods
Textual studies, Lecture, Practicum
  • Preparation for an examination (30-60) - 60 hours per semester
  • Contact hours - 65 hours per semester
  • Preparation for formative assessments (2-20) - 20 hours per semester
  • Preparation for comprehensive test (10-40) - 20 hours per semester
prerequisite
professional knowledge
Only elementary.
learning outcomes
Main goal is to obtain abilities use of basic concepts information theory in economical and investment modeling.
teaching methods
Lecture
Practicum
Textual studies
assessment methods
Written exam
Recommended literature
  • Adámek. Stochastické procesy a teorie informace - úlohy.
  • Vajda, Igor. Teória informácie a štatistického rozhodovania. 1. vyd. Bratislava : Alfa, 1982.


Study plans that include the course
Faculty Study plan (Version) Branch of study Category Recommended year of study Recommended semester
Faculty of Applied Sciences Geomatics (2014) Construction industry, geodesy and cartography 2 Winter
Faculty of Applied Sciences Geomatics (2017) Construction industry, geodesy and cartography 2 Winter
Faculty of Applied Sciences Mathematics for Business Studies (2015) Mathematics courses 3 Winter
Faculty of Applied Sciences Financial Informatics and Statistics (2007) Economy 3 Winter
Faculty of Applied Sciences Geomatics (2016) Construction industry, geodesy and cartography 2 Winter
Faculty of Applied Sciences Mathematics for Business Studies (2011) Mathematics courses 3 Winter
Faculty of Applied Sciences Financial Informatics and Statistics (2017) Economy 3 Winter
Faculty of Applied Sciences Financial Informatics and Statistics (1) Economy 3 Winter
Faculty of Applied Sciences Geomatics (2015) Construction industry, geodesy and cartography 2 Winter
Faculty of Applied Sciences Mathematics for Business Studies (2017) Mathematics courses 3 Winter
Faculty of Applied Sciences Mathematics for Business Studies (2017) Mathematics courses 3 Winter
Faculty of Applied Sciences Financial Informatics and Statistics (2016) Economy 3 Winter
Faculty of Applied Sciences Mathematics for Business Studies (2016) Mathematics courses 3 Winter
Faculty of Applied Sciences Financial Informatics and Statistics (2017) Economy 3 Winter
Faculty of Applied Sciences Financial Informatics and Statistics (2016) Economy 3 Winter
Faculty of Applied Sciences Scientific Computing and Modelling (2011) Mathematics courses 3 Winter
Faculty of Applied Sciences Mathematics for Business Studies (2016) Mathematics courses 3 Winter