Information Theory

 Title ΘΕΩΡΙΑ ΠΛΗΡΟΦΟΡΙΩΝ / Information Theory Code ΗΥ0502 Faculty Engineering School Electrical and Computer Engineering Cycle / Level 1st / Undergraduate Teaching Period Spring Coordinator Leonidas Georgiadis Common No Status Active Course ID 20001997

 Academic Year 2017 – 2018 Class Period Spring Faculty Instructors Weekly Hours 4 Class ID 600111432

Class Schedule

 Building Πολυτεχνείο (πτέρυγα Γ) Floor Όροφος 1 Hall Α7 (4) Calendar Δευτέρα 09:00 έως 11:00 Building Πολυτεχνείο (πτέρυγα Γ) Floor Όροφος 1 Hall Α3 (2) Calendar Πέμπτη 18:00 έως 20:00
Course Type 2016-2020
• General Knowledge
Course Type 2011-2015
General Foundation
Mode of Delivery
• Face to face
Digital Course Content
Erasmus
The course is also offered to exchange programme students.
Language of Instruction
• Greek (Instruction, Examination)
• English (Instruction, Examination)
Learning Outcomes
Understanding of the Shannon theorems - 1st and 2nd - and of the constraints of any communication system, as far as the transfer of information is concerned. Familiarization with basic codes and introduction to the world of cryptography.
General Competences
• Apply knowledge in practice
• Retrieve, analyse and synthesise data and information, with the use of necessary technologies
Course Content (Syllabus)
Information measure. Entropy of simple source of information. Double, triple ... source of information. Joint and conditional entropy. Extensions of simple source, trans-information, and capacity of information channel. Simple and cascaded information channels. Analog flow of information. Noiseless encoding and Shannon's first theorem. Simple codes of differential code-word length. The detection automaton. Coding in the presence of noise and Shannon's second theorem. Detection and correction of errors. Convolutional codes. Algebraic coding theory.
Keywords
information, entropy, channel capacity, coding
Educational Material Types
• Notes
• Book
Use of Information and Communication Technologies
Use of ICT
• Use of ICT in Course Teaching
Course Organization
Lectures39
Tutorial13
Exams23
Total120
Student Assessment
Description
Written Examination
Student Assessment methods
• Written Exam with Problem Solving (Formative, Summative)
Bibliography
Course Bibliography (Eudoxus)
Shannon, C., Μια Μαθηματική Θεωρία της Επικοινωνίας. Leader Books, 2006 Βούκαλης Δ., Θεωρία Πληροφοριών - Κώδικες. Ίων, 2009