Information Theory
| Title | ΘΕΩΡΙΑ ΠΛΗΡΟΦΟΡΙΩΝ / Information Theory |
| Code | ΗΥ0502 |
| Faculty | Engineering |
| School | Electrical and Computer Engineering |
| Cycle / Level | 1st / Undergraduate |
| Teaching Period | Spring |
| Coordinator | Leonidas Georgiadis |
| Common | No |
| Status | Active |
| Course ID | 20001997 |
| Academic Year | 2017 – 2018 |
| Class Period | Spring |
| Faculty Instructors | |
| Weekly Hours | 4 |
| Class ID | 600111432
|
Class Schedule
| Building | Πολυτεχνείο (πτέρυγα Γ) |
| Floor | Όροφος 1 |
| Hall | Α7 (4) |
| Calendar | Δευτέρα 09:00 έως 11:00 |
| Building | Πολυτεχνείο (πτέρυγα Γ) |
| Floor | Όροφος 1 |
| Hall | Α3 (2) |
| Calendar | Πέμπτη 18:00 έως 20:00 |
Course Type 2016-2020
- General Knowledge
Course Type 2011-2015
General Foundation
Mode of Delivery
- Face to face
Digital Course Content
- e-Study Guide https://qa.auth.gr/en/class/1/600111432
- Other: GoogleGroup
Erasmus
The course is also offered to exchange programme students.
Language of Instruction
- Greek (Instruction, Examination)
- English (Instruction, Examination)
Learning Outcomes
Understanding of the Shannon theorems - 1st and 2nd - and of the constraints of any communication system, as far as the transfer of information is concerned. Familiarization with basic codes and introduction to the world of cryptography.
General Competences
- Apply knowledge in practice
- Retrieve, analyse and synthesise data and information, with the use of necessary technologies
Course Content (Syllabus)
Information measure. Entropy of simple source of information. Double, triple ... source of information. Joint and conditional entropy. Extensions of simple source, trans-information, and capacity of information channel. Simple and cascaded information channels. Analog flow of information. Noiseless encoding and Shannon's first theorem. Simple codes of differential code-word length. The detection automaton. Coding in the presence of noise and Shannon's second theorem. Detection and correction of errors. Convolutional codes. Algebraic coding theory.
Keywords
information, entropy, channel capacity, coding
Educational Material Types
- Notes
- Book
Use of Information and Communication Technologies
Use of ICT
- Use of ICT in Course Teaching
Course Organization
| Activities | Workload | ECTS | Individual | Teamwork | Erasmus |
|---|---|---|---|---|---|
| Lectures | 39 | ✓ | ✓ | ||
| Reading Assigment | 45 | ✓ | ✓ | ||
| Tutorial | 13 | ✓ | ✓ | ||
| Exams | 23 | ✓ | ✓ | ||
| Total | 120 |
Student Assessment
Description
Written Examination
Student Assessment methods
- Written Exam with Problem Solving (Formative, Summative)
Bibliography
Course Bibliography (Eudoxus)
Shannon, C., Μια Μαθηματική Θεωρία της Επικοινωνίας. Leader Books, 2006
Βούκαλης Δ., Θεωρία Πληροφοριών - Κώδικες. Ίων, 2009
Last Update
03-11-2015
