Information Theory

Course Information
TitleΘΕΩΡΙΑ ΠΛΗΡΟΦΟΡΙΩΝ / Information Theory
CodeΗΥ0502
FacultyEngineering
SchoolElectrical and Computer Engineering
Cycle / Level1st / Undergraduate
Teaching PeriodSpring
CoordinatorDiomidis Michalopoulos
CommonNo
StatusActive
Course ID20001997
Class Information
Academic Year2026 – 2027
Class PeriodSpring
Faculty Instructors
Class ID
600308309
Course Type 2016-2020
  • General Knowledge
Course Type 2011-2015
Specific Foundation / Core
Mode of Delivery
  • Distance learning
Digital Course Content
Language of Instruction
  • Greek (Instruction, Examination)
Learning Outcomes
After successful completion of the class, the students: 1. Will be able to examine the fundamental capabilities of communication systems and information systems in general, regarding the compression and transmission rate. 2. Will be able to begin the further study and implementation of compression and error-correcting codes based on the basic principles that are taught in the class.
General Competences
  • Apply knowledge in practice
  • Retrieve, analyse and synthesise data and information, with the use of necessary technologies
  • Advance free, creative and causative thinking
Course Content (Syllabus)
Concepts of Entropy and Mutual Information. Data compression. First Shannon theorem. Error-correction coding. Discrete communication channel. Gaussian channel Channel capacity. Second Shannon Theorem.
Keywords
information, entropy, channel capacity, coding
Educational Material Types
  • Notes
  • Book
Use of Information and Communication Technologies
Use of ICT
  • Use of ICT in Course Teaching
  • Use of ICT in Communication with Students
Course Organization
ActivitiesWorkloadECTSIndividualTeamworkErasmus
Lectures39✓
Reading Assigment45✓
Tutorial13✓
Exams23✓
Total120
Student Assessment
Description
Written Examination
Student Assessment methods
  • Written Exam with Problem Solving (Formative, Summative)
Bibliography
Course Bibliography (Eudoxus)
THOMAS M. COVER, JOY A. THOMAS, "Στοιχεία Θεωρίας Πληροφορίας", ΠΑΝΕΠΙΣΤΗΜΙΑΚΕΣ ΕΚ∆ΟΣΕΙΣ ΚΡΗΤΗΣ, 2014.
Last Update
30-11-2020