INFORMATION THEORY AND CODING

Course Information
TitleΘΕΩΡΙΑ ΠΛΗΡΟΦΟΡΙΩΝ ΚΑΙ ΚΩΔΙΚΟΠΟΙΗΣΗ / INFORMATION THEORY AND CODING
CodeNNA-08-03
FacultySciences
SchoolInformatics
Cycle / Level1st / Undergraduate
Teaching PeriodSpring
CoordinatorNikolaos Pleros
CommonNo
StatusActive
Course ID40002943

Programme of Study: Undergradute Studies - School of Informatics (2015-today)

Registered students: 11
OrientationAttendance TypeSemesterYearECTS
Information SystemsElective Courses845
Digital MediaElective Courses635
Communication, Networks And Systems ArchitectureElected Compulsory Directional845
Information And Communication Technologies In EducationElective Courses845
General Common DirectionElective Courses845

Class Information
Academic Year2015 – 2016
Class PeriodSpring
Faculty Instructors
Weekly Hours3
Class ID
600005023
Type of the Course
  • Scientific Area
Course Category
Specific Foundation / Core
Mode of Delivery
  • Face to face
Erasmus
The course is also offered to exchange programme students.
Language of Instruction
  • Greek (Instruction, Examination)
  • English (Examination)
Prerequisites
General Prerequisites
basic knowledge on signal theory, basic knowledge on probabilities
Learning Outcomes
amiliarization with the topics of information theory and coding, correlation of information theory objectives with current practical communication and coding examples, training on theoretical channel analysis, training on basic coding practices
General Competences
  • Apply knowledge in practice
  • Work autonomously
  • Advance free, creative and causative thinking
Course Content (Syllabus)
Information – entropy (entropy, joint entropy, conditional entropy, memory and memoryless information sources), channel capacity (information channels, mutual information and capacity, lossless channels, uniform information channel, binary symmetric channel, binary erasure channel), coding in noiseless communications (Kraft inequality, Shannon’s theorem, typical codes (Shannon, Shannon-Fano, Huffmann, binary coding trees). Coding in noisy communications (decoding criteria, Fano’s limit, Shannon’s second theorem, Hamming code). Arithmetic coding, algebraic coding.
Keywords
information, entropy, channel, capacity, code
Educational Material Types
  • Notes
  • Slide presentations
  • Book
Use of Information and Communication Technologies
Use of ICT
  • Use of ICT in Course Teaching
Course Organization
ActivitiesWorkloadECTSIndividualTeamworkErasmus
Lectures391.3
Reading Assigment712.4
Project401.3
Total1505
Student Assessment
Description
Written Exams (70%) and Problem Sets (30%)
Student Assessment methods
  • Written Assignment (Formative, Summative)
  • Written Exam with Problem Solving (Formative, Summative)
Bibliography
Course Bibliography (Eudoxus)
ΘΕΩΡΙΑ ΠΛΗΡΟΦΟΡΙΩΝ - ΚΩΔΙΚΕΣ, ΒΟΥΚΑΛΗΣ ΔΗΜΗΤΡΙΟΣ, ΙΩΝ, ΑΘΗΝΑ, 1994
Additional bibliography for study
ΣΗΜΕΙΩΣΕΙΣ ΔΙΔΑΣΚΟΝΤΑ
Last Update
15-06-2016