Home/ Majors directory/Information and Communication Systems/Information Theory and Coding
Information Theory and Coding
Major: Information and Communication Systems
Code of subject: 6.126.02.O.022
Credits: 7.00
Department: Telecommunication
Lecturer: Ph.D. Associate Professor Burachok Roman Adamovich
Semester: 4 семестр
Mode of study: денна
Завдання: The study of an educational discipline involves the formation of competencies in students of education:
integral competence: The ability to solve complex specialized tasks and practical problems in the field of information systems and technologies, or in the learning process, characterized by the complexity and uncertainty of conditions that require the application of theories and methods of information technologies.
general competences:
KZ1. Ability to abstract thinking, analysis and synthesis.
KZ2. Ability to apply knowledge in practical situations.
KZ3. Ability to understand the subject area and professional activity.
KZ5. Ability to learn and master modern knowledge.
KZ8. The ability to evaluate and ensure the quality of the work performed.
KZ9. The ability to realize one's rights and responsibilities as a member of society, to realize the values of a civil (free democratic) society and the need for its sustainable development, the rule of law, the rights and freedoms of a person and a citizen in Ukraine.
KZ10. The ability to preserve and increase the moral, cultural, scientific values and achievements of society based on an understanding of the history and patterns of development of the subject area, its place in the general system of knowledge about nature and society and in the development of society, technology and technologies, to use various types and forms of motor activity for active recreation and leading a healthy lifestyle.
professional competences:
CS2. Ability to apply standards in the field of information systems and technologies when developing functional profiles, building and integrating systems, products, services and elements of the organization's infrastructure.
CS4. The ability to design, develop and use the means of implementing information systems, technologies and information communications (methodical, informational, algorithmic, technical, software and others).
CS5. The ability to evaluate and take into account economic, social, technological and environmental factors at all stages of the life cycle of information and communication systems.
CS7. The ability to apply information technologies during the creation, implementation and operation of the quality management system and to estimate the costs of its development and maintenance.
CS12. Ability to manage and use modern information and communication systems and technologies (including those based on the use of the Internet).
Learning outcomes: - Use basic knowledge of informatics and modern information systems and technologies, programming skills, technologies for safe work in computer networks, methods of creating databases and Internet resources, technologies for developing algorithms and computer programs in high-level languages using object-oriented oriented programming for solving problems of designing and using information systems and technologies.
- Conduct a system analysis of design objects and justify the choice of structure, algorithms and methods of information transmission in information systems and technologies.
- Argue the choice of software and technical means for creating information systems and technologies based on the analysis of their properties, purpose and technical characteristics, taking into account system requirements and operating conditions; have skills in debugging and testing software and technical means of information systems and technologies.
- Ability to communicate, including oral and written communication in Ukrainian and foreign (English) languages.
- Ability to use various methods of modern information technologies for effective communication at professional and social levels.
- Ability to adapt to new situations and make appropriate decisions.
- The ability to realize the need for training in order to deepen the acquired and acquire new professional knowledge.
- The ability to take responsibility for the work performed, to make decisions independently, to achieve the set goal in compliance with the requirements of professional ethics.
Required prior and related subjects: Previous academic disciplines
1. Discrete mathematics
2. Schematics of information systems
3. Basics of information technologies
Associated and subsequent academic disciplines
1. Embedded systems
2. Architecture of information and communication systems
3. Data protection in information and communication systems.
Summary of the subject: The discipline is devoted to the study of the basic technologies and methods of information coding during its processing in separate IS subsystems, using the basic principles of information theory.
Опис: - Introduction. Coding of information. Basic concepts and definitions.
- Classification of codes. General classification of codes. Classification of binary codes. Basic characteristics (parameters) of codes.
- Non-redundant codes. Simple uniform codes. Binary-decimal codes. Reflex (mirrored) codes. Non-uniform non-redundant codes. Statistical coding. Shannon-Fano code. Construction of Shannon-Fano codes.
- Redundant codes that detect and correct errors. Corrective code properties and code distance. Error detection. Error correction. Simultaneous correction and error detection. Principles of building systematic codes. Methods of correcting errors with systematic codes. The main types of systematic codes. Code with one parity check. Code with simple repetition. Correlation code (code with element doubling, Manchester code). Inverse code (Bauer code).
- Hamming codes. The perfect Hamming code. Extended Hamming code. Short code of Lemming. Weight characteristic. The probability of an undetected error. Goley code. Reed-Muller codes (RM-codes). Iterative codes.
- Unsystematic codes. Berger codes. Berger codes for asymmetric channels. Berger codes for symmetrical channels.
- Block indivisible codes. Codes with constant weight. Plotkin (Hadamard, Walsh) codes and their use in the cellular communication system of the CDMA standard.
- Cyclic codes. Principles of construction of cyclic codes. Arithmetic operations on polynomials. The first method of coding. The second method of coding. Cyclic codes in matrix form. Abbreviated cyclic codes.
- Selection of the generating polynomial. Inverse polynomials. Detection and correction of errors (correction of errors) by cyclic codes. Cyclic Hamming codes. Bose-Choudhury-Hockingham codes (BCH - codes). Fire code. Compound codes.
- Evaluation and selection of codes. Probability of error when transmitting information by redundant codes on channels with independent errors. Probability of error when transmitting information through communication channels with packet error distribution. The main methods of increasing the reliability of information transmission by redundant codes. Code selection recommendations.
Assessment methods and criteria: Testing on topics passed (in a virtual learning environment).
Protection of laboratory work in the form of a survey based on completed reports.
Examination control (written component – extended answers to questions and solutions to problems, oral component – survey based on the list of questions to be studied and submitted for semester control.
Критерії оцінювання результатів навчання: Intermediate control (in the form of testing on passed topics) - 10 points.
Performance and defense of laboratory work - 20 points.
Порядок та критерії виставляння балів та оцінок: 100–88 points – (“excellent”) is awarded for a high level of knowledge (some inaccuracies are allowed) of the educational material of the component contained in the main and additional recommended literary sources, the ability to analyze the phenomena being studied in their interrelationship and development, clearly, succinctly, logically, consistently answer the questions, the ability to apply theoretical provisions when solving practical problems; 87–71 points – (“good”) is awarded for a generally correct understanding of the educational material of the component, including calculations, reasoned answers to the questions posed, which, however, contain certain (insignificant) shortcomings, for the ability to apply theoretical provisions when solving practical tasks; 70 – 50 points – (“satisfactory”) awarded for weak knowledge of the component’s educational material, inaccurate or poorly reasoned answers, with a violation of the sequence of presentation, for weak application of theoretical provisions when solving practical problems; 49-26 points - ("not certified" with the possibility of retaking the semester control) is awarded for ignorance of a significant part of the educational material of the component, significant errors in answering questions, inability to apply theoretical provisions when solving practical problems; 25-00 points - ("unsatisfactory" with mandatory re-study) is awarded for ignorance of a significant part of the educational material of the component, significant errors in answering questions, inability to navigate when solving practical problems, ignorance of the main fundamental provisions.
Recommended books: Educational and methodological support
1. Synopsis of lectures on the discipline "Information transmission systems".
2. Synopsis of lectures "Methods of information coding".
3. Laboratory workshop on the discipline "Information transmission systems".
4. Laboratory workshop "Methods of information coding".
5. Electronic educational and methodological complex in the discipline "Methods of information coding".
Recommended Books
1. R. A. Burachok, M. M. Klymash, B. V. Koval. Telecommunication systems of information transmission. Coding methods. Lviv: Publishing House of Lviv Polytechnic, 2015.
2. Kuzmin I. V., Klyuchko V. I., Lytvyn V. A. Coding and decoding in information systems. - K.: Higher School, 1985.
3. Tsymbal V. P. Theory of information and coding. - K.: Higher School, 1992.
4. Kuzmin I. V., Kedrus V. A. Fundamentals of information theory and coding: Textbook for universities, 2nd ed., revised. and additional - K.: Higher School, Main Publishing House, 1986.
5. Tsymbal V. P. Task on the theory of information and coding. - K.: Higher School, 1976.
6. Coding of information (binary codes). Directory / Ed. Berezyuk N. T., Andrushchenko A. G., Moschytsky S. S. and others - Kharkiv, Publishing House of Kharkiv State University Publishing House "Higher School", 1978.
7. Clark D., Kane D. Coding with error correction in digital communication systems. - M.: Radio and communication, 1987.
Уніфікований додаток: Lviv Polytechnic National University ensures the realization of the right of persons with disabilities to obtain higher education. Inclusive educational services are provided by the Service of accessibility to learning opportunities "Without restrictions", the purpose of which is to provide permanent individual support for the educational process of students with disabilities and chronic diseases. An important tool for the implementation of the inclusive educational policy at the University is the Program for improving the qualifications of scientific and pedagogical workers and educational and support staff in the field of social inclusion and inclusive education. Contact at:
St. Karpinsky, 2/4, 1st floor, room 112
E-mail: nolimits@lpnu.ua
Websites: https://lpnu.ua/nolimits https://lpnu.ua/integration
Академічна доброчесність: The policy regarding the academic integrity of the participants of the educational process is formed on the basis of compliance with the principles of academic integrity, taking into account the norms "Regulations on academic integrity at the Lviv Polytechnic National University" (approved by the academic council of the university on June 20, 2017, protocol No. 35).