Abstract: The information theory based on probability concept was developed for application in communication engineering. This theory utilizes the concept of “entropy,” a measure of uncertainty. The errors ...