I just don't understand the source coding theorem.

Asked 2 years ago, Updated 2 years ago, 78 views

I managed to understand the amount of information and entropy, but I don't understand the formula of the source coding theorem

Do you mean I can think of it as the average code length L = entropy (H)?

I am referring to this site

http://sun.ac.jp/prof/hnagano/houkoku/h24information-04.html

information-theory

2022-09-29 21:33

1 Answers

Do you mean I can think of it as the average code length L = entropy (H)?

For one source S, I think it is correct to interpret that the "shortest" average code length L equals entropy H(S).

As H(S) LL (where は is an arbitrary positive number) in the source site, the source coding theorem says, "No algorithm can reduce the average code length L to less than entropy H(S)."


2022-09-29 21:33

If you have any answers or tips


© 2024 OneMinuteCode. All rights reserved.