- English
- فارسی

# The overall performance of the Shannon code

**Abstract**

It is well-known that the redundancy of the Shannon code lies in the interval [0, 1). In order to study the overall performance of the Shannon code, we consider its redundancy as a random variable on the set of sources with n symbols, i.e., $R^{sh}(n)$, and examine its statistical parameters. It is shown that the mean of $R^{sh}(n)$ gets close to $0.5$ for sources with large alphabet size $n$. Moreover, we observe that its variance tends to zero as $n$ increases. Briefly speaking, for almost all sources with a large alphabet size, the redundancy of

the Shannon code is almost $0.5$ bits.

Conference Papers

Month/Season:

December

Year:

2008