Shannon entropy calculation

Question

I have a probability distribution that determines the probability of occurrence of npossible states.

I would like to calculate the value of the Shannon entropy in bits of a given probability distribution.

Can I use wentropy(x,'shannon')to get the value, and if so, where can I determine the number of possible states that the system has?

Answer 1

Since you already have a probability distribution, name it p, you can make the following formula for Shannon entropy instead of using wentropy:

H = sum(-(p(p>0).*(log2(p(p>0)))));

H .

p 1.