The following Matlab project contains the source code and Matlab examples used for information theory toolbox.
This toolbox contains functions for discrete random variables to compute following quantities:
1)Entropy
2)Joint entropy
3)Conditional entropy
4)Relative entropy (KL divergence)
5)Mutual information
6)Normalized mutual information
7)Normalized variation information
This toolbox is a tweaked and bundled version of my previous submissions.

The source code and files included in this project are listed in the project files section, please make sure whether the listed source code meet your needs there.

## Project Files:

File Name | Size |
---|---|

conditionalEntropy.m | 662 |

entropy.m | 291 |

jointEntropy.m | 509 |

license.txt | 1340 |

mutualInformation.m | 743 |

nmi.m | 800 |

nvi.m | 706 |

relativeEntropy.m | 573 |