# Mrmr feature selection (using mutual information computation) in matlab

The following Matlab project contains the source code and Matlab examples used for mrmr feature selection (using mutual information computation). This package is the mRMR (minimum-redundancy maximum-relevancy) feature selection method in (Peng et al, 2005 and Ding & Peng, 2005, 2003), whose better performance over the conventional top-ranking method has been demonstrated on a number of data sets in recent publications.

# Windowed mutual information (migram) in matlab

The following Matlab project contains the source code and Matlab examples used for windowed mutual information (migram). Calculate windowed mutual information between two signals up to a pre-defined lag. The estimation of the (joint) probabilities is optimized, hence, entire computation is very fast.

# Normalized mutual entropy in matlab

The following Matlab project contains the source code and Matlab examples used for normalized mutual entropy. Normalized mutual entropy provides a measure of the diversity of a two dimensional matrix.

# Mutual information in probability theory and information theory in matlab

The following Matlab project contains the source code and Matlab examples used for mutual information in probability theory and information theory. The definition of mutual information could resort to wiki: http://en.

# Calculates the sample entropy, in bits, of discrete variables. in matlab

The following Matlab project contains the source code and Matlab examples used for calculates the sample entropy, in bits, of discrete variables. . Entropy: Returns entropy (in bits) of each column of 'X'   by Will Dwinnell     H = Entropy(X)     H = row vector of calculated entropies (in bits)   X = data to be analyzed     Note 1: Each distinct value in X is considered a unique value.

# Normalized mutual information in matlab

The following Matlab project contains the source code and Matlab examples used for normalized mutual information. Normalized mutual information is often used for evaluating clustering result, information retrieval, feature selection etc. This is a optimized implementation of the function which has no for loops.

# The adjusted mutual information in matlab

The following Matlab project contains the source code and Matlab examples used for the adjusted mutual information. This program calculates the adjusted mutual information for comparing clusterings.

# Mutual information in matlab

The following Matlab project contains the source code and Matlab examples used for mutual information. MutualInformation: returns mutual information (in bits) of discrete variables 'X' and 'Y'   I = MutualInformation(X,Y);     I = calculated mutual information (in bits)   X = variable(s) to be analyzed (column vector)   Y = variable to be analyzed (column vector)     Note 1: Multiple variables may be handled jointly as columns in     matrix 'X'.

# Information theory toolbox in matlab

The following Matlab project contains the source code and Matlab examples used for information theory toolbox. This toolbox contains functions for discrete random variables to compute following quantities: 1)Entropy 2)Joint entropy 3)Conditional entropy 4)Relative entropy (KL divergence) 5)Mutual information 6)Normalized mutual information 7)Normalized variation information This toolbox is a tweaked and bundled version of my previous submissions.

# Very fast mutual information betweentwo images. in matlab

The following Matlab project contains the source code and Matlab examples used for very fast mutual information betweentwo images.. function M = MI_GG(X,Y) Computes the mutual information between two quantized images: X and Y.

# Mutual information and joint entropy in matlab

The following Matlab project contains the source code and Matlab examples used for mutual information and joint entropy. Compute mutual information and joint entropy of two images. For implementing this function also download function joint_histogram.m in my File Exchange.

# Ecological information based approach in matlab

The following Matlab project contains the source code and Matlab examples used for ecological information based approach. This is a simple code for calculating the number of nodes, Total System Throughput (TST), Average Mutual Information (AMI), conditional entropy, effective connectivity, and effective number of roles of information flow based network represented in the form of a matrix.

# Fuzzy entropy and mutual information in matlab

The following Matlab project contains the source code and Matlab examples used for fuzzy entropy and mutual information. Nowadays there are heaps of articles on the theory of fuzzy entropy and fuzzy mutual information.

# Fast mutual information, joint entropy, and joint histogram calculation for n d images in matlab

The following Matlab project contains the source code and Matlab examples used for fast mutual information, joint entropy, and joint histogram calculation for n d images. This uses no for-loops - only index manipulation.

# Permutation conditional mutual information (pcmi) in matlab

The following Matlab project contains the source code and Matlab examples used for permutation conditional mutual information (pcmi). [Dxy,Ixy,Iyx] = CMI_PE_tau(X,Y,ord,t,Tau) PCMI: a novel methodology based on permutation analysis and conditional mutual information for estimation of a directionality index between two time series.

# Feature mutual information (fmi) image fusion metric in matlab

The following Matlab project contains the source code and Matlab examples used for feature mutual information (fmi) image fusion metric. FMI calculates the Feature Mutual Information (FMI), the non-reference performance metric for fusion algorithms, proposed in:     M.

# Mutual information computation in matlab

The following Matlab project contains the source code and Matlab examples used for mutual information computation. A self-contained, cross-platform, package for computing mutual information, joint/conditional probability, entropy, and more.

# Ami and correlation in matlab

The following Matlab project contains the source code and Matlab examples used for ami and correlation. AMI computes and plots average mutual information (ami) and correlation of univariate or bivariate time series for different values of time lag.

# Information theoretic feature selection in matlab

The following Matlab project contains the source code and Matlab examples used for information theoretic feature selection. Description: Code (Matlab/C++ Mex) for the following MI based feature selection approaches: - Maximum relevance (maxRel) - Minimum redundancy maximum relevance (MRMR) - Minimum redundancy (minRed) - Quadratic programming feature selection (QPFS) - Mutual information quotient (MIQ) - Maximum relevance minimum total redundancy (MRMTR) or extended MRMR (EMRMR) - Spectral relaxation global Conditional Mutual Information (SPEC_CMI)

# Sum of conditional variance in matlab

The following Matlab project contains the source code and Matlab examples used for sum of conditional variance. Sum of Conditional Variance (SCV) is a new similarity metric for multi-modal image registration, eg CT-Fluoroscopy registration. This is derived using Joiint probability distribution but it is readily differentiable unline Mutual information (MI)

# Fast mutual information of two images or signals in matlab

The following Matlab project contains the source code and Matlab examples used for fast mutual information of two images or signals. Usage: I=mi(A,B), where A and B are equally sized images/signals. 