## Estimate gaussian (mixture) density from a set of weighted samples

### Remember to vote up questions/answers you find interesting or helpful (requires 15 reputation points)

Assume I have a set of weighted samples, where each samples has a corresponding weight between 0 and 1. I'd like to estimate the parameters of a gaussian mixture distribution that is biased towards the samples with higher weight. In the usual non-weighted case gaussian mixture estimation is done via the EM algorithm. Does anyone know how to modify the algorithm to account for the weights?

If not, can some one give me a hint on how to incorporate the weights in the initial formula of the maximum-log-likelihood formulation of the problem?

Thanks!

-

## 1 Answer

The usual EM algorithm can be modified for weighted inputs. Following along the Wikipedia presentation, you would use these formulas instead:

$a_i = \frac{\sum_{j=1}^N w_j y_{i,j}}{\sum_{j=1}^{N}w_j}$

and

$\mu_{i} = \frac{\sum_{j} w_jy_{i,j}x_{j}}{\sum_{j} w_jy_{i,j}}$

where $w_j \ge 0$ are the weights of the data points.

-
{"extraction_info": {"found_math": true, "script_math_tex": 0, "script_math_asciimath": 0, "math_annotations": 0, "math_alttext": 0, "mathml": 0, "mathjax_tag": 0, "mathjax_inline_tex": 3, "mathjax_display_tex": 0, "mathjax_asciimath": 0, "img_math": 0, "codecogs_latex": 0, "wp_latex": 0, "mimetex.cgi": 0, "/images/math/codecogs": 0, "mathtex.cgi": 0}, "config": {"markdown_headings": true, "markdown_code": true, "boilerplate_config": {"ratio_threshold": 0.18, "absolute_threshold": 10, "end_threshold": 15, "enable": true}, "remove_buttons": true, "remove_image_figures": true, "remove_link_clusters": true, "table_config": {"min_rows": 2, "min_cols": 3, "format": "plain"}, "remove_chinese": true, "remove_edit_buttons": true, "extract_latex": true}, "english_confidence": 0.9042485356330872, "perplexity_flag": "head"}