### Abstract

This paper studies clustering of data sequences using the k-medoids algorithm. All the data sequences are assumed to be generated from unknown continuous distributions, which form clusters with each cluster containing a composite set of closely located distributions (based on a certain distance metric between distributions). The maximum intracluster distance is assumed to be smaller than the minimum intercluster distance, and both values are assumed to be known. The goal is to group the data sequences together if their underlying generative distributions (which are unknown) belong to one cluster. Distribution distance metrics based k-medoids algorithms are proposed for known and unknown number of distribution clusters. Upper bounds on the error probability and convergence results in the large sample regime are also provided. It is shown that the error probability decays exponentially fast as the number of samples in each data sequence goes to infinity. The error exponent has a simple form regardless of the distance metric applied when certain conditions are satisfied. In particular, the error exponent is characterized when either the Kolmogrov-Smirnov distance or the maximum mean discrepancy are used as the distance metric. Simulation results are provided to validate the analysis.

Original language | English (US) |
---|---|

Article number | 8651294 |

Pages (from-to) | 2093-2106 |

Number of pages | 14 |

Journal | IEEE Transactions on Signal Processing |

Volume | 67 |

Issue number | 8 |

DOIs | |

State | Published - Apr 15 2019 |

### Fingerprint

### Keywords

- composite distributions
- error probability
- k-medoids clustering
- Kolmogorov-Smirnov distance
- maximum mean discrepancy
- unsupervised learning

### ASJC Scopus subject areas

- Signal Processing
- Electrical and Electronic Engineering

### Cite this

*IEEE Transactions on Signal Processing*,

*67*(8), 2093-2106. [8651294]. https://doi.org/10.1109/TSP.2019.2901370

**K-medoids clustering of data sequences with composite distributions.** / Wang, Tiexing; Li, Qunwei; Bucci, Donald J.; Liang, Yingbin; Chen, Biao; Varshney, Pramod Kumar.

Research output: Contribution to journal › Article

*IEEE Transactions on Signal Processing*, vol. 67, no. 8, 8651294, pp. 2093-2106. https://doi.org/10.1109/TSP.2019.2901370

}

TY - JOUR

T1 - K-medoids clustering of data sequences with composite distributions

AU - Wang, Tiexing

AU - Li, Qunwei

AU - Bucci, Donald J.

AU - Liang, Yingbin

AU - Chen, Biao

AU - Varshney, Pramod Kumar

PY - 2019/4/15

Y1 - 2019/4/15

N2 - This paper studies clustering of data sequences using the k-medoids algorithm. All the data sequences are assumed to be generated from unknown continuous distributions, which form clusters with each cluster containing a composite set of closely located distributions (based on a certain distance metric between distributions). The maximum intracluster distance is assumed to be smaller than the minimum intercluster distance, and both values are assumed to be known. The goal is to group the data sequences together if their underlying generative distributions (which are unknown) belong to one cluster. Distribution distance metrics based k-medoids algorithms are proposed for known and unknown number of distribution clusters. Upper bounds on the error probability and convergence results in the large sample regime are also provided. It is shown that the error probability decays exponentially fast as the number of samples in each data sequence goes to infinity. The error exponent has a simple form regardless of the distance metric applied when certain conditions are satisfied. In particular, the error exponent is characterized when either the Kolmogrov-Smirnov distance or the maximum mean discrepancy are used as the distance metric. Simulation results are provided to validate the analysis.

AB - This paper studies clustering of data sequences using the k-medoids algorithm. All the data sequences are assumed to be generated from unknown continuous distributions, which form clusters with each cluster containing a composite set of closely located distributions (based on a certain distance metric between distributions). The maximum intracluster distance is assumed to be smaller than the minimum intercluster distance, and both values are assumed to be known. The goal is to group the data sequences together if their underlying generative distributions (which are unknown) belong to one cluster. Distribution distance metrics based k-medoids algorithms are proposed for known and unknown number of distribution clusters. Upper bounds on the error probability and convergence results in the large sample regime are also provided. It is shown that the error probability decays exponentially fast as the number of samples in each data sequence goes to infinity. The error exponent has a simple form regardless of the distance metric applied when certain conditions are satisfied. In particular, the error exponent is characterized when either the Kolmogrov-Smirnov distance or the maximum mean discrepancy are used as the distance metric. Simulation results are provided to validate the analysis.

KW - composite distributions

KW - error probability

KW - k-medoids clustering

KW - Kolmogorov-Smirnov distance

KW - maximum mean discrepancy

KW - unsupervised learning

UR - http://www.scopus.com/inward/record.url?scp=85063012599&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85063012599&partnerID=8YFLogxK

U2 - 10.1109/TSP.2019.2901370

DO - 10.1109/TSP.2019.2901370

M3 - Article

AN - SCOPUS:85063012599

VL - 67

SP - 2093

EP - 2106

JO - IEEE Transactions on Signal Processing

JF - IEEE Transactions on Signal Processing

SN - 1053-587X

IS - 8

M1 - 8651294

ER -