- Title
- CORE-SG: Efficient Computation of Multiple MSTs for Density-Based Methods
- Creator
- Neto, Antonio Cavalcante Araujo; Naldi, Murilo Coelho; Campello, Ricardo J. G. B.; Sander, Jörg
- Relation
- 2022 IEEE 38th International Conference on Data Engineering (ICDE). Proceedings of 2022 IEEE 38th International Conference on Data Engineering (ICDE) (Kuala Lumpur, Malaysia 09-12 May, 2022) p. 951-964
- Publisher Link
- http://dx.doi.org/10.1109/ICDE53745.2022.00076
- Publisher
- Institute of Electrical and Electronic Engineers (IEEE)
- Resource Type
- conference paper
- Date
- 2022
- Description
- Several popular density-based methods for unsuper-vised and semi-supervised learning tasks, including clustering and classification, can be formulated as instances of a framework that is based on the processing of a minimum spanning tree of the data, where the edge weights correspond to a form of (unnormalized) density estimate w.r.t. a smoothing parameter mpts . While density-based methods are considered to be robust w.r.t. mpts in the sense that small changes in its value usually lead to slight or no changes in the resulting structure, wider ranges of mpts values may lead to different results that a user would like to analyze before choosing the most suitable value for a given data set or application. However, to explore multiple results for a range of mpts values, until recently, one had to re-run the density-based method for each value in the range independently, which is computationally inefficient. This paper proposes a new computationally efficient approach to compute multiple density-based minimum spanning trees w.r.t. a set of mpts values by leveraging a graph obtained from a single run of the density-based algorithm, without the need for re-runs of the original algorithm. We present theoretical and experimental results that show that our approach overcomes the drawbacks of the previous state-of-the-art, and it is considerably superior in runtime and graph size while being easier to implement. Our experimental evaluation using synthetic and real data shows that our strategy can lead to speed-up factors of hundreds to thousands of times on the computation of density-based minimum spanning trees.
- Subject
- density-based methods; k-nearest neighbors; mini-mum spanning tree; clustering; semi-supervised clustering
- Identifier
- http://hdl.handle.net/1959.13/1486678
- Identifier
- uon:51926
- Identifier
- ISBN:978166540884-4
- Identifier
- ISSN:1063-6382
- Language
- eng
- Reviewed
- Hits: 494
- Visitors: 491
- Downloads: 0
| Thumbnail | File | Description | Size | Format |
|---|