Repository navigation
Support cluster tags for non-english #30
Description
It looks for now use tf-idf with english-only preprocessing rules.
So for now non-english tags looks dummy.
I know it is possible to pass precomputed tags.
But prefer instead preprocessing steps were no so strict to better support non-english texts out of the box.
Reacted by Alexander Lam
Activity
acylam commentedon Aug 26, 2025
I am also looking for a solution to this. How to add Chinese tags?
acylam commentedon Aug 26, 2025
@fredhohman If not calculated automatically, is there a way to add precomputed labels to clusters? Looking for a way to support non-English.
donghaoren commentedon Aug 26, 2025
No, there isn't a a way to add pre-computed labels yet, but we are looking into that.
I think we might be able to use the new
Intl.SegmenterAPI (see here) to provide better labels for more languages without adding a ton of dependency.