Skip to content

uniquifier去重只处理一半 #114

Description

@xiaoqun2016

使用了多个翻译器,发现一个问题: uniquifier每次只能去掉一半的重复项。

将方案简化如下:

# xxx.schema.yaml

schema:
  schema_id: xxx
  name: "uniquifier_问题"
  version: 1
#  author:
#  description: 
#  dependencies:

switches:
  - name: simplification
    states: [关, 开]
    reset: 1      

engine:
  processors:
#    - ascii_composer
#    - recognizer
#    - key_binder
    - speller
#    - punctuator
#    - selector
#    - navigator
    - express_editor
  segmentors:
#    - ascii_segmentor
#    - matcher
    - abc_segmentor
#    - punct_segmentor
#    - fallback_segmentor
  translators:
    - echo_translator
    - table_translator
    - table_translator@t1
    - table_translator@t2
    - table_translator@t3
    - table_translator@t4
    - table_translator@t5
  filters:
#    - simplifier
#    - uniquifier
#    - uniquifier
    - uniquifier

#speller:
#  alphabet: "zyxwvutsrqponmlkjihgfedcba"

translator: &trans
  dictionary: xxx
  enable_completion: false
  enable_sentence: false

t1: *trans
t2: *trans
t3: *trans
t4: *trans
t5: *trans

词典如下:

# xxx.dict.yaml

---
name: xxx
version: 1
sort: original
columns:
  - text
  - code
...

# table begins
一	a
#复制词典时,请将词与编码间的空格转为tab

先将uniquifier注释,查看重复情况:
1
总共有六个重复项,符合方案。
然后加一个 uniquifier :
2
滤去三个,还剩3个。
再加一个 uniquifier :
3
又滤去一个,还剩两个。
加第三个 uniquifier :
4
又滤去一个。
从rime.im下载的2014年的小狼毫正式版没有这个问题。试过2015年的小狼毫预览版,还有安卓上的同文,都存在这个问题。 这可能是某次变更导致的bug?

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions