rime-lmdg

fcitx5扩展词库/Rime全局带声调词库，最全声调标注工具链，Rime语法模型：LMDG - Language, Model, Dictionary, Grammar。

21 articles

Trade-offs Between KenLM and Other N-gram Model Builders for RIME

Explore KenLM's advantages for RIME language model training including speed memory efficiency and licensing compared to alternatives like SRILM.

performance

Feb 24, 2026

How to Tune RIME Grammar Configuration: `collocation_max_length` and `collocation_penalty` Deep Dive

Master RIME grammar configuration. Tune collocation_max_length and collocation_penalty to optimize multi-character phrase handling and scoring for better language model performance.

deep-dive

Feb 24, 2026

How to Ensure Data Integrity When Processing Mixed File Formats in RIME-LMDG

Ensure data integrity when processing mixed file formats like txt yaml csv json jsonl in amzxyz/rime-lmdg. Learn efficient strategies for robust data handling.

best-practices

Feb 24, 2026

AUX_SEP_REGEX Pattern in Rime LMDG: How to Customize Auxiliary Code Separators

Customize Rime LMDG auxiliary codes by modifying the AUX_SEP_REGEX pattern in wanxiang-tools.py. Learn how this regex splits pinyin and update delimiters instantly.

how-to-guide

Feb 24, 2026

How pypinyin heteronym=False Generates Deterministic Pinyin Annotations

Learn how pypinyin heteronym=False ensures deterministic pinyin annotations by returning only the first pronunciation for each character, vital for RIME dictionary creation.

deep-dive

Feb 24, 2026

How to Develop a Migration Strategy for Legacy RIME Dictionaries to the Wanxiang Format Without Data Loss

**The `amzxyz/rime-lmdg` repository provides a lossless, two-phase Python pipeline that converts legacy RIME dictionaries to the Wanxiang format by first normalizing tone marks and then injecting auxiliary codes, while preservi...

migration-guide

Feb 24, 2026

How to Benchmark Jieba Multi-Threading Configurations in Rime-LMDG

Benchmark jieba multi-threading configurations effectively measure performance across worker counts. Optimize your Rime-LMDG setup for speed and efficiency.

performance

Feb 24, 2026

Corpus File Encoding in rime-lmdg: Default UTF-8 Settings and Custom Configuration

Discover rime-lmdg's default UTF-8 corpus file encoding. Learn how to specify custom encodings using FILE_ENCODING or open arguments for flexible file handling.

internals

Feb 24, 2026

How 对数归一化 (Logarithmic Normalization) Shapes Word Frequencies in Rime-LMDG

Discover how logarithmic normalization compresses n-gram probabilities in Rime-LMDG. Learn how this technique reduces storage size while preserving statistical relationships for your input method.

deep-dive

Feb 24, 2026

Learn the recommended directory structure for RIME grammar files. This guide shows you where to place your .gram file for seamless integration with your input method.

how-to-guide

Feb 24, 2026

How to Troubleshoot Common Errors During KenLM ARPA File Generation

Troubleshoot KenLM ARPA file generation errors in rime-lmdg. Learn to diagnose missing binaries, memory, and permission issues by inspecting exit codes and console output.

how-to-guide

Feb 24, 2026

Memory Optimization Strategies for Processing a 32GB Chinese Corpus in rime-lmdg

Discover memory optimization strategies for processing a 32GB Chinese corpus with rime-lmdg. Learn about streaming I/O, generator pipelines, chunked aggregation, multiprocessing, and SQLite for efficient RAM usage.

Feb 24, 2026

Have a question about this repo?

These articles cover the highlights, but your codebase questions are specific. Give your agent direct access to the source. Share this with your agent to get started:

Share the following with your agent to get started:

curl -s "https://instagit.com/install.md"

Add to your MCP client configuration:

{
  "mcpServers": {
    "instagit": {
      "command": "npx",
      "args": ["-y", "instagit@latest"]
    }
  }
}

Ask your agent:

"Use Instagit MCP to understand how amzxyz/rime-lmdg works."

Works with

Claude Codex Cursor VS Code OpenClaw Any MCP Client

Maintain an open-source project? Get it listed too →