All pull requests

Pull requests

• Improve Thai segmentation: maximal matching on character cluster boundaries

  #384·kamthorn opened Sep 25, 2026·

  ·
  5

• Normalize final sigma in every position, not only at the end

  #383·jaideeppyne opened Aug 29, 2026·

  ·
  8

• Normalize Arabic and Persian Kaf/Yeh to a single canonical form

  #382·harismuzaffer opened Aug 14, 2026·

  ·
  1

  5

• Make allow list API more flexible

  #380·RemiBardon opened Jul 21, 2026·

  ·
  11

• Reuse cached language

  #378·baptistejamin opened Jul 19, 2026·

  ·
  3

• Fix script detection of halfwidth katakana and fullwidth forms

  #376·mahirhir opened Jun 28, 2026·

  ·
  1

  1

• Replace yanked core2 to make charabia installable again

  #374·JEM-Mosig opened Apr 15, 2026·

  ·
  1

  2

• Improve Thai normalization: preserve combining marks and fix Sara Am decomposition

  #372·kamthorn opened Apr 6, 2026·

  ·
  1

  2

• Add AI usage disclosure guidelines to CONTRIBUTING.md

  documentation
  #369·meili-bot opened Jan 19, 2026Contributor·

  ·
  1

• chore(deps): bump peter-evans/create-pull-request from 7 to 8

  dependenciesskip changelog
  #368·dependabot[bot] opened Jan 1, 2026Bot·

  ·
  1

• chore(deps): bump actions/checkout from 5 to 6

  dependenciesskip changelog
  #364·dependabot[bot] opened Dec 1, 2025Bot·

  ·
  1

• chore(deps): bump Swatinem/rust-cache from 2.8.1 to 2.8.2

  dependenciesskip changelog
  #363·dependabot[bot] opened Dec 1, 2025Bot·

  ·
  1

• Make classification case insenstive

  #352·ManyTheFish opened Aug 26, 2025Member·

  ·

• Adds support for the use of external dictionaries for segmenters backed by lindera

  #326·PedroTurik opened Jan 24, 2025Contributor·

  ·
  1

  5

• Normalizer for russian

  #296·aignatovich opened Jun 26, 2024·

  ·
  11

• [Fork tracking] Chinese Segmenter enhancements

  #253·ManyTheFish opened Jan 9, 2024Member·

  ·
  2