open-dsi
/
postgres
mirror of https://github.com/postgres/postgres
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
52103 Commits
38 Branches
662 Tags
732 MiB
 
 
 
 
 
 
Tag: Branch: Tree: 78ab944cd4
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from '78ab944cd4'
${ noResults }
postgres/src/common/unicode
History
John Naylor 78ab944cd4
Change mbbisearch to return the character range 		4 years ago
..
.gitignore Add SQL functions for Unicode normalization 6 years ago
Makefile Rename unicode_combining_table to unicode_width_table 4 years ago
README Add support for automatically updating Unicode derived files 6 years ago
generate-norm_test_table.pl Update copyright for 2021 5 years ago
generate-unicode_norm_table.pl Update copyright for 2021 5 years ago
generate-unicode_normprops_table.pl Update copyright for 2021 5 years ago
generate-unicode_width_table.pl Change mbbisearch to return the character range 4 years ago
norm_test.c Update copyright for 2021 5 years ago

README 

This directory contains tools to generate the tables in
src/include/common/unicode_norm.h, used for Unicode normalization. The
generated .h file is included in the source tree, so these are normally not
needed to build PostgreSQL, only if you need to re-generate the .h file
from the Unicode data files for some reason, e.g. to update to a new version
of Unicode.

Generating unicode_norm_table.h
-------------------------------

Run

    make update-unicode

from the top level of the source tree and commit the result.

Tests
-----

The Unicode consortium publishes a comprehensive test suite for the
normalization algorithm, in a file called NormalizationTest.txt. This
directory also contains a perl script and some C code, to run our
normalization code with all the test strings in NormalizationTest.txt.
To download NormalizationTest.txt and run the tests:

    make normalization-check

This is also run as part of the update-unicode target.