open-dsi
/
postgres
mirror of https://github.com/postgres/postgres
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
51501 Commits
38 Branches
662 Tags
732 MiB
 
 
 
 
 
 
Tag: Branch: Tree: c24311c1fe
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from 'c24311c1fe'
${ noResults }
postgres/src/common/unicode
History
Tom Lane 5cbfce562f
Initial pgindent and pgperltidy run for v13. 		5 years ago
..
.gitignore Add SQL functions for Unicode normalization 6 years ago
Makefile Fix update-unicode target 5 years ago
README Add support for automatically updating Unicode derived files 6 years ago
generate-norm_test_table.pl Initial pgindent and pgperltidy run for v13. 5 years ago
generate-unicode_combining_table.pl Initial pgindent and pgperltidy run for v13. 5 years ago
generate-unicode_norm_table.pl Initial pgindent and pgperltidy run for v13. 5 years ago
generate-unicode_normprops_table.pl Initial pgindent and pgperltidy run for v13. 5 years ago
norm_test.c Add support for other normal forms to Unicode normalization API 6 years ago

README 

This directory contains tools to generate the tables in
src/include/common/unicode_norm.h, used for Unicode normalization. The
generated .h file is included in the source tree, so these are normally not
needed to build PostgreSQL, only if you need to re-generate the .h file
from the Unicode data files for some reason, e.g. to update to a new version
of Unicode.

Generating unicode_norm_table.h
-------------------------------

Run

    make update-unicode

from the top level of the source tree and commit the result.

Tests
-----

The Unicode consortium publishes a comprehensive test suite for the
normalization algorithm, in a file called NormalizationTest.txt. This
directory also contains a perl script and some C code, to run our
normalization code with all the test strings in NormalizationTest.txt.
To download NormalizationTest.txt and run the tests:

    make normalization-check

This is also run as part of the update-unicode target.