11660 common.UTF-8.src should be compiled from CLDR data

Reviews
Diff

- Download Diff

Information
Submitter:	Yuri Pankov
Repository:	illumos-gate
Branch:	master
Bugs:	11660
Depends On:
Commit:	7f9deb6...
Reviewers
Groups:	general
People:

Description

Compile data/common.UTF-8.src from UnicodeData.txt and UTF-8 charmap.

tools/utf8-rollup.pl comes from FreeBSD, where I did modify it to do the same. It didn't have any license/copyrights there, so I'm not adding for illumos.

Add basic README while here (to be updated when next CLDR release comes in).

Testing Done

Just using it. Same was done in FreeBSD almost an year ago and doesn't seem to introduce any issues.

Issues

0
0
1
All Issues: 1

Description	From	Last Updated
This didn't need an any updates too, right?	Rich Lowe	Sept. 5, 2019, 8:18 p.m.

usr/src/data/locale/tools/utf8-rollup.pl (Diff revision 1)

Show all issues

This didn't need an any updates too, right?

Yuri Pankov Sept. 5, 2019, 7:49 p.m.

No, UTF-8.cm is updated only for new CLDR releases.  Script gets character class values from UnicodeData.txt, and uses UTF-8.cm to do the wide-character code -> name mapping.

Yuri Pankov Sept. 5, 2019, 7:53 p.m.

Or it's possible I just don't understand what you are asking :)

The script is run from usr/src/data/locale like perl tools/utf8-rollup.pl --unidata=/path/to/UnicodeData.txt once after updating CLDR to new release.

Rich Lowe Sept. 5, 2019, 8:18 p.m.

You understood, I just wanted to make sure nothing was missing (and that I understood why nothing was missing) :)
Thanks.

Change Summary:

Update utf8-rollup.pl with license/copyright.

Commit:

-	ac4f5af2674a477673b6319df11c5b1052a38283
+	7f9deb68e390ce2b131e863b41cc6f6170b05880

Diff:

Revision 2 (+33199 -6132)

Show changes

	usr/src/data/locale/README.txt
	usr/src/data/locale/data/common.UTF-8.src
	usr/src/data/locale/tools/utf8-rollup.pl

Ship it!

Ship It!

Change Summary:

add issue #

Bugs:

+	11660

You have a pending review.

Review Board 2.5.16

Screenshots

Files

Issues

Change Summary:

Commit:

Diff:

Change Summary:

Bugs:

Status: Closed (submitted)