Rule Sets FAQ - Revision history

MaryH: /* How I create a regex pattern for Registered, Trademark, Copyright symbols? */

2018-03-13T17:40:43Z

How I create a regex pattern for Registered, Trademark, Copyright symbols?

← Older revision		Revision as of 17:40, 13 March 2018
Line 78:		Line 78:
	http://www.regular-expressions.info/unicode.html		http://www.regular-expressions.info/unicode.html

	===How I create a regex pattern for Registered, Trademark, Copyright symbols?===		===How do I create a regex pattern for Registered, Trademark, Copyright symbols?===

	To detect/filter characters such as ® (Registered), please use the Unicode code point in the regex. For instance,		To detect/filter characters such as ® (Registered), please use the Unicode code point in the regex. For instance,

MaryH: /* How to create a regex pattern for Registered, Trademark, Copyright symbols */

2018-03-13T17:36:20Z

How to create a regex pattern for Registered, Trademark, Copyright symbols

← Older revision		Revision as of 17:36, 13 March 2018
Line 78:		Line 78:
	http://www.regular-expressions.info/unicode.html		http://www.regular-expressions.info/unicode.html

	===How to create a regex pattern for Registered, Trademark, Copyright symbols===		===How I create a regex pattern for Registered, Trademark, Copyright symbols?===

	To detect/filter characters such as ® (Registered), please use the Unicode code point in the regex. For instance,		To detect/filter characters such as ® (Registered), please use the Unicode code point in the regex. For instance,
	* ® (Registered): \u00AE		* ® (Registered): \u00AE
	* ™ (Trademark): \u2122		* ™ (Trademark): \u2122
	* © (Copyright): \u00A9		* © (Copyright): \u00A9

	~~http://www.regular-expressions.info/unicode.html~~
	===Searching for characters in a specified language===		===Searching for characters in a specified language===

MaryH at 17:34, 13 March 2018

2018-03-13T17:34:54Z

← Older revision		Revision as of 17:34, 13 March 2018
Line 78:		Line 78:
	http://www.regular-expressions.info/unicode.html		http://www.regular-expressions.info/unicode.html

			===How to create a regex pattern for Registered, Trademark, Copyright symbols===

			To detect/filter characters such as ® (Registered), please use the Unicode code point in the regex. For instance,
			* ® (Registered): \u00AE
			* ™ (Trademark): \u2122
			* © (Copyright): \u00A9

			http://www.regular-expressions.info/unicode.html
	===Searching for characters in a specified language===		===Searching for characters in a specified language===

Olibouban: /* Can I modify the Default Rule Sets? */

2015-09-09T17:42:45Z

Can I modify the Default Rule Sets?

← Older revision		Revision as of 17:42, 9 September 2015
Line 1:		Line 1:
	===Can I modify the Default Rule Sets?===		===Can I modify the Default Rule Sets?===

	If you ~~have a Globalyzer Team Server license, you will be~~ hosting the Globalyzer Server, ~~and as~~ the Administrator~~, you~~ can modify any of the Default Rule Sets.		If you are hosting the Globalyzer Server, the Administrator user can modify any of the Default Rule Sets.

	If ~~you are running from~~ Lingoport's Globalyzer Server, you will not be able to modify the Default Rule Sets, but you can modify one of your own Rule Sets and then allow your team members to either use it (sharing) or copy it. This Rule Set can then be the starting point for their internationalization scanning and filtering process.		If Lingoport is hosting the Globalyzer Server, you will not be able to modify the Default Rule Sets, but you can modify one of your own Rule Sets and then allow your team members to either use it (sharing) or copy it. This Rule Set can then be the starting point for their internationalization scanning and filtering process.

	===In what order are Rule Set detection and filtering applied?===		===In what order are Rule Set detection and filtering applied?===

Olibouban: /* I changed the Rule Set but the Workbench keeps using the old Rule Set. How can I use the updated Rule Set? */

2015-09-09T15:03:22Z

I changed the Rule Set but the Workbench keeps using the old Rule Set. How can I use the updated Rule Set?

← Older revision		Revision as of 15:03, 9 September 2015
Line 13:		Line 13:

	===I changed the Rule Set but the Workbench keeps using the old Rule Set. How can I use the updated Rule Set?===		===I changed the Rule Set but the Workbench keeps using the old Rule Set. How can I use the updated Rule Set?===
	When rule sets are modified on the server, select <code>Project->Reload Rule</code> Sets to refresh the client.		When rule sets are modified on the server, select <b><code>Project->Reload Rule</code></b> Sets to refresh the client.

	===We have lots of Rule Sets: Is there a way to organize Rule Set to better manage them?===		===We have lots of Rule Sets: Is there a way to organize Rule Set to better manage them?===

Olibouban at 15:02, 9 September 2015

2015-09-09T15:02:56Z

← Older revision		Revision as of 15:02, 9 September 2015
Line 14:		Line 14:
	===I changed the Rule Set but the Workbench keeps using the old Rule Set. How can I use the updated Rule Set?===		===I changed the Rule Set but the Workbench keeps using the old Rule Set. How can I use the updated Rule Set?===
	When rule sets are modified on the server, select <code>Project->Reload Rule</code> Sets to refresh the client.		When rule sets are modified on the server, select <code>Project->Reload Rule</code> Sets to refresh the client.

			===We have lots of Rule Sets: Is there a way to organize Rule Set to better manage them?===
			Globalyzer supports <b>Inherited Rule Sets</b>.

			Base rule sets can be created and maintained by an individual and then project level rule sets can extend the base rule set. The extended rule set would have everything from the base rule set, plus whatever is added/modified.

			When an individual introduces a new rule or modifies a rule in the project level rule set, other projects wouldn't be affected.

	===Where can I find help on “General Pattern” issues found in C++ code scanning?===		===Where can I find help on “General Pattern” issues found in C++ code scanning?===

Olibouban at 14:55, 9 September 2015

2015-09-09T14:55:38Z

← Older revision		Revision as of 14:55, 9 September 2015
Line 5:		Line 5:
	If you are running from Lingoport's Globalyzer Server, you will not be able to modify the Default Rule Sets, but you can modify one of your own Rule Sets and then allow your team members to either use it (sharing) or copy it. This Rule Set can then be the starting point for their internationalization scanning and filtering process.		If you are running from Lingoport's Globalyzer Server, you will not be able to modify the Default Rule Sets, but you can modify one of your own Rule Sets and then allow your team members to either use it (sharing) or copy it. This Rule Set can then be the starting point for their internationalization scanning and filtering process.

			===In what order are Rule Set detection and filtering applied?===
			There are four categories of results: Embedded Strings, Locale-Sensitive Methods, General Patterns, and Static File References.

			For Embedded Strings, all strings are found as issues initially, then the string filters are run (all except String Method Filter) to see what should be filtered (String Line Filter, String Literal Filter, and String Operand Filter), and then the detection patterns are run to see what should be retained (String Method Pattern, String Operand Pattern, and String Retention Pattern). Then String Method Filter is run last. We used to run String Method Filters along with the other filters, but found in practice that String Method Filters should trump all detections, and be run last.

			For the other three categories, the patterns are run first to find the issues, and then the filters are run to remove.

			===I changed the Rule Set but the Workbench keeps using the old Rule Set. How can I use the updated Rule Set?===
			When rule sets are modified on the server, select <code>Project->Reload Rule</code> Sets to refresh the client.

	===Where can I find help on “General Pattern” issues found in C++ code scanning?===		===Where can I find help on “General Pattern” issues found in C++ code scanning?===

Masnes: /* Searching for characters in a specified language with character ranges */

2015-08-06T00:31:58Z

Searching for characters in a specified language with character ranges

← Older revision		Revision as of 00:31, 6 August 2015
Line 93:		Line 93:

	The above regex expression will find strings of one or more Chinese characters from any of the Ideograph sets.		The above regex expression will find strings of one or more Chinese characters from any of the Ideograph sets.

			For Example:
			[[File:ChineseStringRetentionPatternAllChineseCharacters.png]]

	===Character Ranges for Korean, Chinese and Japanese===		===Character Ranges for Korean, Chinese and Japanese===

Masnes: /* Character Ranges for Korean, Chinese and Japanese */

2015-08-06T00:10:49Z

Character Ranges for Korean, Chinese and Japanese

Masnes: /* Character Ranges for Korean, Chinese and Japanese */

2015-08-05T22:09:33Z

Character Ranges for Korean, Chinese and Japanese

@@ Line 104: / Line 104: @@
 ====Chinese (Han)====
 * 4e00-9fd5   [http://www.unicode.org/charts/PDF/U4E00.pdf (CJK Unified Ideographs, ~500 page pdf)]
-* 3400-4db5   [http://www.unicode.org/charts/PDF/U3400.pdf (CJK Unified Ideographs ext a, ~100 page pdf)]
+* 3400-4db5   [http://www.unicode.org/charts/PDF/U3400.pdf (CJK Unified Ideographs ext. a, ~100 page pdf)]
-* 20000-2a6d6 [http://www.unicode.org/charts/PDF/U20000.pdf (CJK Unified Ideographs ext b, ~400 page pdf)]
+* 20000-2a6d6 [http://www.unicode.org/charts/PDF/U20000.pdf (CJK Unified Ideographs ext. b, ~400 page pdf)]
-* 2a700-2b734 [http://www.unicode.org/charts/PDF/U2A700.pdf (CJK Unified Ideographs ext c, ~40 page pdf)]
+* 2a700-2b734 [http://www.unicode.org/charts/PDF/U2A700.pdf (CJK Unified Ideographs ext. c, ~40 page pdf)]
 ====Japanese (Katakana, Hiragana, Kanji)====
 =====At a glance:=====
 * 3000-30ff ([http://www.unicode.org/charts/PDF/U3000.pdf Punctuation],[http://www.unicode.org/charts/PDF/U3040.pdf Hiragana],[http://www.unicode.org/charts/PDF/U30A0.pdf Katakana])
 * 31f0-31ff [http://www.unicode.org/charts/PDF/U31F0.pdf (Katakana phonetic extensions)]

← Older revision		Revision as of 00:10, 6 August 2015
Line 96:		Line 96:
	===Character Ranges for Korean, Chinese and Japanese===		===Character Ranges for Korean, Chinese and Japanese===
	====Korean (Hangul)====		====Korean (Hangul)====
	* 1100-11ff [http://www.unicode.org/charts/PDF/U1100.pdf (Jamo)]		* (Hex 1100-11ff) (Decimal 4352-4607) [http://www.unicode.org/charts/PDF/U1100.pdf (Jamo)]
	* a960-a97c [http://www.unicode.org/charts/PDF/UA960.pdf (Jamo extended a)]		* (Hex a960-a97c) (Decimal 43360-43388) [http://www.unicode.org/charts/PDF/UA960.pdf (Jamo extended a)]
	* d7b0-d7ff [http://www.unicode.org/charts/PDF/UD7B0.pdf (Jamo extended b)]		* (Hex d7b0-d7ff) (Decimal 55216-55295) [http://www.unicode.org/charts/PDF/UD7B0.pdf (Jamo extended b)]
	* 3130-318f [http://www.unicode.org/charts/PDF/U3130.pdf (Hangul compatibility Jamo)]		* (Hex 3130-318f) (Decimal 12592-12687) [http://www.unicode.org/charts/PDF/U3130.pdf (Hangul compatibility Jamo)]
	* ff00-ffef [http://www.unicode.org/charts/PDF/UFF00.pdf (half width and full width forms, includes english alphabet)]		* (Hex ff00-ffef) (Decimal 65280-65519) [http://www.unicode.org/charts/PDF/UFF00.pdf (half width and full width forms, includes english alphabet)]

	====Chinese (Han)====		====Chinese (Han)====
	* 4e00-9fd5 [http://www.unicode.org/charts/PDF/U4E00.pdf (CJK Unified Ideographs, ~500 page pdf)]		* (Hex 4e00-9fd5) (Decimal 19968-40917) [http://www.unicode.org/charts/PDF/U4E00.pdf (CJK Unified Ideographs, ~500 page pdf)]
	* 3400-4db5 [http://www.unicode.org/charts/PDF/U3400.pdf (CJK Unified Ideographs ext. a, ~100 page pdf)]		* (Hex 3400-4db5) (Decimal 13312-19893) [http://www.unicode.org/charts/PDF/U3400.pdf (CJK Unified Ideographs ext. a, ~100 page pdf)]
	* 20000-2a6d6 [http://www.unicode.org/charts/PDF/U20000.pdf (CJK Unified Ideographs ext. b, ~400 page pdf)]		* (Hex 20000-2a6d6) (Decimal 131072-173782) [http://www.unicode.org/charts/PDF/U20000.pdf (CJK Unified Ideographs ext. b, ~400 page pdf)]
	* 2a700-2b734 [http://www.unicode.org/charts/PDF/U2A700.pdf (CJK Unified Ideographs ext. c, ~40 page pdf)]		* (Hex 2a700-2b734) (Decimal 173824-177972) [http://www.unicode.org/charts/PDF/U2A700.pdf (CJK Unified Ideographs ext. c, ~40 page pdf)]

	====Japanese (Katakana, Hiragana, Kanji)====		====Japanese (Katakana, Hiragana, Kanji)====
	=====At a glance:=====		=====At a glance:=====
	* 3000-30ff ([http://www.unicode.org/charts/PDF/U3000.pdf Punctuation],[http://www.unicode.org/charts/PDF/U3040.pdf Hiragana],[http://www.unicode.org/charts/PDF/U30A0.pdf Katakana])		* (Hex 3000-30ff) (Decimal 12288-12543) ([http://www.unicode.org/charts/PDF/U3000.pdf Punctuation],[http://www.unicode.org/charts/PDF/U3040.pdf Hiragana],[http://www.unicode.org/charts/PDF/U30A0.pdf Katakana])
	* 31f0-31ff [http://www.unicode.org/charts/PDF/U31F0.pdf (Katakana phonetic extensions)]		* (Hex 31f0-31ff) (Decimal 12784-12799) [http://www.unicode.org/charts/PDF/U31F0.pdf (Katakana phonetic extensions)]
	* 1b000-1b0ff [http://www.unicode.org/charts/PDF/U1B000.pdf (Katakana supplement)]		* (Hex 1b000-1b0ff) (Decimal 110592-110847) [http://www.unicode.org/charts/PDF/U1B000.pdf (Katakana supplement)]
	* 3400-9faf ([http://www.rikai.com/library/kanjitables/kanji_codes.unicode.shtml Common / Uncommon Kanji] and [http://www.rikai.com/library/kanjitables/kanji_codes.unicode.shtml Rare Kanji])		* (Hex 3400-9faf) (Decimal 13312-40879) ([http://www.rikai.com/library/kanjitables/kanji_codes.unicode.shtml Common / Uncommon Kanji] and [http://www.rikai.com/library/kanjitables/kanji_codes.unicode.shtml Rare Kanji])
	** Exclude 4db1-4dff if you wish to avoid a section between sets of Kanji		** Exclude 4db1-4dff if you wish to avoid a section between sets of Kanji
	* ff00-ffef [http://www.unicode.org/charts/PDF/UFF00.pdf (Half width and full width forms, includes english alphabet)]		* (Hex ff00-ffef) (Decimal 65280-65519) [http://www.unicode.org/charts/PDF/UFF00.pdf (Half width and full width forms, includes english alphabet)]

	=====Full details:=====		=====Full details:=====
	* 3000-303f [http://www.unicode.org/charts/PDF/U3000.pdf (Punctuation)]		* (Hex 3000-303f) (Decimal 12288-12351) [http://www.unicode.org/charts/PDF/U3000.pdf (Punctuation)]
	* 3040-309f [http://www.unicode.org/charts/PDF/U3040.pdf (Hiragana)]		* (Hex 3040-309f) (Decimal 12352-12447) [http://www.unicode.org/charts/PDF/U3040.pdf (Hiragana)]
	* 30a0-30ff [http://www.unicode.org/charts/PDF/U30A0.pdf (Katakana)]		* (Hex 30a0-30ff) (Decimal 12448-12543) [http://www.unicode.org/charts/PDF/U30A0.pdf (Katakana)]
	* 31f0-31ff [http://www.unicode.org/charts/PDF/U31F0.pdf (Katakana phonetic extensions)]		* (Hex 31f0-31ff) (Decimal 12784-12799) [http://www.unicode.org/charts/PDF/U31F0.pdf (Katakana phonetic extensions)]

	* 1b000-1b0ff [http://www.unicode.org/charts/PDF/U1B000.pdf (Katakana supplement)]		* (Hex 1b000-1b0ff) (Decimal 110592-110847) [http://www.unicode.org/charts/PDF/U1B000.pdf (Katakana supplement)]

	* 4e00-9faf [http://www.rikai.com/library/kanjitables/kanji_codes.unicode.shtml (Common and Uncommon Kanji)]		* (Hex 4e00-9faf) (Decimal 19968-40879) [http://www.rikai.com/library/kanjitables/kanji_codes.unicode.shtml (Common and Uncommon Kanji)]
	* 3400-4dbf [http://www.rikai.com/library/kanjitables/kanji_codes.unicode.shtml (Rare Kanji)]		* (Hex 3400-4dbf) (Decimal 13312-19903) [http://www.rikai.com/library/kanjitables/kanji_codes.unicode.shtml (Rare Kanji)]

	* ff60-ffdf [http://www.unicode.org/charts/PDF/UFF00.pdf (Half width Japanese punctuation and Katakana)]		* (Hex ff60-ffdf) (Decimal 65376-65503) [http://www.unicode.org/charts/PDF/UFF00.pdf (Half width Japanese punctuation and Katakana)]
	* ff00-ffef [http://www.unicode.org/charts/PDF/UFF00.pdf (Half width and full width forms, includes english alphabet)]		* (Hex ff00-ffef) (Decimal 65280-65519) [http://www.unicode.org/charts/PDF/UFF00.pdf (Half width and full width forms, includes english alphabet)]