Rebuild all lang Program - Revision history

Geep: /* Downloads */ Update contents of rebuilt_all_lang.zip to include LICENSE.txt

2026-02-14T16:15:29Z

Downloads: Update contents of rebuilt_all_lang.zip to include LICENSE.txt

← Older revision		Revision as of 16:15, 14 February 2026
Line 87:		Line 87:
	v 1.0 Source Code: This C++ v20 program was developed under Windows 11 with VS 2022 Community Edition (updated through 2025).		v 1.0 Source Code: This C++ v20 program was developed under Windows 11 with VS 2022 Community Edition (updated through 2025).
	* [https://drive.google.com/file/d/1kKunDZfVcolZgU4xMsYIpWc5VQgjd3-_/view?usp=sharing Windows executable rebuild_all_lang.exe]		* [https://drive.google.com/file/d/1kKunDZfVcolZgU4xMsYIpWc5VQgjd3-_/view?usp=sharing Windows executable rebuild_all_lang.exe]
	* [https://drive.google.com/file/d/1sNbWZRznhmgUeGJR8GXK6uiMGAstTusY/view?usp=sharing rebuilt_all_lang.zip - source code: a .cpp ~~and~~ .sln file]		* [https://drive.google.com/file/d/1sNbWZRznhmgUeGJR8GXK6uiMGAstTusY/view?usp=sharing rebuilt_all_lang.zip - source code], consisting of a .cpp, .sln, and open-source license file.

	Example preamble files (rename to preamble_utf8.txt to use):		Example preamble files (rename to preamble_utf8.txt to use):

Geep: /* Downloads */ links to 1.1 distribution

2026-02-01T20:42:37Z

Downloads: links to 1.1 distribution

← Older revision		Revision as of 20:42, 1 February 2026
Line 82:		Line 82:
	==== Downloads ====		==== Downloads ====
	v 1.1 [Recommended]. This upgrades to a non-deprecated interface to Windows 10/11's built-in encoding support, and adds custom code to fix 1.0's problem with [Romanian]. It was roundtrip tested against AirPocket's new all.lang. See the release notes in the .cpp file for details.		v 1.1 [Recommended]. This upgrades to a non-deprecated interface to Windows 10/11's built-in encoding support, and adds custom code to fix 1.0's problem with [Romanian]. It was roundtrip tested against AirPocket's new all.lang. See the release notes in the .cpp file for details.
	* [https://drive.google.com/file/d/~~1kKunDZfVcolZgU4xMsYIpWc5VQgjd3-_~~/view?usp=sharing Windows executable rebuild_all_lang.exe]		* [https://drive.google.com/file/d/1j7941Sjy969XZvKEkHuHxs2Ikz5DVp46/view?usp=sharing Windows executable rebuild_all_lang.exe]
	* [https://drive.google.com/file/d/~~1sNbWZRznhmgUeGJR8GXK6uiMGAstTusY~~/view?usp=sharing ~~rebuilt_all_lang~~.zip - source code: a .cpp and .sln file]		* [https://drive.google.com/file/d/178UsLBFpPPce6N-LPwSrG84VRGeLO35i/view?usp=sharing rebuilt_all_lang_1_1.zip - source code: a .cpp and .sln file]

	v 1.0 Source Code: This C++ v20 program was developed under Windows 11 with VS 2022 Community Edition (updated through 2025).		v 1.0 Source Code: This C++ v20 program was developed under Windows 11 with VS 2022 Community Edition (updated through 2025).
Line 92:		Line 92:
	* [https://drive.google.com/file/d/1bOWXv8Ju1DktaNYe2M8Bo-V7zAg2bNJ9/view?usp=sharing preamble_utf8[traditional<nowiki>]</nowiki>.txt]		* [https://drive.google.com/file/d/1bOWXv8Ju1DktaNYe2M8Bo-V7zAg2bNJ9/view?usp=sharing preamble_utf8[traditional<nowiki>]</nowiki>.txt]
	* [https://drive.google.com/file/d/1QKJvG6FoAzuI7njO5fnOQCgwbXQdWqQe/view?usp=sharing preamble_utf8[modern for FM<nowiki>]</nowiki>.txt]		* [https://drive.google.com/file/d/1QKJvG6FoAzuI7njO5fnOQCgwbXQdWqQe/view?usp=sharing preamble_utf8[modern for FM<nowiki>]</nowiki>.txt]

	==== See Also ====		==== See Also ====
	* [[Gen_Lang_Programs]]		* [[Gen_Lang_Programs]]

	{{i18n}} {{editing}}		{{i18n}} {{editing}}

Geep: Update for v 1.1

2026-02-01T20:38:54Z

Update for v 1.1

← Older revision		Revision as of 20:38, 1 February 2026
Line 1:		Line 1:
	''by Geep, 2026''		''by Geep, 2026''

	~~'''HOLD OFF ON USING THIS! Further round-trip testing indicates a problem needing more work.'''~~

	==== Introduction ====		==== Introduction ====
Line 10:		Line 8:
	Suppose "all.lang" was not distributed with the FM. The original FM author may be able to provide it, or you can ask about it being in some TDM SVN repo.		Suppose "all.lang" was not distributed with the FM. The original FM author may be able to provide it, or you can ask about it being in some TDM SVN repo.

	If those routes fail, you can fabricate a replacement all.lang from the *.lang files. Note that the latter are stripped of helpful comments, including grouping header lines, often found in the original all.lang. So this approach is driven by necessity.		If those routes fail, you can fabricate a replacement all.lang from the *.lang files. Note that the latter are stripped of most helpful comments, including grouping header lines, often found in the original all.lang. So this approach is driven by necessity.

	One way that fabrication can be done is first make a new partial all.lang from the existing english.lang file (which being in ASCII, can be viewed as also UTF8), Then add new language sections in UTF8 form. Regenerate just those .lang files, while retaining older unchanged .lang files. Each new UTF8 language section can be -		One way that fabrication can be done is first make a new partial all.lang from the existing english.lang file (which being in ASCII, can be viewed as also UTF8), Then add new language sections in UTF8 form. Regenerate just those .lang files, while retaining older unchanged .lang files. Each new UTF8 language section can be -
Line 21:		Line 19:
	The Windows command-line program rebuild_all_lang is a simple C++ utility that takes no parameters, and if successful generates "all.lang" in the current directory. Control it by -		The Windows command-line program rebuild_all_lang is a simple C++ utility that takes no parameters, and if successful generates "all.lang" in the current directory. Control it by -
	* deciding in advance which *.lang files are the current directory		* deciding in advance which *.lang files are the current directory
	* if you want the generated file to embed a preamble, you can provide it as a file named "preamble_utf8.txt" in the same directory. This is optional. As ~~an example~~, the program distribution includes a typical stock ~~preamble~~.		* if you want the generated file to embed a preamble, you can provide it as a file named "preamble_utf8.txt" in the same directory. This is optional. As examples, the program distribution includes 2 typical stock preambles.

	A typical output to console is:		A typical output to console is:
Line 47:		Line 45:
	Contents of *.lang files were converted successfully to UTF-8 and merged into new 'all.lang'.		Contents of *.lang files were converted successfully to UTF-8 and merged into new 'all.lang'.

	Languages are always processed in the order shown. If a particular *.lang is missing, that is ~~handled quietly~~, and that section is not added to all.lang.		Languages are ''always'' processed in the order shown. If a particular *.lang is missing, that is merely mentioned to the console, and that section is not added to all.lang.

	At the start of all.lang, typical text is...		At the start of all.lang, typical text is...
Line 77:		Line 75:

	This program has some minimal file I/O and conversion error checking, with reporting to console. It is not thought necessary to do character-level checking of the UTF8 results against characters supported by TDM's character map... such checking is better done elsewhere. This is a simple program. (One could imagine a more elaborate version that would, say, allow english.lang to be annotated with comments (e.g., to group lines into subsections). And then reorder lines within the non-English language sections to match, embedding those same annotations.)		This program has some minimal file I/O and conversion error checking, with reporting to console. It is not thought necessary to do character-level checking of the UTF8 results against characters supported by TDM's character map... such checking is better done elsewhere. This is a simple program. (One could imagine a more elaborate version that would, say, allow english.lang to be annotated with comments (e.g., to group lines into subsections). And then reorder lines within the non-English language sections to match, embedding those same annotations.)

			Within each of the source *.lang files, comments take only two forms:
			* as a preamble; as discussed above, the first line is harvested, the rest ignored.
			* as trailing "// ..." at the ends of lines. These will be propagated to the corresponding lines of the rebuilt all.lang. (These will be treated as in the same 8-bit language encoding as the rest of the text in the block. Because all supported encodings include ASCII, English comments will be preserved.)

	==== Downloads ====		==== Downloads ====
			v 1.1 [Recommended]. This upgrades to a non-deprecated interface to Windows 10/11's built-in encoding support, and adds custom code to fix 1.0's problem with [Romanian]. It was roundtrip tested against AirPocket's new all.lang. See the release notes in the .cpp file for details.
			* [https://drive.google.com/file/d/1kKunDZfVcolZgU4xMsYIpWc5VQgjd3-_/view?usp=sharing Windows executable rebuild_all_lang.exe]
			* [https://drive.google.com/file/d/1sNbWZRznhmgUeGJR8GXK6uiMGAstTusY/view?usp=sharing rebuilt_all_lang.zip - source code: a .cpp and .sln file]

	v 1.0 Source Code: This C++ v20 program was developed under Windows 11 with VS 2022 Community Edition (updated through 2025).		v 1.0 Source Code: This C++ v20 program was developed under Windows 11 with VS 2022 Community Edition (updated through 2025).
	* [https://drive.google.com/file/d/1kKunDZfVcolZgU4xMsYIpWc5VQgjd3-_/view?usp=sharing Windows executable rebuild_all_lang.exe]		* [https://drive.google.com/file/d/1kKunDZfVcolZgU4xMsYIpWc5VQgjd3-_/view?usp=sharing Windows executable rebuild_all_lang.exe]

Geep: /* Usage and Example */

2026-01-23T18:15:07Z

Usage and Example

← Older revision		Revision as of 18:15, 23 January 2026
Line 20:		Line 20:
	==== Usage and Example ====		==== Usage and Example ====
	The Windows command-line program rebuild_all_lang is a simple C++ utility that takes no parameters, and if successful generates "all.lang" in the current directory. Control it by -		The Windows command-line program rebuild_all_lang is a simple C++ utility that takes no parameters, and if successful generates "all.lang" in the current directory. Control it by -
	- deciding in advance which *.lang files are the current directory		* deciding in advance which *.lang files are the current directory
	- if you want the generated file to embed a preamble, you can provide it as a file named "preamble_utf8.txt" in the same directory. This is optional. As an example, the program distribution includes a typical stock preamble.		* if you want the generated file to embed a preamble, you can provide it as a file named "preamble_utf8.txt" in the same directory. This is optional. As an example, the program distribution includes a typical stock preamble.

	A typical output to console is:		A typical output to console is:

Geep: HOLD OFF ON USING THIS warning added

2026-01-23T18:07:16Z

HOLD OFF ON USING THIS warning added

← Older revision		Revision as of 18:07, 23 January 2026
Line 1:		Line 1:
	''by Geep, 2026''		''by Geep, 2026''

			'''HOLD OFF ON USING THIS! Further round-trip testing indicates a problem needing more work.'''

	==== Introduction ====		==== Introduction ====
	Ordinarily, an FM that has been internationalized has a UTF8 "all.lang" text file, from which "*.lang" files in various 8-bit ISO-8859-x (or Windows) encodings were generated and distributed within the "strings" folder.		Ordinarily, an FM that has been internationalized has a UTF8 "all.lang" text file, from which "*.lang" files in various 8-bit ISO-8859-x (or Windows) encodings were generated and distributed within the "strings" folder.

Geep: Add ending tags

2026-01-21T19:29:52Z

Add ending tags

← Older revision		Revision as of 19:29, 21 January 2026
Line 85:		Line 85:
	==== See Also ====		==== See Also ====
	* [[Gen_Lang_Programs]]		* [[Gen_Lang_Programs]]

			{{i18n}} {{editing}}

Geep: Tweak "Downloads" & "See Also"

2026-01-21T19:27:08Z

Tweak "Downloads" & "See Also"

← Older revision		Revision as of 19:27, 21 January 2026
Line 76:		Line 76:

	==== Downloads ====		==== Downloads ====
	Source ~~code~~: This C++ v20 program was developed under Windows 11 with VS 2022 Community Edition (updated through 2025).		v 1.0 Source Code: This C++ v20 program was developed under Windows 11 with VS 2022 Community Edition (updated through 2025).
	* [https://drive.google.com/file/d/1kKunDZfVcolZgU4xMsYIpWc5VQgjd3-_/view?usp=sharing Windows executable rebuild_all_lang.exe]		* [https://drive.google.com/file/d/1kKunDZfVcolZgU4xMsYIpWc5VQgjd3-_/view?usp=sharing Windows executable rebuild_all_lang.exe]
	* [https://drive.google.com/file/d/1sNbWZRznhmgUeGJR8GXK6uiMGAstTusY/view?usp=sharing rebuilt_all_lang.zip - source code: a .cpp and .sln file]		* [https://drive.google.com/file/d/1sNbWZRznhmgUeGJR8GXK6uiMGAstTusY/view?usp=sharing rebuilt_all_lang.zip - source code: a .cpp and .sln file]
Line 84:		Line 84:
	* [https://drive.google.com/file/d/1QKJvG6FoAzuI7njO5fnOQCgwbXQdWqQe/view?usp=sharing preamble_utf8[modern for FM<nowiki>]</nowiki>.txt]		* [https://drive.google.com/file/d/1QKJvG6FoAzuI7njO5fnOQCgwbXQdWqQe/view?usp=sharing preamble_utf8[modern for FM<nowiki>]</nowiki>.txt]
	==== See Also ====		==== See Also ====
	[~~COMING SOON~~]		* [[Gen_Lang_Programs]]

Geep: /* Downloads */ added links

2026-01-21T19:19:33Z

Downloads: added links

← Older revision		Revision as of 19:19, 21 January 2026
Line 13:		Line 13:
	* possibly generated using some third-party ISO to UTF8 translator tool.		* possibly generated using some third-party ISO to UTF8 translator tool.

	Or, as a convenience, use rebuild_all_lang. When run from within a give folder (e.g., "strings"), it will take every *.lang it finds (starting with english.lang), convert it from that language's ISO to UTF8, and basically glue them together into the required form.		Or, as a convenience, use '''rebuild_all_lang'''. When run from within a give folder (e.g., "strings"), it will take every *.lang it finds (starting with english.lang), convert it from that language's ISO to UTF8, and basically glue them together into the required form.

	==== Usage and Example ====		==== Usage and Example ====
Line 75:		Line 75:
	This program has some minimal file I/O and conversion error checking, with reporting to console. It is not thought necessary to do character-level checking of the UTF8 results against characters supported by TDM's character map... such checking is better done elsewhere. This is a simple program. (One could imagine a more elaborate version that would, say, allow english.lang to be annotated with comments (e.g., to group lines into subsections). And then reorder lines within the non-English language sections to match, embedding those same annotations.)		This program has some minimal file I/O and conversion error checking, with reporting to console. It is not thought necessary to do character-level checking of the UTF8 results against characters supported by TDM's character map... such checking is better done elsewhere. This is a simple program. (One could imagine a more elaborate version that would, say, allow english.lang to be annotated with comments (e.g., to group lines into subsections). And then reorder lines within the non-English language sections to match, embedding those same annotations.)

	==== ~~Download~~ ====		==== Downloads ====
	~~[COMING SOON]~~
	~~The distribution includes an example stock "preamble_utf8.txt" file.~~
	Source code: This C++ v20 program was developed under Windows 11 with VS 2022 Community Edition (updated through 2025).		Source code: This C++ v20 program was developed under Windows 11 with VS 2022 Community Edition (updated through 2025).
			* [https://drive.google.com/file/d/1kKunDZfVcolZgU4xMsYIpWc5VQgjd3-_/view?usp=sharing Windows executable rebuild_all_lang.exe]
			* [https://drive.google.com/file/d/1sNbWZRznhmgUeGJR8GXK6uiMGAstTusY/view?usp=sharing rebuilt_all_lang.zip - source code: a .cpp and .sln file]

			Example preamble files (rename to preamble_utf8.txt to use):
			* [https://drive.google.com/file/d/1bOWXv8Ju1DktaNYe2M8Bo-V7zAg2bNJ9/view?usp=sharing preamble_utf8[traditional<nowiki>]</nowiki>.txt]
			* [https://drive.google.com/file/d/1QKJvG6FoAzuI7njO5fnOQCgwbXQdWqQe/view?usp=sharing preamble_utf8[modern for FM<nowiki>]</nowiki>.txt]
	==== See Also ====		==== See Also ====
	[COMING SOON]		[COMING SOON]

Geep: create article

2026-01-20T18:55:36Z

create article

New page

''by Geep, 2026''
==== Introduction ====
Ordinarily, an FM that has been internationalized has a UTF8 "all.lang" text file, from which "*.lang" files in various 8-bit ISO-8859-x (or Windows) encodings were generated and distributed within the "strings" folder.

Sometimes, an attempt is made to improve translations, or extend them to additional languages. The ideal way is to alter content in all.lang, then regenerate the *.lang files (e.g., with gen_lang_plus). This regeneration could be for every language section specified in all.lang, or more selectively, just the ones for languages newly added or with changed content.

Suppose "all.lang" was not distributed with the FM. The original FM author may be able to provide it, or you can ask about it being in some TDM SVN repo.

If those routes fail, you can fabricate a replacement all.lang from the *.lang files. Note that the latter are stripped of helpful comments, including grouping header lines, often found in the original all.lang. So this approach is driven by necessity.

One way that fabrication can be done is first make a new partial all.lang from the existing english.lang file (which being in ASCII, can be viewed as also UTF8), Then add new language sections in UTF8 form. Regenerate just those *.lang files, while retaining older unchanged *.lang files. Each new UTF8 language section can be -
* typed from scratch, while consulting the ISO-8859-x version.
* possibly generated using some third-party ISO to UTF8 translator tool.

Or, as a convenience, use rebuild_all_lang. When run from within a give folder (e.g., "strings"), it will take every *.lang it finds (starting with english.lang), convert it from that language's ISO to UTF8, and basically glue them together into the required form.

==== Usage and Example ====
The Windows command-line program rebuild_all_lang is a simple C++ utility that takes no parameters, and if successful generates "all.lang" in the current directory. Control it by -
- deciding in advance which *.lang files are the current directory
- if you want the generated file to embed a preamble, you can provide it as a file named "preamble_utf8.txt" in the same directory. This is optional. As an example, the program distribution includes a typical stock preamble.

A typical output to console is:

Running rebuild_all_lang, v. 1.0
Note: Did not find an optional preamble file preamble_utf8.txt
Processing...
English
German
French
Italian
Spanish
Polish
Romanian
Russian
Portuguese
Czech
Hungarian
Slovak
Swedish
Danish
Dutch
Turkish
Catalan
Contents of *.lang files were converted successfully to UTF-8 and merged into new 'all.lang'.

Languages are always processed in the order shown. If a particular *.lang is missing, that is handled quietly, and that section is not added to all.lang.

At the start of all.lang, typical text is...

// Rebuilt all.lang file - created by rebuild_all_lang v. 1.0
// Strings in each section in same order as in *.lang, but converted from various iso-8859s encodings to UTF8.

// Note - did not find an optional file preamble_utf8.txt with preamble comments to place here.

{
[English]
// Sourced from english.lang of 2025-07-16T16:08:26+00:00, whose first line was...
// String table - english (iso-8859-1) - created on 2025-07-16T16:08:26Z with gen_lang_plus v. 1.1
"#str_fm_airpocket_xd_sheet_appointment_to_service_pg1__title" "Appointment to Service\n"
....

Within each language section - like [English] here - some variant of the first two commented lines are always generated. As you see, the "// Sourced from..." line is followed by the first line copied from the *.lang file. In this example, the comments show the external file modification datetime, and then the datetime written at generation time. The latter will not always be present, depending upon creation method.

==== Details ====
As required, the generated all.lang text file has Linux linebreaks (e.g., LF instead of CRFL), independent of linebreak form in input files *.lang or preamble_UTF8.txt

If all.lang already exists, you will see...

Running rebuild_all_lang, v. 1.0
File 'all.lang' already exists.
Continue and overwrite it? [y/n]

If you indicate "n" for "no", the program quits with message "Bye".

This program has some minimal file I/O and conversion error checking, with reporting to console. It is not thought necessary to do character-level checking of the UTF8 results against characters supported by TDM's character map... such checking is better done elsewhere. This is a simple program. (One could imagine a more elaborate version that would, say, allow english.lang to be annotated with comments (e.g., to group lines into subsections). And then reorder lines within the non-English language sections to match, embedding those same annotations.)

==== Download ====
[COMING SOON]
The distribution includes an example stock "preamble_utf8.txt" file.
Source code: This C++ v20 program was developed under Windows 11 with VS 2022 Community Edition (updated through 2025).
==== See Also ====
[COMING SOON]