The DarkMod Wiki - Recent changes [en]

Converting Translations with all lang to po

Geep — Sat, 24 Oct 2026 19:39:45 GMT

Overview

Converting Translations with all lang to po

Geep — Fri, 23 Oct 2026 20:01:05 GMT

create article

New page

=== Moving from LANG to POT and PO Files===
''By Geep, 2026''
==Overview==
Traditionally, TDM's i18n approach has used a UTF8 "all.lang" file, which has an "[English]" section as master, followed by individual sections for each TDM-supported language. Across sections, phrases have been tied together by #str_ids. Then, from all.lang, language files (e.g., english.lang, german.lang, etc) in language-specific 8-bit encodings are generated and distributed.

Consider specifically tdm_base01.pk4/strings/all.lang, that provides TDM's main menu and other core phrases.

For [upcoming] TDM 2.15, the [English] portion of this was substantially reworked, to provide greater and more accurate context for human and AI translators, and so assist remaining translation updates and fill-ins.

Building off that, Geep and stgatilov are undertaking a move towards the popular GNU "gettext" translation architecture, with:
* an English template file (english.pot)
* various individual language files (*.po). The target encoding for these remains UTF8, unlike the *.lang files. Instead, the TDM engine internally converts to 8-bit form (at least for now).

All these can be edited by third-party apps like "poedit".

It is desirable to retain the advantages of the reworked all.lang. So, rather than the stock workflow of using "xgettext" to generate a .pot file from marked-up *.cpp, *.hpp, and *.gui source, a further-marked-up version of all.lang [English] is used instead, as in effect the "source" material.

In turn, this used by all_lang_to_po to generate:
* "english.pot", as structured from all.lang [English].
* Various non-english "*.po" files. These also reflect the all.lang [English] structure, because the creation of each begins with copying the english.pot template, then adding all existing translations from the appropriate language section of all.lang .
* Optionally, an "english.po" file, where each English string appears twice. This is not required, since TDM will consume "english.pot" for the English phrases.

[LATER: The exact workflow for further revisions after this transition is still being determined. Likewise applicability to FM translations.]
==Treatment of Unique IDs==
As background, some gettext-based translation projects do not use symbolic ids (like #str_), but just use unique English strings as keys. This would be represented in the english.pot file as:

msgid "Mine"
msgstr ""

Then, in each corresponding language-specific .po, msgstr would be filled in with the translation.

If a particular English key phrase appears multiple times with different meanings, then an additional "context" field can distinguish them:

msgctxt "weapon"
msgid "Mine"
msgstr ""

msgctxt "location"
msgid "Mine"
msgstr ""

In this case, pot/po considers msgctxt+msgid to be the unique key (while msgctxt by itself is not unique.)

For projects like main-menu TDM with symbolic keys, an obvious configuration of the format would be:

msgid "#str_12345"
msgstr ""

But this has a significant drawback. Because the .pot file doesn't contain any English strings, features of poedit that use AI (or community resources) to do draft string translations can't be used. There are ways to overcome this; a reportedly popular one, adopted here, is to move the symbolic link into msgctxt:

msgctxt "#str_12345"
msgid "Mine"
msgstr ""

If further context is needed, it could be included as a comment, discussed further below.

==Editing & Markup in all.lang [English]==
===Programmatic Considerations===
On each line within the [English] section, leading tabs and spaces are ignored.
====Po-Visible Lines====
We define here a "po-visible" line as one that appears as a visible, selectable row in poedit. There are two types, which we name here:
* "Translatable" lines
* "Structure" lines

Translatable lines are indicated by retaining the traditional TDM all.lang layout:
"#str_12345" "Some text here"
Structure lines (which will not be expected to be translated) serve as headlines to group translatable lines together within poedit. Arbitrarily, they are flagged with "//|", e.g.
//| SETTINGS VIDEO SUBMENU
====Comments====
Comments must be associated with, and anchored by, a particular po-visible line. In all.lang, they are arbitrarily flagged as follows:
* Lines that start with "//" are BEFORE comments, associated with a po-visible line that immediately follows the group of them. (Excluded: lines starting with "//|" or "///".)
* Lines that start with "///" are AFTER comments, associated with a po-visible line that immediately precedes the group of them.
When processed by all_lang_to_po, both types will be emitted together (as a group of consecutive individual comment lines, all preceding the po-visible line). Each comment line be flagged by starting with "#." and omit the "//" or "///". In poedit, these will appear in the "Note to Translators" pane, that is shown when the po-visible line is selected.

It was found necessary to have both types to maximize readability of both all.lang and .pot, and provide flexibility for anchoring.

Special treatment: In all.lang, it is common with a group of before-comments for the last line to end in ":", referring to the next line with its po-visible anchoring item. However, once converted into a "Note to Translators", the colon is either useless or erroneously seems to address the first after-comment. So the conversion process automatically removes it. (If the all.lang editor needs to retain it, add a space after it.)

Note: a third possibility, a "//" comment at the trailing end of a translatable line within the [English] section, is deprecated. If present, all_lang_to_po will issue a console warning, and turn it into a "before" comment line. The reworked all.lang [English] avoids this form entirely.
===Style Considerations===
====Headlines====
Currently, the "structure" lines are used for primarily for 3 levels of headlines/outlines:
1) ALL CAPS WITH UNDERLINE
=========================
2) ALL CAPS
3) Camel Case
In a few spots, a fourth style, just a sentence, is used for a group comment that needs to be visible.

Note that the first style uses two po-visible lines, and is used sparingly to denote major chapters.

Translators should be encouraged to click on structure lines, because often times, there are "Notes to Translators" associated with them.
====Comments about Source Code====
When there is editor-provided information about what source code file (e.g., cpp, gui) a particular #str_id appears in, this usually becomes the first line of a Notes to Translators. (This is in the spirit of, but different from, the specific-line annotation that xgettext provides. The latter, tagged with "#:", has a very strict syntax and is only reasonable if programmatically generated, i.e., by xgettext.)
====Comments about #str_ID References====
Within a comment, all.lang uses a leading "&" followed by the seeming text of a translatable line, as a "reference" to that #str_id, e.g.:
//& "#str_12345" "Some text here"
or
///& "#str_12345" "Some text here"
The meaning: that #str_id was already uniquely defined elsewhere in all.lang [English], and is being listed here solely to mark for the reader where it is being used again within, say, a menu's layout. (Without requiring any special processing, in the .pot/.po file, the "&" is retained within a comment line, and when viewed in poedit, becomes the first letter on the corresponding line within "Notes to Translators".)
==Generated Preamble Header==
===In the POT File===
Below is a 2026 example of a gettext-style header in the english.pot file. By gettext convention, the fields starting with "X" are customized additions, e.g., for TDM.
# TDM does not support po plural forms at this time, so this field
# (with language variants) is excluded (which may cause warnings):
# "Plural-Forms: nplurals=2; plural=(n != 1);\n"
msgid ""
msgstr ""
"Project-Id-Version: TDM Main Menu, 2.15\n"
"POT-Creation-Date: 2026-10-22T20:59:54Z\n"
"Language: en\n"
"Content-Type: text/plain; charset=UTF-8\n"
"MIME-Version: 1.0\n"
"Content-Transfer-Encoding: 8bit\n"
"Language-Team: none\n"
"X-TDM-All.Lang-Format-Input-File-Name: all.lang\n"
"X-TDM-All.Lang-Format-Input-File-Date: 2026-10-08 16:05:35\n"
"X-TDM-POT-Output-File-Name: english.pot\n"
"X-TDM-Generator: Program all_lang_to_po v. 0.13\n"
===In the PO Files===
The *.po files have the same preamble, except the Language field has the appropriate code.
==Data Conversion from all.lang [English] to english.pot==
[TO DO - THIS INFO GOES INTO TABLE CELLS]
From all.lang [English] To .pot [Note 1] Notes
"#str_whatever" "text" msgctxt "#str_whatever"
msgid "text"
msgstr ""
Same, but "text" has printf specifiers Adds line: "#, c-format" [Note 2]
Same, but "if line > maxlength chars..." msgid ""
"if line > maxlength chars, ... then "
"chunked, i.e., word wrapped" [Note 3]
//| Structure text msgctxt "##"
msgid "Structure text"
msgstr "" [Note 3][Note 4]
// Before-comment #. Before-comment [Note 5]
/// After-comment #. After-comment [Note 5]

===Notes===
[1] Following a poedit convention, each block of data associated with a given phrase is separated by a blank line in the file (but not visible in the poedit UI). Also, in the optional english.po generated by all_lang_to_po, the "msgstr" is not an empty string, but instead the same string as "msgid".

[2] Only specifier substrings actually used in TDM are searched for: %d, %i, %s, %0 .

[3] Chunking applies to msgctxt, msgid, and msgstr, and for both translatable and structure text (though the latter is not likely to need it). You can suppress chunking with an all_lang_to_po "-long" option. And change poedit to allow long lines. (Note however: poedit appears to have its own treatment of word wrap that seems idiosyncratic.) [maxLength is in theory 79 printable chars; my code is a little more conservative at moment.]

[4] Note that msgctxt is "##" (rather than all.lang's "//|" or other considered alternatives). This style choice, eventually arrived at, reflecting that:
* comments in po generally start with "#"
* in poedit, for a po-visible line, the msgctxt content is visually separated from the msgid content by a "|", so already has that hint.
* Keeping this as short as possible was visually helpful in poedit.

Also, the "Structure Text" phrase must be unique to the file (since the msgctxt "##" is not unique).

[5] Before and after cases differ in only where lines are defined in all.lang; both are emitted into .pot before the corresponding po-visible anchor line. Also, any too-line will be broken up into multiple comment lines – similar to chunking in spirit if not details.
==Data Conversion from all.lang [<language>] to <language>.po==
The process begins by copying the english.pot file, then filing in the "msgstr" fields with all the existing translations. Within the all.lang <language> section, full-line comments are ignored. The only comments retained are those that trail phrase lines. In the .po file, such a comment becomes a separate line beginning with "#<space>" instead of "//". In poedit this appears in the translator's "Comment" pane. This treatment covers the traditional translator notation of "stays the same" specified by TDM.

If the content of msgctxt, msgid, or msgstr is too long, and the -long option is not specified, "chunking" (word-wrap) will occur.
==Release Notes & Possible Further Work==
See the start of the all_lang_to_po.cpp file.
==Downloadable Files==
[This section coming soon]

Source Code

Executable

==See More==
For more about the headers, see
* https://po-file.com/blog/po-file-header-explained
* https://www.gnu.org/software/gettext/manual/html_node/Header-Entry.html

Fan Missions for The Dark Mod

Nbohr1more — Sat, 17 Oct 2026 19:17:45 GMT

Missions table

← Older revision		Revision as of 19:17, 17 October 2026
(One intermediate revision by the same user not shown)
Line 24:		Line 24:

	<!--INSERT NEW MISSIONS BELOW THIS LINE-->		<!--INSERT NEW MISSIONS BELOW THIS LINE-->

			\|-
			!align=left\|{{TDM-FM\|cloistered_repo\|Cloistered in a Repository}}
			\|Brams
			\|{{Forumlink\|https://forums.thedarkmod.com/index.php?/topic/23213-fm-mis-primeras-misiones-my-first-fan-missions-brams}}
			\|2026-10-17
			\|8.0
			\|No
			\|No
			\|No
			\|
			\|Mansion/Estate
			\|
			\|-

			\|-
			!align=left\|{{TDM-FM\|captured\|A Captured Thief}}
			\|Brams
			\|{{Forumlink\|https://forums.thedarkmod.com/index.php?/topic/23213-fm-mis-primeras-misiones-my-first-fan-missions-brams}}
			\|2026-10-17
			\|7.6
			\|No
			\|No
			\|No
			\|
			\|Mansion/Estate
			\|
			\|-

	\|-		\|-

Abandoned Works

Amadeus — Tue, 13 Oct 2026 00:13:28 GMT

Castle3

← Older revision		Revision as of 00:13, 13 October 2026
(3 intermediate revisions by the same user not shown)
Line 48:		Line 48:
	Archive name: castles_caves		Archive name: castles_caves
	<gallery mode=nolines>		<gallery mode=nolines>
			castle1_1.jpg
			castle1_2.jpg
			castle1_3.jpg
	Castle_burrockDR.png\|DR screenshot		Castle_burrockDR.png\|DR screenshot
	</gallery>		</gallery>
Line 56:		Line 59:
	Archive name: castles_caves		Archive name: castles_caves
	<gallery mode=nolines>		<gallery mode=nolines>
			castle2_1.jpg
			castle2_2.jpg
	Castle2_burock.png\|DR screenshot		Castle2_burock.png\|DR screenshot
	</gallery>		</gallery>
Line 64:		Line 69:
	Archive name: castles_caves		Archive name: castles_caves
	<gallery mode=nolines>		<gallery mode=nolines>
			castle3_1.jpg
			castle3_2.jpg
	Castle3_burock.png\|DR screenshot		Castle3_burock.png\|DR screenshot
	</gallery>		</gallery>

File:Castle1 3.jpg

Amadeus — Tue, 13 Oct 2026 00:12:06 GMT

Amadeus uploaded File:Castle1 3.jpg

New page

File:Castle1 2.jpg

Amadeus — Tue, 13 Oct 2026 00:11:45 GMT

Amadeus uploaded File:Castle1 2.jpg

New page

File:Castle1 1.jpg

Amadeus — Tue, 13 Oct 2026 00:11:28 GMT

Amadeus uploaded File:Castle1 1.jpg

New page

File:Castle2 2.jpg

Amadeus — Tue, 13 Oct 2026 00:11:01 GMT

Amadeus uploaded File:Castle2 2.jpg

New page

File:Castle2 1.jpg

Amadeus — Tue, 13 Oct 2026 00:10:41 GMT

Amadeus uploaded File:Castle2 1.jpg

New page

File:Castle3 2.jpg

Amadeus — Tue, 13 Oct 2026 00:10:16 GMT

Amadeus uploaded File:Castle3 2.jpg

New page

File:Castle3 1.jpg

Amadeus — Tue, 13 Oct 2026 00:09:47 GMT

Amadeus uploaded File:Castle3 1.jpg

New page

Abandoned Works

Amadeus — Tue, 13 Oct 2026 00:02:35 GMT

Castle3

← Older revision		Revision as of 00:02, 13 October 2026
Line 63:		Line 63:
	{{abandoned-works\|JohannesBurock\|-\|{{green\|Free for adoption}}\|Castle\|undefined\|very basic Geometry\|-}}		{{abandoned-works\|JohannesBurock\|-\|{{green\|Free for adoption}}\|Castle\|undefined\|very basic Geometry\|-}}
	Archive name: castles_caves		Archive name: castles_caves
			<gallery mode=nolines>
			Castle3_burock.png\|DR screenshot
			</gallery>
	<br />		<br />

File:Castle3 burock.png

Amadeus — Tue, 13 Oct 2026 00:01:41 GMT

Amadeus uploaded File:Castle3 burock.png

New page

Abandoned Works

Amadeus — Tue, 13 Oct 2026 00:00:35 GMT

Castle2

← Older revision		Revision as of 00:00, 13 October 2026
Line 55:		Line 55:
	{{abandoned-works\|JohannesBurock\|-\|{{green\|Free for adoption}}\|Castle\|undefined\|very basic Geometry\|-}}		{{abandoned-works\|JohannesBurock\|-\|{{green\|Free for adoption}}\|Castle\|undefined\|very basic Geometry\|-}}
	Archive name: castles_caves		Archive name: castles_caves
			<gallery mode=nolines>
			Castle2_burock.png\|DR screenshot
			</gallery>
	<br />		<br />

File:Castle2 burock.png

Amadeus — Mon, 12 Oct 2026 23:59:25 GMT

Amadeus uploaded File:Castle2 burock.png

New page

Abandoned Works

Amadeus — Mon, 12 Oct 2026 23:57:43 GMT

Castle

← Older revision		Revision as of 23:57, 12 October 2026
Line 48:		Line 48:
	Archive name: castles_caves		Archive name: castles_caves
	<gallery mode=nolines>		<gallery mode=nolines>
	Castle_burrockDR.png~~.jpg~~\|DR screenshot		Castle_burrockDR.png\|DR screenshot
	</gallery>		</gallery>
	<br />		<br />

File:Castle burrockDR.png

Amadeus — Mon, 12 Oct 2026 23:56:50 GMT

Amadeus uploaded File:Castle burrockDR.png

New page

Abandoned Works

Amadeus — Mon, 12 Oct 2026 23:55:14 GMT

Castle

@@ Line 42: / Line 42: @@
 CastleDR.jpg|DR screenshot
 </gallery>
 <br />
@@ Line 206: / Line 224: @@
 == Adopted ==
 === The White Rose Hotel ===
@@ Line 242: / Line 256: @@
 == Released ==
 === The Black Mage ===

Readables

Datiswous — Wed, 07 Oct 2026 13:41:16 GMT

added extra space after each section.

← Older revision		Revision as of 13:41, 7 October 2026
Line 25:		Line 25:
	* maps, that are also mobile and go in their own section of inventory;		* maps, that are also mobile and go in their own section of inventory;
	* stock and custom textures, that can contain text and graphics with appropriate background. Typically, these are applied to surfaces that are immobile, non-frobbable, and must be read either close-up or through a spyglass.		* stock and custom textures, that can contain text and graphics with appropriate background. Typically, these are applied to surfaces that are immobile, non-frobbable, and must be read either close-up or through a spyglass.


	== Adding Readables to your Map - From Prefabs ==		== Adding Readables to your Map - From Prefabs ==

	For a really easy way to add readables to your maps, use Fidcal's [[Readables Prefabs]].		For a really easy way to add readables to your maps, use Fidcal's [[Readables Prefabs]].


	== Adding Readables to your Map - From Model-Based Entities ==		== Adding Readables to your Map - From Model-Based Entities ==
Line 47:		Line 49:

	http://www.mindplaces.com/save/paper2.jpg		http://www.mindplaces.com/save/paper2.jpg


	== Adding Readables to your Map - from Scratch, Made from Brushes ==		== Adding Readables to your Map - from Scratch, Made from Brushes ==
Line 113:		Line 116:

	Now compile your map.		Now compile your map.


	== Test your Readable! ==		== Test your Readable! ==
Line 120:		Line 124:

	When testing readable text you can use reloadXData in the console to reload changed xdata definitions in-game. A small test map with the player start right in front of the readable and you can review changes in seconds just by pressing the up key and Enter in the console to repeat the command or even faster, bind reloadXData to a key so you just hit a key to refresh the readable.		When testing readable text you can use reloadXData in the console to reload changed xdata definitions in-game. A small test map with the player start right in front of the readable and you can review changes in seconds just by pressing the up key and Enter in the console to repeat the command or even faster, bind reloadXData to a key so you just hit a key to refresh the readable.


	==Troubleshooting==		==Troubleshooting==
Line 174:		Line 179:

	* No gui text on readable and it wouldn't display at all when frobbed yet no error in xdata. Possible reason : sheet upside down so player frobbing it from back!		* No gui text on readable and it wouldn't display at all when frobbed yet no error in xdata. Possible reason : sheet upside down so player frobbing it from back!



Line 188:		Line 194:

	It is likely all the variables you see in an xd file could be used this way so e.g., num_pages etc.		It is likely all the variables you see in an xd file could be used this way so e.g., num_pages etc.


	== Triggering Something After Being Read ==		== Triggering Something After Being Read ==
Line 208:		Line 215:

	It both cases, in the "Readable:" dialog group, select "Name of single entity" and enter the name of your readable.		It both cases, in the "Readable:" dialog group, select "Name of single entity" and enter the name of your readable.


	== Dynamically Changing Readable Contents ==		== Dynamically Changing Readable Contents ==

User:Thebigh

Thebigh — Sun, 04 Oct 2026 23:43:16 GMT

update

← Older revision		Revision as of 23:43, 4 October 2026
Line 1:		Line 1:
	Amateur DarkRadiant user.		Amateur DarkRadiant user. Pro-human, AI sceptic.

	# [[The Factory Heist (FM)\|The Factory Heist]]		# [[The Factory Heist (FM)\|The Factory Heist]]
Line 6:		Line 6:
	# [[The House of deLisle]]		# [[The House of deLisle]]
	# [[The Wizard's Treasure (FM)\|The Wizard's Treasure]]		# [[The Wizard's Treasure (FM)\|The Wizard's Treasure]]
			# [[A Collector's Errand (FM)\|A Collector's Errand]] - collab with Bikerdude

	I like to try to Supreme Ghost levels. I'll document my [[User:Thebigh/SupremeGhost\|successes and failures]].		I like to try to Supreme Ghost levels. I'll document my [[User:Thebigh/SupremeGhost\|successes and failures]].

Readables

Joebarnin — Sun, 27 Sep 2026 18:51:54 GMT

New section discussing how to dynamically change readable content

@@ Line 209: / Line 209: @@
 It both cases, in the "Readable:" dialog group, select "Name of single entity" and enter the name of your readable.
 [[Category:Tutorial]]
 {{GUI}}