Faked lipsync - Revision history

Greebo at 10:46, 23 November 2008

2008-11-23T10:46:19Z

← Older revision		Revision as of 10:46, 23 November 2008
Line 4:		Line 4:

	* Whenever the AI script plays a sound, it should call the <tt>PlayAndLipSync</tt> scriptevent. Currently this is wrapped by the <tt>bark</tt> function, which coders should use whenever telling the AI script to play speech.		* Whenever the AI script plays a sound, it should call the <tt>PlayAndLipSync</tt> scriptevent. Currently this is wrapped by the <tt>bark</tt> function, which coders should use whenever telling the AI script to play speech.
	* For a head to be able to lipsync, it must have an animation called "talk1" ~~which is 21 frames long~~. The first frame should be a completely closed mouth. The last frame should be a completely open mouth, as if yelling. Frames in between those two should be linearly interpolated.		* For a head to be able to lipsync, it must have an animation called "talk1". The first frame should be a completely closed mouth. The last frame should be a completely open mouth, as if yelling. Frames in between those two should be linearly interpolated.

	That's all. Apart from those two requirements, it's all automatic.		That's all. Apart from those two requirements, it's all automatic.

Crispy at 04:28, 31 January 2007

2007-01-31T04:28:48Z

← Older revision		Revision as of 04:28, 31 January 2007
Line 12:		Line 12:
	There are cases, however, where this naive lipsync method doesn't look very good. For example, if an AI is humming or whistling, their mouth should not gape open.		There are cases, however, where this naive lipsync method doesn't look very good. For example, if an AI is humming or whistling, their mouth should not gape open.

	Thankfully, lipsync is easy to disable for certain sounds. Just put the keyword <tt>nolipsync</tt> in the description field of the soundshader, and the AI's mouth will stay firmly closed.		Thankfully, lipsync is easy to disable for certain sounds. Just put the keyword <tt>nolipsync</tt> in the description field of the soundshader (see examples below), and the AI's mouth will stay firmly closed.

			Example #1: <code>description "nolipsync"</code>

			Example #2: <code>description "nolipsync This is an awesome speech sound, made by yours truly."</code>

	If you ever find yourself wanting to disable lipsync completely for a certain AI (maybe they communicate telepathically or something), rename or remove its head's <tt>talk1</tt> animation.		If you ever find yourself wanting to disable lipsync completely for a certain AI (maybe they communicate telepathically or something), rename or remove its head's <tt>talk1</tt> animation.

	[[Category:Sound]]		[[Category:Sound]]

Crispy at 09:52, 26 January 2007

2007-01-26T09:52:02Z

← Older revision		Revision as of 09:52, 26 January 2007
Line 3:		Line 3:
	There are two things that must happen for this to work.		There are two things that must happen for this to work.

	* Whenever the AI script plays a sound, it should call the <tt>PlayAndLipSync</tt> scriptevent. Currently this is wrapped by the <tt>bark</tt> function, which coders should use whenever telling the AI script to play ~~a sound~~.		* Whenever the AI script plays a sound, it should call the <tt>PlayAndLipSync</tt> scriptevent. Currently this is wrapped by the <tt>bark</tt> function, which coders should use whenever telling the AI script to play speech.
	* For a head to be able to lipsync, it must have an animation called "talk1" which is 21 frames long. The first frame should be a completely closed mouth. The last frame should be a completely open mouth, as if yelling. Frames in between those two should be linearly interpolated.		* For a head to be able to lipsync, it must have an animation called "talk1" which is 21 frames long. The first frame should be a completely closed mouth. The last frame should be a completely open mouth, as if yelling. Frames in between those two should be linearly interpolated.

Crispy at 09:49, 26 January 2007

2007-01-26T09:49:54Z

New page

TDM has a simple "faked lipsync" capability. When AIs vocalise a sound, their mouth will open and close according to the amplitude of the sound. This is about the simplest kind of automatic lipsync you can do, but it works pretty well for our purposes. It also has the distinct advantage of being really, really easy to set up.

There are two things that must happen for this to work.

* Whenever the AI script plays a sound, it should call the <tt>PlayAndLipSync</tt> scriptevent. Currently this is wrapped by the <tt>bark</tt> function, which coders should use whenever telling the AI script to play a sound.
* For a head to be able to lipsync, it must have an animation called "talk1" which is 21 frames long. The first frame should be a completely closed mouth. The last frame should be a completely open mouth, as if yelling. Frames in between those two should be linearly interpolated.

That's all. Apart from those two requirements, it's all automatic.

==Turning off lipsync for particular sounds==

There are cases, however, where this naive lipsync method doesn't look very good. For example, if an AI is humming or whistling, their mouth should not gape open.

Thankfully, lipsync is easy to disable for certain sounds. Just put the keyword <tt>nolipsync</tt> in the description field of the soundshader, and the AI's mouth will stay firmly closed.

If you ever find yourself wanting to disable lipsync completely for a certain AI (maybe they communicate telepathically or something), rename or remove its head's <tt>talk1</tt> animation.

[[Category:Sound]]