FaceFX Documentation and support
Events - Analysis Events
Table of Contents
- Stress categories
When analyzing audio, FaceFX uses analysis events to signify important events in the audio. These are then translated into animation curves via the analysis actor. Below are a list of the events and the event group names:
- Anim_Begin - Placed at the start time of the animation
- Anim_End - Placed at the end time of the animation
- Anim_Entire - This event is always at time 0, and has duration scale equal to the duration of the animation.
- Anim_Clamp_Start - This is a special event that is not generated by analysis, but it is looked for in the analysis event take. If found, there will be no keys prior to the event start time. This is required when you want to start at a non-neutral position (use this carefully as starting at a non neutral position can cause snapping unless you are careful with how blendin, blendout, and persistent events are used).
- Anim_Clamp_End - This is a special event that is not generated by analysis, but it is looked for in the event take. If found, there will be no keys after the event start time. The Anim_Clamp_End is not required when you want to leave the actor in a non-neutral position because a persistent event left up will have the same effect.
Stress events represent stressed syllables potentially worthy of an eyebrow raise, head nod, or other gesture. They have a duration scale equal to the current rate of speech.
- Average_Stress - The magnitude scale of this event is the average stress over the entire file.
- Subphrase_Max_Stress - This event is the maximum stress that is found in a silence-deliminated phrase. In many case the same stress will also be in one of the below categories.
- Stress_Initial - An initial stress is the first one in the animation or the first stress after a long silence.
- Stress_Final - A final stress is the last one in the animation or the last stress before a long silence.
- Stress_Isolated - An isolated stress has no other stresses in its immediate vicinity.
- Stress_Quick - A quick stress is one that occurs immediately before another stress.
- Stress_Normal - A normal stress is one that doesn’t fit into any of the above categories.
Silence events signify silence in the animation. The duration scale of these events equals their duration in seconds.
- Silence_Initial - A silence that begins the audio.
- Silence_Short - A short silence.
- Silence_Medium - A medium silence.
- Silence_Long - A long silence.
- Silence_Final - A silence that ends the audio
Events for each phoneme are inserted into this group. The event name is the FaceFX representation of the phoneme.
- Average_Pitch - The Magnitude scale of this event is the average pitch over the entire file. Beware that this number may be large.
Rhythm events are like stress events, but their spacing is enforced (they must be at least .5 seconds apart) and they are more aggressively grouped based upon neighboring silences. Because silence is an excellent indicator of thought, these events can give insight into when the speaker begins and ends new thoughts.
- Rhythm_First - The first rhythm event. This will replace a Rhythm_Initial or Rhythm_Isolated event if it is the first in the audio. The first event can sometimes require special treatment.
- Rhythm_Initial - The first stress in a silence-deliminated utterance.
- Rhythm_Final - The last stress in a silence-deliminated utterance.
- Rhythm_Middle - All stresses that occur between a Rhythm_Initial and Rhythm_Final event.
- Rhythm_Isolated - The only stress in a silence-deliminated utterance.
- Rhythm_Last - The last rhythm event. This will replace Rhythm_Final or Rhythm_Isolated if the event is the last in the audio. The last event can sometimes require special treatment.
PhraseEvents (note the lack of the underscore), are used to break the text into shorter phrases corresponding to the punctuation in the text. There are four phrase events for commas, periods, question marks and exclamation points. The event start time corresponds to the start of the first word in the phrase, and the event duration is equal to the time in seconds until the end of the last word in the phrase.
More info about emoticon events can be found here.