analyzeMusicEmotionWithMusiCNN
Analyze audio files to detect 50 music emotion, instrument, and vocal tags, valence-arousal-tension curves, and emotional turning points for After Effects camera and character choreography.
Instructions
Analyze an audio file using the bundled MusiCNN (musicnn_mood_va.onnx, Pons & Serra 2019 multi-scale timbral+temporal CNN) + AudioLyricPoseNet (audio_lyric_pose_net.onnx). Returns 50 music emotion/instrument/vocal/structure tags, continuous Russell Circumplex Valence-Arousal-Tension trajectories, emotional turning points, and per-window 3D camera + Boy/Girl 7-joint character acting choreography.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| topK | No | Number of top mood/music tags to return per segment (default: 6) | |
| endTime | No | End time in seconds | |
| audioPath | Yes | Absolute path to the audio file (.mp3, .wav, .flac, .m4a) | |
| startTime | No | Start time in seconds (default: 0) | |
| windowSec | No | Window duration in seconds for emotion curve if no LRC is provided (default: 3.5) | |
| lyricsText | No | Optional raw LRC or plain lyrics text to fuse lyric affect with MusiCNN audio features for character pose generation | |
| lrcFilePath | No | Optional path to .lrc file so each lyric line receives its own MusiCNN emotion & AudioLyricPoseNet acting direction |