Anima Avatar (Project Anima)

Generates high-quality interactive videos where Shutiao speaks the text with appropriate expressions, gestures, and voice.

Capabilities

• True Voice: Uses Fish Audio API for realistic speech synthesis.
• Dynamic Sprites: Auto-selects from a library of 30+ sprites (Happy, Angry, Shy, Think, Action) based on emotion tags.
• Smart Director: Handles parallel rendering, audio-sync, and video composition (FFmpeg).
• Pro Delivery: Uploads as native stream to Feishu for direct playback (with correct duration).

Structure

• src/director.js: The core engine. Generates frames (sharp + SVG), audio (Fish Audio), and video (FFmpeg).
• src/send_video_pro.js: Delivery script. Handles transcoding, duration calculation, and Feishu upload.
• src/batch_generator.js: Batch sprite generator. Uses Gemini image generation to produce sprite variants.
• assets/sprites/: The sprite library (1920x1080 PNG files).
• assets/production_plan.csv: The asset registry (25 sprites).
• assets/manifest.json: Sprite metadata for reference.
• output/: Generated videos.

IMPORTANT: Sprites Not Included

ClawHub only distributes text files. The sprite PNG images are not included in the published package.

After installing, follow the steps below in order to prepare your sprites before first use.

All image generation steps use Gemini API (Nano Banana) as the AI image generator. It works by "reference image + text prompt" — you give it an existing image and a text description of what to change, and it returns a new image with the changes applied. This is how both the base sprite (character + background fusion) and all expression variants are created.

Step 1: Prepare your character image

You need a standalone character illustration (transparent background PNG recommended).

• This is your character's "identity" — it defines the look for all sprites.
• Resolution: at least 1920x1080. Full-body is best.
• Example: a full-body anime character PNG with transparent background.

Save it somewhere accessible (e.g. avatars/my_character.png).

Step 2: Prepare your background image

You need a background scene for the character to stand in.

• This is the environment that appears behind the character in every video frame.
• Resolution: at least 1920x1080.
• Example: a cherry blossom garden, a classroom, a city street.

Save it at: assets/backgrounds/ (e.g. assets/backgrounds/cherry_blossom_bg.png).

Step 3: Fuse character + background into base sprite

This step uses Gemini (Nano Banana) image generation to merge your character onto the background. The AI sees both images and creates a natural-looking composite — this is NOT a simple overlay/paste, but an AI-generated fusion that handles lighting, shadows, and blending.

How to do it: