Identity as Presence: Towards Appearance and Voice Personalized Joint Audio-Video Generation

Qin Chen, Yingjie Chen, Shilun Lin, Xing Cai, Binxin Yang, Long Zhou, Qixin Yan, Wenjing Wang, Dingming Liu, Hao Liu, Chen Li, and Jing LYU

WeChat Vision, Tencent Inc.

Identity-as-Presence supports multi-subject personalization, cross-domain personalization, spatio-temporal multi-view consistent personalization, and text-reference disentanglement for both appearance and voice.
Teaser Image

Abstract


Recent advances in video synthesis have enabled realistic integration of real individuals, driving demand for identity-aware generation. While emerging methods support joint appearance and voice injection in audio-visual models, they primarily focus on single-subject settings. Multimodal identity integration across multiple subjects remains limited, and precise alignment between visual and vocal identities in multi-subject scenarios remains underexplored. We present Identity-as-Presence, a unified framework for joint personalized audio-video generation. An automated data curation pipeline constructs identity-labeled audio-visual pairs for single- and multi-subject scenes. A unified identity injection mechanism then binds paired appearance and voice through shared cross-modal identity binding and subject-anchored captions. A multi-stage training strategy further leverages large-scale unimodal data alongside scarce paired clips to mitigate modality imbalance. Experiments show superior audio quality, video fidelity, and audio-visual consistency, with stronger multi-subject binding than the compared methods.

Method


The overall dual-tower DiT architecture and training framework. The model encodes video, audio, paired appearance/voice references, and subject-anchored captions, binds them with shared identity embeddings, and injects them via reference positioning and decoupled asymmetric attention. Training proceeds in three stages: unimodal identity, joint multimodal alignment, and spatio-temporal multi-view fine-tuning.

Framework Image


Single-subject Personalized Generation Results


Here we show the results of single-subject personalized generation. Please click on the videos to play the audio.
Prompt: This is a behind-the-scenes documentary clip. The camera starts from a corner of a foreground object and slowly pans to a medium shot framing the subject from the waist up. The scene is set in a bright pottery studio, with unfinished clay pieces, wooden shelves, and scattered tools visible in the background under even, soft lighting. In the frame, <REF_1_S>a young woman with wavy blonde hair, winged eyeliner, and pink lipstick<REF_1_E>, wearing an apron, holds a small piece of pottery with both hands. She looks relaxed, first gently turns the pottery toward the camera to show it, then smiles and says: <S>Nice touch.<E>
Prompt: This is a passionate sports drama clip, shot with a medium-close slow zoom-in approach. The lens cuts in from directly in front at eye level, focusing on the male's resolute facial contours and burly figure. The scene is set in the player preparation area of a professional indoor basketball court, with bright, professional cool-toned lighting spilling in evenly from the front. In the frame, <REF_1_S>a male with neat short black hair and resolute eyes<REF_1_E>, wearing a white 'ROCKETS' jersey with red trim, has his arms powerfully crossed over his chest. He initially looks serious and thoughtful, gazing deeply ahead, when he suddenly hears the cheers of his teammates scoring. His brows relax, revealing a confident and composed smile, and he looks firmly at the camera, saying: <S>该我们上场了。<E> The background sound includes the thumping of basketballs hitting the wooden floor, the squeaking of sneakers rubbing against the ground, and the distant whistle of a coach.
Prompt: This is a suspense crime drama clip, shot with a medium-close slow zoom-in approach. The lens cuts in from directly in front, focusing at extremely close range on the male's deep and intimidating blue pupils. The scene is set in a cool-toned secret interrogation room or industrial background space, backed against a neat white tiled wall, with harsh side lighting outlining his deep facial contours and skin texture. In the frame, <REF_1_S>a male with neat short textured hair and a cold gaze<REF_1_E>, wearing a crisp white pointed-collar shirt and a black pinstripe suit, initially leans expressionlessly against the wall, his eyes revealing a scrutinizing look. He then slowly parts his lips slightly, his gaze locked on the camera. He says in a deep and magnetic voice: <S>The game has just begun.<E>, his expression revealing an unquestionable calmness and determination. The background sound includes muffled distant metal clashing sounds and tense low-frequency suspenseful background music.
Prompt: This is a lifestyle short video clip, shot with a fixed medium-close approach, with the camera steadily focusing on the front of the character. The scene is set in a warmly lit corner of an indoor cafe, where blurred red and white decorations in the background form soft color blocks. In the frame, <REF_1_S>a young male with short brown hair that is slightly fluffy<REF_1_E>, wearing a dark blue V-neck sweater, faces the camera with bright eyes and a faint smile on his lips. He leans forward slightly and says in a brisk tone: <S>Done! This project went more smoothly than expected.<E> The background sound includes the steam sound of an espresso machine and a faint jazz melody.
Prompt: This is an urban lifestyle/workplace short drama clip, shot with a medium-close slow zoom-in approach. The lens cuts in from the front, slightly to the right, focusing at eye level on the male's eye contact and subtle expressions. The scene is set in a minimalist modern creative studio, with soft cool-toned natural light spilling in from the side, creating a premium feel. In the frame, <REF_1_S>a young male with short black textured hair and deep facial features<REF_1_E>, wearing a black branded hoodie, is casually resting his chin on his hand, with his arms folded on a transparent glass table. He is initially staring deeply diagonally downwards in thought, and sensing someone approaching, slowly raises his eyes to look at the camera. A faint, gentle smile appears on the corners of his mouth, and he says in a relaxed tone: <S>等你好久了。<E>, showing a personal charm that is both professional and approachable. The background sound includes the faint grinding sound of a coffee machine and soothing Lo-fi background music.
Prompt: This is a slice-of-life comedy short drama clip, shot with a medium-close slow zoom-in approach. The lens cuts in from the front, slightly to the right, delicately capturing the rich micro-movements of the male's facial muscles. The scene is set in a retro cafe full of life, with warm yellow light softly spilling down from above. In the frame, <REF_1_S>a middle-aged to elderly male with short textured gray hair and a forehead covered in deep wrinkles<REF_1_E>, wearing a small blue and white checkered shirt under a dark black corduroy suit jacket, is frantically patting his chest and pants pockets, his eyes instantly turning panicked before his movements freeze. He slowly raises his head, revealing an awkward yet polite wry smile on his face, and says in a lowered voice: <S>Oops, I think I forgot my wallet.<E> The background sound includes the faint clinking of cups and glasses in the distance.
Prompt: This is a political satire clip, shot with a slow dolly-in and slight eye-level frontal shot. The scene is set in a formal press briefing room, with a podium in the center and a blurred background of reporters. In the center of the frame, <REF_1_S>a man with a clean-cut look<REF_1_E>, wearing a dark suit and a white shirt, stands at the podium. He speaks with a calm and composed tone, and says: <S>I'm sure you are the expert of video generation.<E>
Prompt: This is a historical palace drama clip, shot with a slow dolly-in and slight eye-level frontal shot. The scene is set in an opulent imperial chamber... <REF_1_S>a woman with refined features, wearing a golden-red embroidered Manchu-style robe and an elaborate phoenix hairpin adorned with rubies<REF_1_E>, gently rotates a string of prayer beads in her hand, her piercing gaze fixed forward. She speaks in a calm yet icy tone, and says <S1>妹妹近日,往景仁宫跑得倒是勤快。<E1>
Prompt: This is a fashion portrait short video clip, shot with a slow zoom-in approach, starting from a close-up and gradually focusing on the character's face and shoulders, revealing the texture of the leather jacket and the details of his expression. The scene is set in a minimalist photography studio, with a soft grayish-white gradient background, and light illuminating the character from the front and upper side at a soft angle. In the frame, <REF_1_S>a young Asian male with neat short black hair that has a natural messy feel<REF_1_E>, wearing a highly glossy black leather jacket, looks directly at the camera with a firm and confident gaze, the corners of his mouth slightly raised. He slowly opens his mouth, speaking in a calm and affirmative tone: <S>就是现在,保持这个状态。<E> The background sound includes soft simulated shutter sounds and extremely faint ambient noise.
Prompt: This is an opening clip of a modern fashion-themed short film, shot with a fixed medium-close shot, slowly pulling back slightly from the character's shoulders to briefly show the character's posture in the environment. The scene is set in a minimalist photography studio or gallery, with a soft light gray wall as the background, and the lighting is mainly soft diffused light, evenly illuminating the character. In the frame, <REF_1_S>a young male with fluffy jet-black short hair and three-dimensional facial features<REF_1_E>, wearing a glossy black leather jacket over a white shirt and a black tie, relaxes his body slightly and rests his right hand lightly in front of him, looking steadily and directly at the camera. Then, the corners of his mouth turn up slightly, and he says in a clear and calm tone: <S>我们准备好了,可以开始。<E> The background sound includes very slight background music noise and an extremely light shutter sound.
Prompt: This is a traditional culture or comedy short drama clip, shot with a medium-close slow zoom-in approach. The lens cuts in from the front, focusing at eye level on the male's charming facial expressions. The scene is set in a quaintly decorated Chinese-style studio, with soft studio light shining in from the side and rear, creating a tranquil artistic atmosphere. In the frame, <REF_1_S>a middle-aged male with a signature "peach-heart" shaped short hair<REF_1_E>, wearing a dark blue silk Tang suit covered with intricate silver-white floral embroidery, is initially looking calm, seemingly thinking about something, and then, sensing the camera approaching, slowly raises his head to look forward. A signature humorous smile appears on the corners of his mouth, and he says in a melodious tone: <S>Well, that's where your skill comes in.<E>, showing an experienced and humorous master's demeanor. The background sound includes the crisp sound of a folding fan opening and the faint sound of an opera interlude in the distance.
Prompt: This is a nostalgic literary short drama clip, shot with a medium-close slow zoom-in approach. The lens cuts in from the front, slightly to the right, focusing on the melancholy and tenderness deep in the male's eyes. The scene is set in a private art studio full of nostalgic atmosphere, with warm yellow soft light spilling in from the side, creating a tranquil atmosphere. In the frame, <REF_1_S>a male with a classic black fluffy hairstyle, clear eyes revealing a faint sorrow<REF_1_E>, wearing a simple textured black crew neck knit sweater, is initially leaning against a grayish-brown wall lost in thought, seemingly immersed in some memory, and then slowly brings his gaze back to look at the camera. A gentle yet slightly lonely smile hangs on the corners of his mouth, and he says softly: <S>好久不见。<E>, showing a charming temperament that transcends time and space. The background sound includes the faint sound of distant traffic outside the window and a low, melodious vinyl record accompaniment.
Prompt: This is an interview-style clip presented as a soft medium close-up. The background shows a textured shallow depth of field, with a warm gray solid wall blurred into delicate color blocks, creating a professional and quiet atmosphere. In the frame, <REF_1_S>a young male with fair skin, freckles, clear blue eyes, and medium-length brown curly hair<REF_1_E>, wearing a tailored dark blue shirt, leans slightly forward as if eagerly sharing an important point. His right hand lightly presses near his chest, then naturally lowers with a slight nod, and he says sincerely: <S>I really believe that consistency is the key to mastering any skill over time.<E> Soft overhead light outlines his shoulders, making his focus and enthusiasm stand out against the quiet background.
Prompt: This is an urban lifestyle/workplace short drama clip, shot with a medium-close slow zoom-in approach. The lens cuts in from the front, slightly to the right, focusing at eye level on the male's eye contact and subtle expressions. The scene is set in a minimalist modern creative studio, with soft cool-toned natural light spilling in from the side, creating a premium feel. In the frame, <REF_1_S>a young male with short black textured hair and deep facial features<REF_1_E>, wearing a black branded hoodie, is casually resting his chin on his hand, with his arms folded on a transparent glass table. He is initially staring deeply diagonally downwards in thought, and sensing someone approaching, slowly raises his eyes to look at the camera. A faint, gentle smile appears on the corners of his mouth, and he says in a relaxed tone: <S>I've been waiting for you for a long time.<E>, showing a personal charm that is both professional and approachable. The background sound includes the faint grinding sound of a coffee machine and soothing Lo-fi background music.
Prompt: This is a behind-the-scenes documentary clip of a movie, shot with a slow zoom-in close-up, starting from the folds of the clothing at the character's collarbone, gradually moving upwards, and focusing on the character's facial expression. The scene is set in a quiet interview room or studio, with a soft and blurred light-colored vertical stripe background, and light softly illuminating the character from the front. In the frame, <REF_1_S>actress Anne Hathaway with long dark brown wavy hair<REF_1_E>, wearing a simple black top, gently clasps her hands in front of her chest, placed at the collar. She gazes firmly at the camera, then takes a soft breath, as if sharing an important decision, speaking in a clear and steady tone: <S>I choose to believe in this story, and also believe in myself.<E> The background sound is extremely quiet, with only extremely faint equipment noise, to highlight the solemnity of her words.
Prompt: This is a cinematic literary short drama clip, shot with a medium-close slow zoom-in approach. The lens cuts in from directly in front, focusing at eye level on the female's highly narrative facial expressions. The scene is set in a studio with a 90s retro charm, with soft natural light spilling in evenly from the front, contrasting with the dark blue background. In the frame, <REF_1_S>a female with thick black long hair<REF_1_E>, wearing a black Chinese-style top with a light green collar and white floral embroidery, is initially looking calm and profound, gazing thoughtfully into the distance, and then, feeling some kind of touch, slowly aligns her gaze with the camera. Her eyes flash with a certain clear wisdom, and she says in a steady and magnetic tone: <S>The past will eventually gone with the wind.<E>, followed by a subtle and moving smile appearing on her face. The background sound includes the faint sound of a film camera rolling and a melodious guqin background music.
Prompt: This is a historical legend/urban inspirational/fashion short drama clip, shot with a medium-close slow zoom-in approach. The lens cuts in from the front, slightly to the left, focusing at eye level on the male's tension-filled facial expressions. The scene is set in a creative studio with a postmodern industrial style, with strong cool-toned backlight spilling in from behind, outlining the character's messy and tough silhouette. In the frame, <REF_1_S>a male with black textured short hair styled diagonally upwards, and eyes revealing shrewdness and a sense of story<REF_1_E>, wearing a black stand-collar motorcycle leather jacket with detailed zippers and metal buckles on the shoulders, is initially looking down in thought, then, as if making a bold decision, slowly raises his head to face the camera directly. A signature, confident, and slightly humorous smile appears on the corners of his mouth, and he says in a firm tone: <S>This time, we're sure to win.<E> The background sound includes the subtle sound of leather jacket friction and a rhythmic heavy bass background music.
Prompt: This is a political satire clip, shot with a static, eye-level medium frontal shot. The scene is set in the Oval Office, with the American flag visible in the soft-focus background. In the center of the frame, a man with a full head of hair, wearing a dark suit and a black tie, sits at a desk. He leans forward slightly, with a confident expression, and says <S>No one know video generation better than me.<E>. Background sounds include the soft hum of air conditioning and distant office chatter.
Prompt: This is a warm and composed indoor medium close-up. Soft natural light filters through blinds onto a wooden desk, while blurred bookshelf outlines and warm lamps intertwine into a quiet atmosphere. The frame steadily holds the upper body of <REF_1_S>a young woman with bright blonde hair and neat bangs, deep blue eyes, and red lips<REF_1_E>, wearing a soft cream turtleneck sweater. As she speaks, her shoulders rise and fall gently with her breath, her hands lightly clasp and then open in front of her chest as if organizing her thoughts, and she says calmly: <S>I believe that true creativity comes from embracing the quiet moments in our busy lives.<E> Light dances on the tips of her hair, adding a quiet and firm strength to this focused moment.
Prompt: Soft morning light filters through sheer curtains into a clean, bright living room, where light-colored walls and simple furniture outlines remain clearly visible. A medium close-up steadily frames the upper body of <REF_1_S>a young woman with brown hair neatly tied back, a lightly made-up and focused face, and clear dark eyes<REF_1_E>, wearing a soft white silk shirt. As she speaks, she leans slightly forward, raises her right hand, and emphasizes with a finger gesture while her shoulders sway naturally, saying lightly and firmly: <S>I really think this new approach will change everything for the better.<E> Warm light flows across her shoulders, adding a cozy atmosphere to this intimate and sincere share.

Multi-subject Personalized Generation Results


Here we show the results of multi-subject personalized generation. Please click on the videos to play the audio.
Sub A Sub B
Sub A Sub B
Sub A Sub B
Sub A Sub B
Prompt: This is a conversation presented in a static, eye-level medium shot from a front view. The scene is set in a formal government office with soft frontal lighting and a prominent American flag on the left wall. On the left, <REF_1_S>a middle-aged man with neatly trimmed gray-black short hair, wearing a tailored navy blue suit and blue-brown striped tie<REF_1_E>, sits upright with calm authority. He speaks and says, <S1>Leadership requires vision and discipline.<E1>. On the right, <REF_2_S>a woman with platinum blonde short curly hair, wearing bright red sleeveless top<REF_2_E>, leans forward slightly with a confident smile. She speaks and says, <S2>But it also needs courage to break the mold.<E2>. Background sounds include the quiet hum of an air conditioning system and the occasional soft click of a mechanical clock.
Prompt: This is a conversation presented in a static, eye-level medium shot from a front view. The scene is set in a nostalgic film set with wooden props and soft golden light. On the left, <REF_1_S>a man with long silver hair and a gray mustache, wearing a thick brown tweed coat<REF_1_E>, writes on a chalkboard. He speaks and says, <S1>I don't need a formula to make magic.<E1>. On the right, <REF_2_S>a woman with platinum blonde short curly hair, wearing bright red sleeveless top<REF_2_E>, winks at the camera. She speaks and says, <S2>But even magic follows certain rules.<E2>. Background sounds include the scratch of chalk on slate and the distant hum of a vintage projector warming up.
Prompt: This is a conversation presented in a static, eye-level medium shot from a front view. The scene is set in a slightly dimly lit but lively event site or backstage, with a blurred background. On the left side of the screen is <REF_1_S>a young male with thin metal-rimmed glasses and a gentle, scholarly temperament, with short parted black hair<REF_1_E>, wearing a red round-neck knit shirt; on the right side is <REF_2_S>a young male with short black bangs and delicate features<REF_2_E>, wearing a white hooded sweatshirt over a gray printed T-shirt. He intimately rests his arm on the shoulder of the male on the left. They lean their heads together, showing relaxed and sincere smiles to the camera. The male on the left says gently: <S1>The atmosphere tonight is really good.<E1> The male on the right responds mischievously: <S2>With you here, of course it's lively.<E2>, showing the deep friendship between the two.
Prompt: This is a glamorous red carpet event scene, captured with a medium close-up fixed camera. The background features a blurred event backdrop and crowd, with bright, even lighting that exudes the atmosphere of a high-profile social scene. On the left is a young woman with side-parted brown wavy short hair and delicated makeup, wearing a dress with pink 3D floral shoulder straps, her eyes bright and a sweet smile on her face. On the right is a young man with voluminous brown curly hair, wearing a black suit with a black bow tie and a crisp white shirt underneath, his smile confident and radiant. They stand close together facing the media cameras, presenting their best public image. The woman whispers slightly to the side: <S1>The flashlights seem even more intense tonight than usual.<E1> The man keeps smiling and calmly responds: <S2>Don't worry, we just need to keep smiling.<E2>

Sub A Sub B
Sub A Sub B
Sub A Sub B
Sub A Sub B
Prompt: This is a noble and elegant red carpet gala film scene, shot with a medium close-up fixed lens. The lighting is soft and bright, with a blurred background of crowds and camera equipment, creating a highly publicized, star-studded atmosphere. On the left is an elegant woman with a brown low ponytail, a few loose strands gently framing her face, wearing vintage pearl earrings, her eyes deep and captivating, a subtle smile on her lips. On the right is a man with neat side-parted short hair, a handsome and composed face, wearing a black suit with a black bow tie, his gaze firm and forward. They stand shoulder to shoulder, exuding confidence and poise as they face the cameras, showcasing star power. The woman softly says: <S1>This red carpet feels longer than I imagined.<E1> The man slightly turns his head and gently replies: <S2>It's okay, as long as you're by my side.<E2>, revealing deep affection between them.
Prompt: This is a conversation presented in a static, eye-level medium shot from a front view. The scene is set in a reflective evening office with city lights glowing outside and soft ambient desk lighting. On the left, <REF_1_S>a young woman with long wavy blonde hair and exquisite, atmospheric makeup<REF_1_E>, wearing a champagne satin off-shoulder gown, leans forward with a warm smile. She speaks and says, <S1>This moment feels like the beginning of something real.<E1>. On the right, <REF_2_S>a middle-aged male with short dark brown hair and a slightly weathered face<REF_2_E>, wearing a navy blue velvet blazer with a gray silk tie, nods slowly. He speaks and says, <S2>And the best beginnings are the ones we do not plan.<E2>
Prompt: This is a conversation presented in a static, eye-level medium shot from a front view. The scene is set in a moody fashion week afterparty, with colored lights pulsing and deep house music vibrating in the air. On the left, <REF_1_S>a young male with brown slightly curly medium-length hair<REF_1_E>, wearing a sleek black bomber jacket over a white shirt and a silver chain, leans in slightly. He speaks and says, <S1>I think we just became the best part of this night.<E1>. On the right, <REF_2_S>a young male with reddish-brown curly short hair<REF_2_E>, wearing a soft white knit shirt and layered pearls, laughs quietly. He speaks and says, <S2>Then let's make it last a little longer,<E2>
Prompt: This is a conversation presented in a static, eye-level medium shot from a front view. The scene is set at a fan meet-and-greet after the event, with colorful banners and excited voices in the background. On the left, <REF_1_S>a young male with brown curly hair and a sunny and brilliant smile<REF_1_E>, wearing a black T-shirt with a logo, waves to the crowd. He speaks and says, <S1>They really love you.<E1>. On the right, <REF_2_S>a young female with dark brown center-parted long straight hair<REF_2_E>, wearing a pink denim jacket and hoop earrings, smiles warmly. She speaks and says, <S2>And they love you even more,<E2>. Background sounds include the joyful squeals of fans and the rhythmic clap of hands in the background.

Sub A Sub B
Sub A Sub B
Sub A Sub B
Sub A Sub B
Prompt: This is a tense subway tunnel scene, shot with a tracking shot from a side rail-mounted camera. The lighting is flickering and unstable, with distant train lights sweeping across their faces. The background is a damp concrete tunnel with graffiti-covered walls. On the left side of the frame is <REF_1_S>a sharp, professional woman with neat black hair tied in a bun and large silver hoop earrings<REF_1_E>, wearing a dark raincoat and gloves, her expression focused and stern. On the right is <REF_2_S>a mature man with dark short, tousled hair and light stubble<REF_2_E>, dressed in a black overcoat and scarf, his gaze deep and piercing. They move cautiously down the tracks, flashlights in hand. The woman stops and whispers: <S1>Footprints end here.<E1> The man shines his light ahead and replies: <S2>Then he's still close.<E2>
Prompt: This is a conversation presented in a static, eye-level medium shot from a front view. The scene is set in a minimalist creative studio with soft cold-toned natural light from the side. On the left, <REF_1_S>a young man with short black messy hair, wearing a black branded hoodie<REF_1_E>, rests his chin on his hand. He speaks and says, <S1>等你好久。<E1>. On the right, <REF_2_S>a woman with brown long wavy hair in a low ponytail, wearing a pure white V-neck silk top<REF_2_E>, looks up with a gentle smile. She speaks and says, <S2>现在我们终于有时间好好聊聊了。<E2>
Prompt: A reflective pause on a quiet balcony, shot with a wide-angle close-up. The background is a city skyline under soft moonlight. On the left is <REF_1_S>a young woman with side-parted brown wavy short hair and exquisite makeup<REF_1_E>, wearing a dress with pink 3D floral shoulder straps, arms crossed. On the right is <REF_2_S>a man with neat side-parted short hair, a handsome and composed face<REF_2_E>, wearing a charcoal-gray double-breasted suit with a crisp white shirt and no tie, sleeves rolled slightly. The woman on the left says: <S1>Some moments feel like they were meant to be remembered.<E1> The man on the right replies: <S2>Especially the ones we don't rush through.<E2>
Prompt: A vibrant night market encounter, lit by colorful lanterns and warm stall lights. On the left, <REF_1_S>a young Asian man in a black leather jacket<REF_1_E> holds a snack and says: <S1>热闹的地方,心反而静。<E1> On the right, <REF_2_S>a woman with golden curls in a red sleeveless top<REF_2_E> smiles and replies: <S2>因为知道,有人在等你回家。<E2>

Sub A Sub B
Sub A Sub B
Sub A Sub B
Sub 1 Sub 2 Sub 3
Prompt: This is a dialogue presented in a static, eye-level medium shot from a front view. The scene is set in a dimly lit study room with bookshelves and a desk lamp. On the right, <REF_1_S>a young woman with black hair, wearing glasses and a white button-up shirt<REF_1_E>, sips tea. She says, <S1>Write down every idea, even the weak ones.<E1>. On the left, <REF_2_S>a young man with short black hair, wearing a dark jacket<REF_2_E>, flips through a notebook, saying, <S2>Because the weak ones sometimes lead to strong ones.<E2>
Prompt: This is a classic interview or group photo close-up, shot with a medium-close fixed lens at eye level. The scene is set against a minimalist indoor background, with beige textured wallpaper appearing simple and nostalgic, and soft frontal lighting clearly illuminating the faces. On the left side of the screen, <REF_1_S>a male with a very short buzz cut and a thin, cool face<REF_1_E> is wearing a dark gray turtleneck sweater; on the right side, <REF_2_S>a female with short black hair<REF_2_E> is wearing a black top with gold embroidery on the collar, looking gentle. They stand side by side, looking natural. The male looks straight ahead with deep eyes, his expression serious and reserved, while the female tilts her head slightly with a faint smile on her lips. The male says calmly: <S1>The story has been told.<E1> The female responds gently: <S2>But the touching part has just begun.<E2>
Prompt: This is a conversation presented in a static, eye-level medium shot from a front view. The scene is set in a hybrid space blending old books and digital screens. On the left, <REF_1_S>a man with long silver hair and a gray mustache, wearing a thick brown tweed coat<REF_1_E>, holds a fountain pen. He speaks and says, <S1>Wisdom comes from reflection.<E1>. On the right, <REF_2_S>a young Asian man with neat black short hair, wearing a glossy black leather jacket<REF_2_E>, turns on a tablet. He speaks and says, <S2>And progress comes from action.<E2>
Prompt: This is a short three-person conversation in a rainy-day cafe by a glass window, shot with a fixed eye-level frontal medium framing so all three faces face the camera clearly. The background shows a wooden table, rain streaks on the window, and soft indoor lighting. First, on the left, <REF_1_S>a middle-aged white man with short curly salt-and-pepper hair and a clean-shaven face, wearing a deep teal shirt jacket over a white henley<REF_1_E>, holds a cup with both hands and calmly says: <S1>Take your time.<E1>. While he speaks, the other two listen quietly with closed lips. Then, in the center, <REF_2_S>an older white man with short gray hair, deep forehead wrinkles, and thick dark brows, wearing a plum knit sweater over a collared shirt<REF_2_E>, looks steady and assured as he says: <S2>Patience pays off.<E2>. While he speaks, the others listen quietly with closed lips. Finally, on the right, <REF_3_S>a young white woman with long blonde hair and bangs, blue eyes, red lips, and defined eyeliner, wearing a cream cardigan over a mist-blue top<REF_3_E>, softly replies: <S3>Agreed.<E3>. The three speak in turn with brief, natural, coherent dialogue.

Cross-domain Personalized Generation Results


Here we show the results of cross-domain personalized generation. Please click on the videos to play the audio.
Prompt: This is a lightly handheld evening news-desk medium close-up. The scene is set behind a small wooden news desk under cool studio lights, with a blurred teleprompter glow in the background. In the frame, <REF_1_S>an orange-and-white house cat wearing a black collar<REF_1_E> leans strongly forward, almost pushing its pink nose into the lens. Its head sways sharply left and right, and its tail sweeps a half-circle before snapping back. With sharp yellow eyes locked on camera, it lowers its voice and says: <S>Breaking news tonight: the red dot has finally escaped, and we are all safe for now.<E>
Prompt: This is a warm indoor medium close-up on a kitchen counter. Soft yellow light falls across a wooden cutting board, while blurred kitchenware outlines fill the background. In the frame, <REF_1_S>a cream-and-brown guinea pig with dark brown eyes and small round ears<REF_1_E> stands facing the camera. Its ears twitch lightly, it gives a tiny shoulder shrug, then opens its mouth and says: <S>大家好,今天我们来挑战一道简单又美味的田园沙拉。<E> A fresh vegetable scent seems to linger in the air.
Prompt: This is an outdoor courtyard medium close-up under warm sunlight. Soft green leaves tremble in the blurred background. In the frame, <REF_1_S>a red panda with a reddish-brown head and ears, a black muzzle and body, signature white facial markings, and long white whiskers<REF_1_E> sits steadily on a wooden step, facing the camera. It gives a gentle nod, keeps its deep eyes forward, and says mildly: <S>阳光正好,别赶路,来这儿偷个闲,闻闻花香再走。<E>
Prompt: This is a soft vertical medium close-up in a bright living room. Warm indoor light falls on a beige sofa blurred behind the subject. In the frame, <REF_1_S>a calico cat with white-and-brown tabby fur, pointed ears, bright emerald-green eyes, a pink nose, and long white whiskers<REF_1_E> leans almost into the lens. One front paw lifts to emphasize its words, then drops firmly as its tail sweeps quickly behind it. With a wide mouth motion, it excitedly says: <S>欢迎来到我的秘密基地,今天我们要一起探索沙发底下的奇幻世界!<E>
Prompt: This is an autumn-morning campus playground medium shot with a fixed eye-level camera. Behind the subject, ginkgo trees rustle in the wind and distant PE-class silhouettes blur softly. In the frame, <REF_1_S>a yellow square cartoon sponge with bright blue eyes, two iconic front teeth, rosy cheeks, a white shirt, red tie, brown shorts, and black shoes<REF_1_E> stands alone on the edge of the track. Only this character speaks, with voice and lip sync strictly matched. Looking at the camera with a slightly questioning tone, it says: <S>我会每天早起练习,绝不偷懒<E> The palette is warm and slightly desaturated, with a mild film-grain feel.
Prompt: This is a dusk park-bench anime medium close-up with a fixed eye-level camera. Behind the wooden bench, wind-stirred tree shadows, blurred street lamps, and an orange-pink skyline create a quiet warm mood. In the frame, <REF_1_S>a cartoon fox with orange-red fur, green eyes, a black nose, a light green shirt, and a deep purple striped tie<REF_1_E> sits alone. Its shoulders sway lightly with speech, its head tips left then returns, and one paw taps lightly on its chest. Looking at the camera playfully, it says: <S>Sunset is free, but good company still costs a smile.<E>
Prompt: This is an evening indoor eye-level medium shot inside a beige camping tent. Soft warm string lights glow along the tent frame, with a sleeping bag and camping gear faintly visible around the subject. In the frame, <REF_1_S>Labubu, a fluffy tan monster plush with long upright ears, a peach face, large black eyes, freckles, and a wide toothy grin<REF_1_E>, wearing a light-blue long-sleeve shirt under dark-blue overalls with yellow buttons, sits facing the camera. Only this character speaks, with voice and lip sync strictly matched. Looking at the camera cheerfully, it says: <S>帐篷好暖和,今晚睡这儿。<E> The palette is warm and slightly desaturated, with a cozy camping mood.
Prompt: This is an afternoon greenhouse anime medium close-up with a fixed eye-level camera. Along a glasshouse aisle, green leaves, small white flowers, and mottled sunlight create a moist fresh atmosphere. In the frame, <REF_1_S>a brown-haired girl with straight bangs tied in a ponytail, slightly flushed cheeks, and a white dress with orange-blue polka dots and a blue collar<REF_1_E> stands alone. She leans forward a little, settles back with a soft sway, glances right at the leaves, then turns front again. Looking at the camera gently, she says: <S>这些花闻起来好香,今天的阳光也刚刚好。<E>

Text-reference Disentanglement Results


Here we show the results of text-reference disentanglement. Please click on the videos to play the audio.
Reference

Init Generation

Edit: Init generation — fixed reference; expression, scene, and outfit follow the baseline prompt.
Prompt: This is an interview-style indoor talking-head clip with a stable eye-level frontal medium close-up framing the upper body. The scene is set in an indoor space with a white doorframe and glass windows under soft frontal light. In the frame, <REF_1_S>a middle-aged man with short grayish-white hair, facial wrinkles, and no beard<REF_1_E>, wearing a dark corduroy suit jacket over a blue-and-white checkered shirt, turns his body slightly toward the camera with his head facing forward. As he speaks, he raises his right hand to gesture near his chest, then lowers it naturally. He wears a mild smile with focused eyes, and says: <S>Consistency is the only way to turn good intentions into real results over time.<E>

Change Expression

Edit: Change expression only — angry face (lowered brows, flared nostrils, downturned mouth), while identity, scene, and outfit stay the same.
Prompt: This is an interview-style indoor talking-head clip with a stable eye-level frontal medium close-up framing the upper body. The scene is set in an indoor space with a white doorframe and glass windows under soft frontal light. In the frame, <REF_1_S>a middle-aged man with short grayish-white hair, facial wrinkles, and no beard<REF_1_E>, wearing a dark corduroy suit jacket over a blue-and-white checkered shirt, turns his body slightly toward the camera with his head facing forward. As he speaks, he raises his right hand to gesture near his chest, then lowers it naturally. He looks clearly angry, with lowered brows, flared nostrils, and a downturned mouth, staring ahead, and says: <S>Consistency is the only way to turn good intentions into real results over time.<E>

Change Scene

Edit: Change scene only — home study with bookshelves and warm lamps, while identity, expression, and outfit stay the same.
Prompt: This is an interview-style indoor talking-head clip with a stable eye-level frontal medium close-up framing the upper body. The scene is set in a home study with bookshelves and warm lamps under soft frontal light. In the frame, <REF_1_S>a middle-aged man with short grayish-white hair, facial wrinkles, and no beard<REF_1_E>, wearing a dark corduroy suit jacket over a blue-and-white checkered shirt, turns his body slightly toward the camera with his head facing forward. As he speaks, he raises his right hand to gesture near his chest, then lowers it naturally. He wears a mild smile with focused eyes, and says: <S>Consistency is the only way to turn good intentions into real results over time.<E>

Change Outfit

Edit: Change outfit only — light-gray casual suit over a light-blue shirt, while identity, expression, and scene stay the same.
Prompt: This is an interview-style indoor talking-head clip with a stable eye-level frontal medium close-up framing the upper body. The scene is set in an indoor space with a white doorframe and glass windows under soft frontal light. In the frame, <REF_1_S>a middle-aged man with short grayish-white hair, facial wrinkles, and no beard<REF_1_E>, wearing a light-gray casual suit over a light-blue shirt, turns his body slightly toward the camera with his head facing forward. As he speaks, he raises his right hand to gesture near his chest, then lowers it naturally. He wears a mild smile with focused eyes, and says: <S>Consistency is the only way to turn good intentions into real results over time.<E>

Spatiotemporal Multi-view Consistency Results


Here we show the results of spatiotemporal multi-view consistency. Please click on the videos to play the audio.

Spatial Packing

Reference
Prompt: A fixed medium close-up captures <REF_1_S>a young man with black curly hair, a nose ring, and dark skin<REF_1_E> standing behind a daytime glass-greenhouse planting table in casual gardening clothes. Hands on his hips, he leans slightly forward as he speaks. He first turns slowly from a frontal face to the left for a clear profile, then turns slowly to the right, and finally returns to a frontal face, saying: <S>Look at these thriving plants.<E> Soft natural light filters through the glass onto the leaves, with a slightly blurred background highlighting the subject.
ReferenceReferenceReference
Prompt: A fixed medium close-up captures <REF_1_S>a young man with black curly hair, a nose ring, and dark skin<REF_1_E> standing behind a daytime glass-greenhouse planting table in casual gardening clothes. Hands on his hips, he leans slightly forward as he speaks. He first turns slowly from a frontal face to the left for a clear profile, then turns slowly to the right, and finally returns to a frontal face, saying: <S>Look at these thriving plants.<E> Soft natural light filters through the glass onto the leaves, with a slightly blurred background highlighting the subject.
Reference
Prompt: A fixed medium close-up shows <REF_1_S>a young man with black curly hair, thin-framed glasses, and a dense full beard<REF_1_E> in a plain shirt beside a wooden kitchen counter. He raises one hand to scratch his hair while the other hangs naturally. He first turns slowly from a frontal face to the left for a clear profile, then turns slowly to the right, and finally returns to a frontal face, saying: <S>The coffee is ready now.<E> Soft everyday kitchen light falls across the scene, with blurred utensil outlines in the background.
ReferenceReferenceReference
Prompt: A fixed medium close-up shows <REF_1_S>a young man with black curly hair, thin-framed glasses, and a dense full beard<REF_1_E> in a plain shirt beside a wooden kitchen counter. He raises one hand to scratch his hair while the other hangs naturally. He first turns slowly from a frontal face to the left for a clear profile, then turns slowly to the right, and finally returns to a frontal face, saying: <S>The coffee is ready now.<E> Soft everyday kitchen light falls across the scene, with blurred utensil outlines in the background.

Temporal Expansion

Reference
Prompt: This is a fixed medium shot in a home study. <REF_1_S>A young man with short red hair and a beard<REF_1_E> sits facing the camera behind a desk piled with papers, wearing a dark-brown knit sweater. His brows are furrowed, blue eyes glare forward in strong anger, and he slams a pen onto the desk while angrily saying: <S>这种低级错误绝对不能容忍!<E> Warm yellow desk light hits his tense face, with blurred bookshelf books behind him.
ReferenceReferenceReference
Prompt: This is a fixed medium shot in a home study. <REF_1_S>A young man with short red hair and a beard<REF_1_E> sits facing the camera behind a desk piled with papers, wearing a dark-brown knit sweater. His brows are furrowed, blue eyes glare forward in strong anger, and he slams a pen onto the desk while angrily saying: <S>这种低级错误绝对不能容忍!<E> Warm yellow desk light hits his tense face, with blurred bookshelf books behind him.
Reference
Prompt: This is an outdoor medium close-up in soft overcast daylight, with a blurred gray stone wall behind the subject. In the frame, <REF_1_S>a young woman with long platinum-blonde wavy hair, a small side braid, fair skin, dark brows, and light blue eyes<REF_1_E>, wearing a deep navy-blue velvet high-neck garment with silver embroidered detailing on the shoulders. Strands of her hair blow lightly in the breeze as she starts from a calm soft smile, then breaks into a bright open-mouthed laugh with squinted eyes, saying: <S>Haha, this feels amazing!<E>
ReferenceReferenceReference
Prompt: This is an outdoor medium close-up in soft overcast daylight, with a blurred gray stone wall behind the subject. In the frame, <REF_1_S>a young woman with long platinum-blonde wavy hair, a small side braid, fair skin, dark brows, and light blue eyes<REF_1_E>, wearing a deep navy-blue velvet high-neck garment with silver embroidered detailing on the shoulders. Strands of her hair blow lightly in the breeze as she starts from a calm soft smile, then breaks into a bright open-mouthed laugh with squinted eyes, saying: <S>Haha, this feels amazing!<E>

Qualitative Comparison Results


Here we show qualitative comparisons with other methods. Please click on the videos to play the audio.

Single-subject Comparison

Reference

Ours (OVI)

Prompt: This is an interview or vlog-style video, presented as a static, eye-level medium shot from a front view. The scene is set inside a horse trailer or stable, with metal bars and dark walls in the background, under soft, even lighting. <REF_1_S>A young man with short blonde hair<REF_1_E>, wearing a dark blue polo shirt with black stripes, stands on the left side of the frame. He is petting a brown horse with a white marking on its forehead, which stands calmly on the right. The man speaks directly to the camera, gesturing with his hands as he talks, and says: <S>because I was kind of like not really sure how to feel and how I was going to feel. There was going to be a lot.<E>

Ours (LTX)

Prompt: This is an interview or vlog-style video, presented as a static, eye-level medium shot from a front view. The scene is set inside a horse trailer or stable, with metal bars and dark walls in the background, under soft, even lighting. <REF_1_S>A young man with short blonde hair<REF_1_E>, wearing a dark blue polo shirt with black stripes, stands on the left side of the frame. He is petting a brown horse with a white marking on its forehead, which stands calmly on the right. The man speaks directly to the camera, gesturing with his hands as he talks, and says: <S>because I was kind of like not really sure how to feel and how I was going to feel. There was going to be a lot.<E>

DreamID-Omni

Prompt: This is an interview or vlog-style video, presented as a static, eye-level medium shot from a front view. The scene is set inside a horse trailer or stable, with metal bars and dark walls in the background, under soft, even lighting. <REF_1_S>A young man with short blonde hair<REF_1_E>, wearing a dark blue polo shirt with black stripes, stands on the left side of the frame. He is petting a brown horse with a white marking on its forehead, which stands calmly on the right. The man speaks directly to the camera, gesturing with his hands as he talks, and says: <S>because I was kind of like not really sure how to feel and how I was going to feel. There was going to be a lot.<E>

HuMo

Prompt: This is an interview or vlog-style video, presented as a static, eye-level medium shot from a front view. The scene is set inside a horse trailer or stable, with metal bars and dark walls in the background, under soft, even lighting. <REF_1_S>A young man with short blonde hair<REF_1_E>, wearing a dark blue polo shirt with black stripes, stands on the left side of the frame. He is petting a brown horse with a white marking on its forehead, which stands calmly on the right. The man speaks directly to the camera, gesturing with his hands as he talks, and says: <S>because I was kind of like not really sure how to feel and how I was going to feel. There was going to be a lot.<E>

HunyuanCustom

Prompt: This is an interview or vlog-style video, presented as a static, eye-level medium shot from a front view. The scene is set inside a horse trailer or stable, with metal bars and dark walls in the background, under soft, even lighting. <REF_1_S>A young man with short blonde hair<REF_1_E>, wearing a dark blue polo shirt with black stripes, stands on the left side of the frame. He is petting a brown horse with a white marking on its forehead, which stands calmly on the right. The man speaks directly to the camera, gesturing with his hands as he talks, and says: <S>because I was kind of like not really sure how to feel and how I was going to feel. There was going to be a lot.<E>

ID-LoRA

Prompt: This is an interview or vlog-style video, presented as a static, eye-level medium shot from a front view. The scene is set inside a horse trailer or stable, with metal bars and dark walls in the background, under soft, even lighting. <REF_1_S>A young man with short blonde hair<REF_1_E>, wearing a dark blue polo shirt with black stripes, stands on the left side of the frame. He is petting a brown horse with a white marking on its forehead, which stands calmly on the right. The man speaks directly to the camera, gesturing with his hands as he talks, and says: <S>because I was kind of like not really sure how to feel and how I was going to feel. There was going to be a lot.<E>

OmniCustom

Prompt: This is an interview or vlog-style video, presented as a static, eye-level medium shot from a front view. The scene is set inside a horse trailer or stable, with metal bars and dark walls in the background, under soft, even lighting. <REF_1_S>A young man with short blonde hair<REF_1_E>, wearing a dark blue polo shirt with black stripes, stands on the left side of the frame. He is petting a brown horse with a white marking on its forehead, which stands calmly on the right. The man speaks directly to the camera, gesturing with his hands as he talks, and says: <S>because I was kind of like not really sure how to feel and how I was going to feel. There was going to be a lot.<E>

Phantom

Prompt: This is an interview or vlog-style video, presented as a static, eye-level medium shot from a front view. The scene is set inside a horse trailer or stable, with metal bars and dark walls in the background, under soft, even lighting. <REF_1_S>A young man with short blonde hair<REF_1_E>, wearing a dark blue polo shirt with black stripes, stands on the left side of the frame. He is petting a brown horse with a white marking on its forehead, which stands calmly on the right. The man speaks directly to the camera, gesturing with his hands as he talks, and says: <S>because I was kind of like not really sure how to feel and how I was going to feel. There was going to be a lot.<E>

UniAVGen

Prompt: This is an interview or vlog-style video, presented as a static, eye-level medium shot from a front view. The scene is set inside a horse trailer or stable, with metal bars and dark walls in the background, under soft, even lighting. <REF_1_S>A young man with short blonde hair<REF_1_E>, wearing a dark blue polo shirt with black stripes, stands on the left side of the frame. He is petting a brown horse with a white marking on its forehead, which stands calmly on the right. The man speaks directly to the camera, gesturing with his hands as he talks, and says: <S>because I was kind of like not really sure how to feel and how I was going to feel. There was going to be a lot.<E>

Multi-subject Comparison

Sub A Sub B

Ours (OVI)

Prompt: This is a conversation presented in a static, eye-level medium shot from a front view. The scene is set in front of a green chalkboard with a rustic wooden frame under soft warm lighting. On the left, <REF_1_S>an elderly man with wild silver-white hair and a thick gray mustache<REF_1_E>, wearing a brown textured blazer over a dark shirt and black tie, raises his hand and playfully points toward the woman beside him. He speaks and says: <S1>I don't need a formula to make magic.<E1> On the right, <REF_2_S>a woman with platinum-blonde short curly hair, blue eyes, and a beauty mark on her cheek<REF_2_E>, wearing a bright red sleeveless turtleneck, smiles brightly at the camera. She speaks and says: <S2>But even magic follows certain rules.<E2>

Ours (LTX)

Prompt: This is a conversation presented in a static, eye-level medium shot from a front view. The scene is set in front of a green chalkboard with a rustic wooden frame under soft warm lighting. On the left, <REF_1_S>an elderly man with wild silver-white hair and a thick gray mustache<REF_1_E>, wearing a brown textured blazer over a dark shirt and black tie, raises his hand and playfully points toward the woman beside him. He speaks and says: <S1>I don't need a formula to make magic.<E1> On the right, <REF_2_S>a woman with platinum-blonde short curly hair, blue eyes, and a beauty mark on her cheek<REF_2_E>, wearing a bright red sleeveless turtleneck, smiles brightly at the camera. She speaks and says: <S2>But even magic follows certain rules.<E2>

DreamID-Omni

Prompt: This is a conversation presented in a static, eye-level medium shot from a front view. The scene is set in front of a green chalkboard with a rustic wooden frame under soft warm lighting. On the left, <REF_1_S>an elderly man with wild silver-white hair and a thick gray mustache<REF_1_E>, wearing a brown textured blazer over a dark shirt and black tie, raises his hand and playfully points toward the woman beside him. He speaks and says: <S1>I don't need a formula to make magic.<E1> On the right, <REF_2_S>a woman with platinum-blonde short curly hair, blue eyes, and a beauty mark on her cheek<REF_2_E>, wearing a bright red sleeveless turtleneck, smiles brightly at the camera. She speaks and says: <S2>But even magic follows certain rules.<E2>

Phantom

Prompt: This is a conversation presented in a static, eye-level medium shot from a front view. The scene is set in front of a green chalkboard with a rustic wooden frame under soft warm lighting. On the left, <REF_1_S>an elderly man with wild silver-white hair and a thick gray mustache<REF_1_E>, wearing a brown textured blazer over a dark shirt and black tie, raises his hand and playfully points toward the woman beside him. He speaks and says: <S1>I don't need a formula to make magic.<E1> On the right, <REF_2_S>a woman with platinum-blonde short curly hair, blue eyes, and a beauty mark on her cheek<REF_2_E>, wearing a bright red sleeveless turtleneck, smiles brightly at the camera. She speaks and says: <S2>But even magic follows certain rules.<E2>

Citation


@article{chen2026identity,
  title={Identity as Presence: Towards Appearance and Voice Personalized Joint Audio-Video Generation},
  author={Qin Chen, Yingjie Chen, Shilun Lin, Xing Cai, Binxin Yang, Long Zhou, Qixin Yan, Wenjing Wang, Dingming Liu, Hao Liu, Chen Li, and Jing LYU},
  journal={arXiv preprint arXiv:2603.17889},
  year={2026}
}