Affective Faces for Goal-Driven Dyadic Communication

Qualitative Results

Back to home       Paper       Code       Dataset      




Additional Qualitative Results.

We showcase the video outputs of our method on representative samples from the RealTalk Dataset. For each speaker, we retrieve one listener whose goal is to act socially correctly (left column), and one whose goal is to act socially incorrectly (right column). We stitch the retrieved listener video with the speaker's video for visualization. The ASR transcript of the speaker is placed below each video for convenience.


Specified goal: Act socially correct Specified goal: Act socially incorrect

New York has been your dream for a while and you've been here for quite some time so I feel bad. I already feel like heaviness about having you move as opposed to me and we've talked about it a bunch.


New York has been your dream for a while and you've been here for quite some time so I feel bad. I already feel like heaviness about having you move as opposed to me and we've talked about it a bunch.


Specified goal: Act socially correct Specified goal: Act socially incorrect

do everything to like take care of me or when I'm sick and you made me soup and stuff like that. So I mean you're like the one person I can trust with everything.


do everything to like take care of me or when I'm sick and you made me soup and stuff like that. So I mean you're like the one person I can trust with everything.


Specified goal: Act socially correct Specified goal: Act socially incorrect

because we want you to have a happy childhood, and we want you to go to school free of fear and intimidation based on the color of your skin. And we wanted to stay and fight, but you have to make a decision when it is crossed.


because we want you to have a happy childhood, and we want you to go to school free of fear and intimidation based on the color of your skin. And we wanted to stay and fight, but you have to make a decision when it is crossed.


Specified goal: Act socially correct Specified goal: Act socially incorrect

stroke, I fell over in the bathroom and then you knock the door, Mom, you okay? I said, No, Mom, I'm not okay. And then you said, open the door. I said, I can't move.


stroke, I fell over in the bathroom and then you knock the door, Mom, you okay? I said, No, Mom, I'm not okay. And then you said, open the door. I said, I can't move.


Specified goal: Act socially correct Specified goal: Act socially incorrect

Well, it's starting this visa application and getting you over here to the US so that we can start our lives together and get married. Yeah, I think it's pretty soon.


Well, it's starting this visa application and getting you over here to the US so that we can start our lives together and get married. Yeah, I think it's pretty soon.


Specified goal: Act socially correct Specified goal: Act socially incorrect

Like, I don't know. I think that you're relapsing, but being okay or going back to rehab or going to jail, to still have you in my life.


Like, I don't know. I think that you're relapsing, but being okay or going back to rehab or going to jail, to still have you in my life.


Specified goal: Act socially correct Specified goal: Act socially incorrect

You can just pick a direction and go, I'll just do that, it doesn't matter. And I would tell you that you're just the most special person I've ever met and you surprise me every day. And you literally could do anything.


You can just pick a direction and go, I'll just do that, it doesn't matter. And I would tell you that you're just the most special person I've ever met and you surprise me every day. And you literally could do anything.


Specified goal: Act socially correct Specified goal: Act socially incorrect

like being able-bodied and not having any visible disabilities and in like knowing that I had access and stuff like that but really digging deep into like


like being able-bodied and not having any visible disabilities and in like knowing that I had access and stuff like that but really digging deep into like


Specified goal: Act socially correct Specified goal: Act socially incorrect

It breaks my heart to say that I can't help them right away because you know you get a call from a family it's the first time someone has passed and they don't know what to ask they don't know what they're feeling and I can give them all this information I can walk them through the process I can give them.


It breaks my heart to say that I can't help them right away because you know you get a call from a family it's the first time someone has passed and they don't know what to ask they don't know what they're feeling and I can give them all this information I can walk them through the process I can give them.


Specified goal: Act socially correct Specified goal: Act socially incorrect

Maybe it's not love yet or whatever, but I just... It's something that I'm feeling that I haven't... It's just an intense feeling that I have, and that's what comes to my tongue when I see you, when I say goodbye to you, when I... I don't know.


Maybe it's not love yet or whatever, but I just... It's something that I'm feeling that I haven't... It's just an intense feeling that I have, and that's what comes to my tongue when I see you, when I say goodbye to you, when I... I don't know.


Specified goal: Act socially correct Specified goal: Act socially incorrect

Like I can do them justice right now, but like you were like truly one of the like most pure, like purest people I've ever met in my life. Yeah. Eww. Um yeah like.


Like I can do them justice right now, but like you were like truly one of the like most pure, like purest people I've ever met in my life. Yeah. Eww. Um yeah like.


Specified goal: Act socially correct Specified goal: Act socially incorrect

And I look at her sweet young face and I just, I see my death and I see your death and I see our death. Somewhere in there is hers too. Hopefully I'll never see it.


And I look at her sweet young face and I just, I see my death and I see your death and I see our death. Somewhere in there is hers too. Hopefully I'll never see it.


Specified goal: Act socially correct Specified goal: Act socially incorrect

and like literally drained from you because we were just so happy you know it was the winter after we lost and you know it's just we had so much hope and I was so excited to be a tita.


and like literally drained from you because we were just so happy you know it was the winter after we lost and you know it's just we had so much hope and I was so excited to be a tita.


Specified goal: Act socially correct Specified goal: Act socially incorrect

I could bring you to any of my friend groups and be like, yeah, this person is great. And that feels really good to me that I could do that. And that's something that I'm really attracted to. I also am attracted to women who are more masculine. And you have.


I could bring you to any of my friend groups and be like, yeah, this person is great. And that feels really good to me that I could do that. And that's something that I'm really attracted to. I also am attracted to women who are more masculine. And you have.


Specified goal: Act socially correct Specified goal: Act socially incorrect

Not like you're like this person. You're never like you're this person or never that. It's just, it comes from where it's like, I'm afraid you're gonna do this. And I'm like, you're afraid because somebody has once done that to you, but I've done that in return.


Not like you're like this person. You're never like you're this person or never that. It's just, it comes from where it's like, I'm afraid you're gonna do this. And I'm like, you're afraid because somebody has once done that to you, but I've done that in return.