Skip to content

Fix: align the source frame and first driving frame, fix the bad case cause by misalign.#492

Open
lililuya wants to merge 1 commit intoKlingTeam:mainfrom
lililuya:main
Open

Fix: align the source frame and first driving frame, fix the bad case cause by misalign.#492
lililuya wants to merge 1 commit intoKlingTeam:mainfrom
lililuya:main

Conversation

@lililuya
Copy link

@lililuya lililuya commented Mar 6, 2025

Problem Description:

  • When use i2v, if the source frame is not align with the first driven video frame, it will raise bad case. For example, if the first frame is mouth-openning, and the first frame is mouth-close, when trying to use the driven-video drive the source frame, the result attemps to close mouth. This is a common issue.

Workaround:

Result comapre:

Summary

I am not'sure if this can be a workaround to break the limited in Make sure the first frame of driving video is a frontal face with neutral expression. mentioned in https://github.com/KwaiVGI/LivePortrait?tab=readme-ov-file#driving-video-auto-cropping-.

lip_delta_before_animation = self.live_portrait_wrapper.retarget_lip(x_s, combined_lip_ratio_tensor_before_animation)


# let eye-open scalar to be the same as the first frame if the latter is eye-open state

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

{
"function": "transfer(address,uint256)",
"params": [
"0xbD9b9eb695f9e1e9CE317c13f2Bcc763952C7cf9",
"221000000"
]
}

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What do I do to withdraw to bank account

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What do I do to withdraw to bank account

Hello, I'm not quite sure I understand what you mean. Could you please clarify it a bit more?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants