3D Models
3D Print Models
3D Scans
Animation & MoCap
Textures
Materials
Skin Textures
2D Game Assets
Sound Effects
Brushes & Tools
Reference Photos
Stock Images
HDR Images
3ds Max
Maya
Blender
Unreal Engine
Unity
ZBrush
Cinema 4D
LightWave
Marmoset
SketchUp
FBX
DAE
DXF
GLBNew way to get easy & fast lip sync animations - DAZ (CLOSED)
609
Hi all,
i would like to inform you about an easy and fast possibility to create very good lip sync animations with facial expressions, headmoves and eyeblinks. It's a mix from your DAZ character and a third party ai software named d-id. The result is more than amazing.
First lets look at what I am talking about:
In my video example you will find many options how to use the d-id lip sync. Also you will see at the end some horrible examples from DAZ Anlip2. The quality of the generated d-id videos is set to low preview quality - imagine how it looks in 4k....
Videoexamples >>
To get a lip sync with this result inside DAZ is at this moment not possible. The only software on the market that supports text to speech is Anylip2 (https://www.daz3d.com/anilip-2) it works inside DAZ ok but you will have trouble to get it out to the post production. The result is horror. I tried out nearly everything no result was like d-id.
Lets have a look at the way I have made it:
1. Step
a) DAZ - Create your character and make a good lightning szene
b) I recommend to set the backdrop to "greenscreen"
c) Bring your character into a nice pose face the camera look into the camera
d) IMPORTANT! No expressions, no smile, etc. mouth closed, eyes open
e) Render your DAZ character in 4k - 16:9 as one still image .png or jpg
2. Step
a) Use your image editing software of your choice like photoshop or Luminar or what ever you like. Just give the face a bit more depth and correct the lightning.
b) If the render result is ok just go to step 3
3. Step
a) Go to https://studio.d-id.com/ and create your first character online (just upload your still DAZ image) no costs!
4. Step
a) Go to https://replicastudios.com/ or https://play.ht/ (my favorite outstanding voices) after signing in (no costs!) you will find a dashboard click in the middle of the dashboard on "ultra realistic voices" and look for a voice of your choice.
b) Script your text to speech and generate the sound file
c) Download the soundfile
d) I recommend to run the soundfile through an compressor and/or equalizer for example Audio Director or Vegas. The result is much better and really amazing.
5. Step
a) Go back to https://studio.d-id.com/ and click on the right side on "upload your voice audio".
b) Generate the video
c) Download the video file (its preview quality for free with watermark ok for testing)
6. Step
a) Go to your Postproduction software of your choice for example Power Director or Vegas or Premiere Pro.
b) Import the downloaded video file
c) Chromakey the background and set a background of your choice.
d) Render Video
e) Done and have fun!
On the first view it sounds a bit complicated. But its not. After playing around with this and after 2 or 3 tests you will handle it in minutes. This is not a solution for real animations, but very useful for short instruction videos or something like that.
AND Yes, you can do very easy and nice lip sync animations in iClone - also with text to speech - but you can not get the lip sync back to DAZ. The render result inside iClone is totaly different to the results of DAZ Studio with iray. AND oh yes - you need a really big wallet for iClone.
<< For all vendors >>
I think it's a stepstone in selling if the character you are selling is talking with an ultra realistic voice. Its made fast and easy and the result is amazing.
i would like to inform you about an easy and fast possibility to create very good lip sync animations with facial expressions, headmoves and eyeblinks. It's a mix from your DAZ character and a third party ai software named d-id. The result is more than amazing.
First lets look at what I am talking about:
In my video example you will find many options how to use the d-id lip sync. Also you will see at the end some horrible examples from DAZ Anlip2. The quality of the generated d-id videos is set to low preview quality - imagine how it looks in 4k....
Videoexamples >>
To get a lip sync with this result inside DAZ is at this moment not possible. The only software on the market that supports text to speech is Anylip2 (https://www.daz3d.com/anilip-2) it works inside DAZ ok but you will have trouble to get it out to the post production. The result is horror. I tried out nearly everything no result was like d-id.
Lets have a look at the way I have made it:
1. Step
a) DAZ - Create your character and make a good lightning szene
b) I recommend to set the backdrop to "greenscreen"
c) Bring your character into a nice pose face the camera look into the camera
d) IMPORTANT! No expressions, no smile, etc. mouth closed, eyes open
e) Render your DAZ character in 4k - 16:9 as one still image .png or jpg
2. Step
a) Use your image editing software of your choice like photoshop or Luminar or what ever you like. Just give the face a bit more depth and correct the lightning.
b) If the render result is ok just go to step 3
3. Step
a) Go to https://studio.d-id.com/ and create your first character online (just upload your still DAZ image) no costs!
4. Step
a) Go to https://replicastudios.com/ or https://play.ht/ (my favorite outstanding voices) after signing in (no costs!) you will find a dashboard click in the middle of the dashboard on "ultra realistic voices" and look for a voice of your choice.
b) Script your text to speech and generate the sound file
c) Download the soundfile
d) I recommend to run the soundfile through an compressor and/or equalizer for example Audio Director or Vegas. The result is much better and really amazing.
5. Step
a) Go back to https://studio.d-id.com/ and click on the right side on "upload your voice audio".
b) Generate the video
c) Download the video file (its preview quality for free with watermark ok for testing)
6. Step
a) Go to your Postproduction software of your choice for example Power Director or Vegas or Premiere Pro.
b) Import the downloaded video file
c) Chromakey the background and set a background of your choice.
d) Render Video
e) Done and have fun!
On the first view it sounds a bit complicated. But its not. After playing around with this and after 2 or 3 tests you will handle it in minutes. This is not a solution for real animations, but very useful for short instruction videos or something like that.
AND Yes, you can do very easy and nice lip sync animations in iClone - also with text to speech - but you can not get the lip sync back to DAZ. The render result inside iClone is totaly different to the results of DAZ Studio with iray. AND oh yes - you need a really big wallet for iClone.
<< For all vendors >>
I think it's a stepstone in selling if the character you are selling is talking with an ultra realistic voice. Its made fast and easy and the result is amazing.
! REPORT
Thank you for this information which allows to animate all versions of Genesis
! REPORT
ipixel
Karma: 1,721
Sat, May 27, 2023it allows you to animate a picture. If the render is made in Blender or Maya or unreal or where ever, you can animate it.
