3D Asset Library Trouble

Thread Activity
carso150Tue, Jul 08
Beautiful MisfitsTue, Jul 08
kssamTue, Jul 08
kssamTue, Jul 08
kssamTue, Jul 08
kssamTue, Jul 08
I've grown my asset library to almost unmanageable territory, causing my Daz studio to freeze my machine the moment I load in a new character. Is anyone else running a mega library, and how do you deal with space issues? My Daz 3D Library is currently sitting at 3.5 TB.
! REPORT
I'm running Daz on a 4 TB external drive. I have content from Daz, Renderosity, Renderhub, Renderotica, and most digital creations without a problem. What are the stats of your system?
REPLY
! REPORT
kssam
Karma: 6,338
Wed, Jul 02It's pretty stacked. I'm running a Ryzen 9 7900x, 128 GB DDRS Memory, and a GeForce RTX 4070 TI Super 16GB.
I'm starting to think that my asset library has grown too large for my computer to search. It's a 6TB WD Black P10, running USB 3, so a major bottleneck for searing through 3.5TB of assets.
My system runs clean, fast and cool. It only freezes when I'm trying to use Daz now.
I'm starting to think that my asset library has grown too large for my computer to search. It's a 6TB WD Black P10, running USB 3, so a major bottleneck for searing through 3.5TB of assets.
My system runs clean, fast and cool. It only freezes when I'm trying to use Daz now.
You could try rebuilding your SQL library. Or you could take the route I took a long time ago. I sorted my stuff by figure, and have separate runtimes for each, as well as one for "environments". I've done similar with my DAZ content folder. In essence I ditched the "smart" system, because it isn't very smart. Gave me nothing but headaches. So I've been using the "content directory manager". The problem with databases is, eventually they will become so bloated that they will grind any machine to a standstill. By using the "content directory manager", really you're just using an extension of good old File Explorer (or Nemo for you Linux Mint nerds).
This especially makes sense when you work outside the DAZ Studio walled garden. I have file hierarchies for Blender, Marvelous, OpenCAD, and others. Even my GIMP shared folder is non-standard. I don't rely on SQL databases for content listings, for the very reason you're having trouble with.
This especially makes sense when you work outside the DAZ Studio walled garden. I have file hierarchies for Blender, Marvelous, OpenCAD, and others. Even my GIMP shared folder is non-standard. I don't rely on SQL databases for content listings, for the very reason you're having trouble with.
REPLY
! REPORT
kssam
Karma: 6,338
Thu, Jul 03Thanks for your response. I'm currently trying to transfer my library to a new drive, and rebuild it from there. I also try to avoid the smart content... it truly is dumb.
I ordered two SSD 990 drives for faster internal storage. Hopefully this will do the trick.
I ordered two SSD 990 drives for faster internal storage. Hopefully this will do the trick.
I believe you're experiencing an issue with DAZ loading too many morphs for your character, most likely a Genesis 8 or 8.1 model. While Genesis 9 slightly improves figure loading time, it can still encounter similar slowdowns, especially when posing.
To address this, I install everything manually. After unzipping character files, I separate the morph files into one DAZ library and place the remaining files in my main library. Any package containing morphs, such as those for buttocks, breasts, or navels, etc, goes directly into the morphs folder. However, if both libraries are connected to DAZ simultaneously, you may still face the same issue. My solution is to select the characters I plan to work with, my own beloved creations, hee hee, and place them in a completely separate DAZ library that remains connected. I also organize characters by category and preference. Male characters have their own dedicated DAZ content folder, older male and female characters share another, fantasy figures based on Genesis 8 or 9, like aliens or androids, are grouped together, and characters I rarely use are stored in a separate folder I seldom connect.
To address this, I install everything manually. After unzipping character files, I separate the morph files into one DAZ library and place the remaining files in my main library. Any package containing morphs, such as those for buttocks, breasts, or navels, etc, goes directly into the morphs folder. However, if both libraries are connected to DAZ simultaneously, you may still face the same issue. My solution is to select the characters I plan to work with, my own beloved creations, hee hee, and place them in a completely separate DAZ library that remains connected. I also organize characters by category and preference. Male characters have their own dedicated DAZ content folder, older male and female characters share another, fantasy figures based on Genesis 8 or 9, like aliens or androids, are grouped together, and characters I rarely use are stored in a separate folder I seldom connect.
REPLY
! REPORT
kssam
Karma: 6,338
Thu, Jul 03It's G9 that's giving me the most issues, but it mostly freezes when I'm posing, or using the Iray preview to check lighting.
Luxe Muse
Karma: 4,087
Thu, Jul 03The new system may load figures slightly faster, but it remains cumbersome when handling poses. When checking Iray lighting, its performance depends more on material properties and geometry density than on the figure itself.
For posing, the issue persists: the more morphs you have, the slower the process becomes. This includes morphs added to your G9 data folder from clothing, such as cloth adjustments. In my case, I keep all these connected since I don’t have too many. The best way to manage this is to compartmentalize your DAZ library.
With the method I mentioned earlier, you can still access all your content, but figures and expressions in the same PA folder won’t load until you attach the specific morph folder you need. (Custom expressions with geometry deltas also count as morphs.)
Here’s another tip I didn’t mention before. I like to access all my expressions, poses, and clothing, so I keep them in a dedicated folder. Separating your library and keeping morph folders for each category or group of characters unconnected is tedious, especially when setting it up initially. It took my partner weeks to organize last time (yes, I don’t do it myself, hee hee hee). Once it’s set up, though, it’s simply a matter of adding the morph folder when needed and disconnecting it from DAZ afterward. When you purchase a new character or clothing item, download the zip file and avoid installing it through the install manager, or you’ll soon face a sluggish DAZ again.
For checking Iray lighting, G9 has slightly denser geometry, and when subdivided, it reminds the old Iray engine taht it hasn’t been updated since my children were in diapers. If I recall correctly, IRay physically stores locally a cache copy of the geometry in your hard drive and the raw textures, which means drive speed also adds to how fast it will produce the first render pass.
So for Iray, my advice is to lower the render and display subdivision level to 1 when you’re just doing a quick check. Additionally, and this can be demanding on your graphics card or CPU, verify whether the figure’s materials include displacement maps. These can double, triple, or even further increase the geometry Iray needs to produce and process. (Displacement maps physically subdivides your geometry at render time).
For posing, the issue persists: the more morphs you have, the slower the process becomes. This includes morphs added to your G9 data folder from clothing, such as cloth adjustments. In my case, I keep all these connected since I don’t have too many. The best way to manage this is to compartmentalize your DAZ library.
With the method I mentioned earlier, you can still access all your content, but figures and expressions in the same PA folder won’t load until you attach the specific morph folder you need. (Custom expressions with geometry deltas also count as morphs.)
Here’s another tip I didn’t mention before. I like to access all my expressions, poses, and clothing, so I keep them in a dedicated folder. Separating your library and keeping morph folders for each category or group of characters unconnected is tedious, especially when setting it up initially. It took my partner weeks to organize last time (yes, I don’t do it myself, hee hee hee). Once it’s set up, though, it’s simply a matter of adding the morph folder when needed and disconnecting it from DAZ afterward. When you purchase a new character or clothing item, download the zip file and avoid installing it through the install manager, or you’ll soon face a sluggish DAZ again.
For checking Iray lighting, G9 has slightly denser geometry, and when subdivided, it reminds the old Iray engine taht it hasn’t been updated since my children were in diapers. If I recall correctly, IRay physically stores locally a cache copy of the geometry in your hard drive and the raw textures, which means drive speed also adds to how fast it will produce the first render pass.
So for Iray, my advice is to lower the render and display subdivision level to 1 when you’re just doing a quick check. Additionally, and this can be demanding on your graphics card or CPU, verify whether the figure’s materials include displacement maps. These can double, triple, or even further increase the geometry Iray needs to produce and process. (Displacement maps physically subdivides your geometry at render time).
kssam
Karma: 6,338
Thu, Jul 03I'll try moving everything to a powerful SSD first, just to see if that helps. If not, I'll give your idea a try. Thanks.
Bobb
Karma: 582
Fri, Jul 04I believe that someone offers a script or plugin for Studio that disables excess morphs until needed.
Does that ring a bell with anyone?
Does that ring a bell with anyone?
Thank you for this question and the answers provided.
I'm going to be upgrading my PC in the coming months, so this is an opportunity to restructure my Daz library.
Since I use a desktop PC, my data is on an internal drive. I avoid the slowdowns of using an external drive, but that won't prevent SQL-related problems.
I'm going to be upgrading my PC in the coming months, so this is an opportunity to restructure my Daz library.
Since I use a desktop PC, my data is on an internal drive. I avoid the slowdowns of using an external drive, but that won't prevent SQL-related problems.
REPLY
! REPORT
kssam
Karma: 6,338
Thu, Jul 03I think the lesson learned here is, don't let your asset library exceed 3TB.
guy91600
Karma: 11,796
Thu, Jul 03So I still have a little time since my library is currently around 500GB!
I didn't know that DAZ used a SQL table to manage its data.
Can you explain how to rebuild your DAZ SQL library or give us a link to a tutorial?
Can you explain how to rebuild your DAZ SQL library or give us a link to a tutorial?
REPLY
! REPORT
Luxe Muse
Karma: 4,087
Thu, Jul 03It utilizes PostgreSQL to store all metadata. In the advanced settings of your Install Manager, under the Installation tab, you can find the port that Daz uses. I haven't attempted to connect to this port, and I assume the database is safeguarded by an internal password, though this is merely speculation on my part.
Here are some PostgreSQL tutorials: https://www.postgresql.org/docs/online-resources/
However, I'm uncertain whether these will be particularly helpful, as there seems to be little you can achieve by accessing the database that cannot be accomplished by editing your content library directly within Daz. Just a thought.
Here are some PostgreSQL tutorials: https://www.postgresql.org/docs/online-resources/
However, I'm uncertain whether these will be particularly helpful, as there seems to be little you can achieve by accessing the database that cannot be accomplished by editing your content library directly within Daz. Just a thought.
Does over 3TB content qualify for the hoarder label? I'm afraid to look at my storage level these days.
Still...happy rendering!

Still...happy rendering!

REPLY
! REPORT
Here's a post from the Daz subreddit that helped me clear some things up....
https://www.reddit.com/r/Daz3D/comments/13hckn9/guide_if_youre_having_cms_psql_related_problems/
He explains the system well and walks you through all the programming gobbledygook.
I've just finished re-organizing my content and have it working well now. Part of that was getting rid of all the content I've never used. It's depressing to see the piles of items I spent money on that never saw a render.
https://www.reddit.com/r/Daz3D/comments/13hckn9/guide_if_youre_having_cms_psql_related_problems/
He explains the system well and walks you through all the programming gobbledygook.
I've just finished re-organizing my content and have it working well now. Part of that was getting rid of all the content I've never used. It's depressing to see the piles of items I spent money on that never saw a render.
REPLY
! REPORT
3.5 TB?!
Oooh hell, that's a lot.
I am around 1TB right now and I've now started kicking stuff out. No more prior to Genesis 3. No more old Poser stuff.
The majority of unused data is in the Runtime>Textures folder with lots of unused old Poser texture junk.
Oooh hell, that's a lot.
I am around 1TB right now and I've now started kicking stuff out. No more prior to Genesis 3. No more old Poser stuff.
The majority of unused data is in the Runtime>Textures folder with lots of unused old Poser texture junk.
REPLY
! REPORT
kssam
Karma: 6,338
Tue, Jul 08I also scrapped all my G3 assets prior to save on space. I did notice during these issues that Daz tends to fluff the hard drive with wasted space. I migrated my assets to an internal SSD with modest compression, and everything seems to be running much smoother. I also noticed a huge difference in performance... for the better when I pulled half of the memory, dropping down to 64GB rather than 128GB. I'm not sure why, but perhaps there was just too many texture maps hitting my CPU with that much horsepower for it to process everything.
Beautiful Misfits
Karma: 15,379
Tue, Jul 08I'm almost down to 2TB after cleaning and still not done yet.
Everything older than G3 has to go, that means all old stuff from daz starting with V2 *lol* and the same goes for all rosity stuff. From Miki to Miki4 and all hair, cloth and so on.
Heaven help, I was a 3d hoarder back the days
Everything older than G3 has to go, that means all old stuff from daz starting with V2 *lol* and the same goes for all rosity stuff. From Miki to Miki4 and all hair, cloth and so on.
Heaven help, I was a 3d hoarder back the days

*chuckle* I went the other way. I still use mostly Vicky Fourpointtwoplusplus because she loads instantly, has a massive library of poses and expressions, and has a closet filling wardrobe that all the Genesis bimbos together can't come close to matching. I have a few Gen 8 characters but I rarely use them and generally convert the few new items over to Vicky. My BIG Achilles heel is architecture. I have a pile of interiors and furniture that I use constantly. Then there's all those excellent Poser props. When Poser ruled, there where so many independent artists making a wide variety of props that's never been equalled.
REPLY
! REPORT