Volker Posted August 1, 2022 Report Share Posted August 1, 2022 Hello, for several weeks I can observe a performance degradation. When I select an item in the tree view it takes up to 10 or 15 minutes until all thumbnails are displayed. This happens both on the server itself and on separate client PCs. Is there a way to identify the bottleneck? Here is an example showing the situation about three minutes after selecting an item on the left hand side: Best regards, Volker Quote Link to comment Share on other sites More sharing options...
pgrondin Posted August 6, 2022 Report Share Posted August 6, 2022 I am not an expert here, but I have a few questions: Did the problem appear after an update, either to Daminion, or the program associated with the dng files? Have you checked your directory structure, and your catalog definition in the sever? It appears that the server does not know where the thumbnails are. If you select that item again later, does it now know the thumbnails, or does it have to generate them all over again? Do you have multiple catalogs? If so, do they all behave the same? Do all your file types exhibit this problem? Quote Link to comment Share on other sites More sharing options...
Volker Posted August 6, 2022 Author Report Share Posted August 6, 2022 I am not sure whether the issue first appeared after a certain update. Meanwhile I assume that there's a problem with the thumbnails and therefore currently I recreate them all. It is a long lasting procedure, but it seems to be the solution to this problem. Quote Link to comment Share on other sites More sharing options...
Volker Posted August 12, 2022 Author Report Share Posted August 12, 2022 Recreating the thumbnails is a time consuming task. It takes almost 24 hours to recreate 10,000 of them. Quote Link to comment Share on other sites More sharing options...
Volker Posted August 15, 2022 Author Report Share Posted August 15, 2022 The problem here is that I can start the recreation of the thumbnails for about just 10,000 images. Whenever I select more images the connection to the server gets lost after some time. Is there a way to recreate all thumbnails in a safe and stable way? Quote Link to comment Share on other sites More sharing options...
Daria Kotilainen Posted August 15, 2022 Report Share Posted August 15, 2022 Hi Volker, Please let me know your Daminion version - the screenshot does not show it. Also, please let me know your PostgreSQL version and check if the thumbnailsStorePath= parameter is set in your catalog.config file located here: C:\Program Files (x86)\Daminion Software\Daminion Server. If so, where is it pointing? Kind regards, Daria Quote Link to comment Share on other sites More sharing options...
Volker Posted August 16, 2022 Author Report Share Posted August 16, 2022 Hi Daria, I am on Daminion 7.6.0.2693 and Postgres 12.6. Best regards, Volker Quote Link to comment Share on other sites More sharing options...
Daria Kotilainen Posted August 16, 2022 Report Share Posted August 16, 2022 Hi Volker, Please check if the thumbnail path is added to the configuration file. Slow thumbnail generation is sometimes attributed to the incorrect/missing thumb store path written in the config file Also, if you still have free upgrades, please install a newer version of Daminion. Daria Quote Link to comment Share on other sites More sharing options...
Volker Posted August 16, 2022 Author Report Share Posted August 16, 2022 Hi Daria, one stupid question: where is the configuration file located? Until now I've configured the thumbnail path in the administrator panel. Best regards, Volker Quote Link to comment Share on other sites More sharing options...
Volker Posted August 17, 2022 Author Report Share Posted August 17, 2022 Hi Daria, after upgrading to the latest version I get the error message Best regards, Volker Quote Link to comment Share on other sites More sharing options...
Daria Kotilainen Posted August 17, 2022 Report Share Posted August 17, 2022 Hi Volker, Please upgrade the client application manually. The catalog.config file located here: C:\Program Files (x86)\Daminion Software\Daminion Server The parameter that you need to check is "thumbnailsStorePath=" Kind regards, Daria Quote Link to comment Share on other sites More sharing options...
Volker Posted August 17, 2022 Author Report Share Posted August 17, 2022 Hi Daria, thank you very much! The manual upgrade of the client did the job 🙂 The contents of the catalog.config is <ServerCatalogs disableCheckUpdates="false" initialFileDefaultFolder="" defaultMediaStorePath="" defaultThumbnailsStorePath="C:\ProgramData\Daminion Software\Daminion Server\Thumbnails" checkdirsonstart="true" facerecognition="true" enableVideoPreview="false" videoConvertPriority="low" disableautodect="false" securitylinks="false"> <Catalogs> <clear /> <Catalog catalogName="NetCatalog" webUserCreatorId="" fileShareUser="" fileSharePassword="" name="Bilder" description="Bilder" blobStoreTemp="" mediaStorePath="C:\Users\Public\Documents\Daminion Server Files " dropFolder="" folderTemplate="" filenameTemplate="" thumbnailsStorePath="" videoStorePath="C:\ProgramData\Daminion Software\Daminion Server\Video" videoStorePathNew="" databaseServer="localhost" securitylinks="true" isNeedToApplyMetadata="false" restapi="false" ftsLoader="true" ailabels="false" faces="true" ailabelslang="en" webaccess="true" active="true" viewerCanDownloadOriginal="true" disableVideoPreview="false" databasePort="5432" transportPort="8082" restApiPort="0" fileTransportPort="8084" databaseUser="postgres" databasePassword="postgres" /> <Catalog catalogName="NetCatalog2" webUserCreatorId="" fileShareUser="" fileSharePassword="" name="Musik" description="" blobStoreTemp="" mediaStorePath="C:\DaminionData" dropFolder="" folderTemplate="" filenameTemplate="" thumbnailsStorePath="" videoStorePath="C:\ProgramData\Daminion Software\Daminion Server\Video" videoStorePathNew="" databaseServer="localhost" securitylinks="true" isNeedToApplyMetadata="false" restapi="true" ftsLoader="true" ailabels="false" faces="true" ailabelslang="en" webaccess="false" active="false" viewerCanDownloadOriginal="true" disableVideoPreview="false" databasePort="5432" transportPort="8083" restApiPort="8086" fileTransportPort="8085" databaseUser="postgres" databasePassword="postgres" /> </Catalogs> </ServerCatalogs> The empty paths are obviously wrong. Which path should I enter here? Best regards, Volker Quote Link to comment Share on other sites More sharing options...
Daria Kotilainen Posted August 17, 2022 Report Share Posted August 17, 2022 Hi Volker, thumbnailsStorePath="" are empty for both catalogs, meaning that the thumbs are not cached and are generated on the fly to be stored in a temp folder. This is why it takes so much time to generate them and load them. Please open Notepad as Administrator, open the file "catalogs.config" and set the thumbnailsStorePath="" for both catalogs (e.g. thumbnailsStorePath="D:\Sample\Thumbs\NetCatalog") Kind regards, Daria Quote Link to comment Share on other sites More sharing options...
Volker Posted August 17, 2022 Author Report Share Posted August 17, 2022 Hi Daria, should the path entered match this path? Best regards, Volker Quote Link to comment Share on other sites More sharing options...
Daria Kotilainen Posted August 17, 2022 Report Share Posted August 17, 2022 No, this is a temp storage and this is why the thumbs are not permanently cached You can only edit the thumbs path in the admin panel and save settings. Then restart Daminion server and check if the path was written into the config file Daria Quote Link to comment Share on other sites More sharing options...
Volker Posted August 17, 2022 Author Report Share Posted August 17, 2022 I have set the path to "C:\DaminionData\Thumbs\NetCatalog" and I can see that thumbnails are being created there. Now all thumbnails should be created. Quote Link to comment Share on other sites More sharing options...
Daria Kotilainen Posted August 17, 2022 Report Share Posted August 17, 2022 This is correct. Keep an eye on that folder, it will be growing as the cache will be static now Daria Quote Link to comment Share on other sites More sharing options...
Volker Posted August 18, 2022 Author Report Share Posted August 18, 2022 Good morning, Daria, which is the best way to recreate all thumbnails? As mentioned before it is a very time consuming process and I have to do it step by step. Whenever I select more than about 20,000 images and tell Daminion to recreate the thumbnails the connection to the server gets lost and I have to start again: Best regards, Volker Quote Link to comment Share on other sites More sharing options...
Daria Kotilainen Posted August 18, 2022 Report Share Posted August 18, 2022 Hi Volker, what are your sysstem specs? Do you see memory or cpu high load when you select more than 20k? Daria Quote Link to comment Share on other sites More sharing options...
Volker Posted August 18, 2022 Author Report Share Posted August 18, 2022 Hi Daria, I've selected now about 100,000 images and can observe a medium load on the system: Volker Quote Link to comment Share on other sites More sharing options...
Daria Kotilainen Posted August 18, 2022 Report Share Posted August 18, 2022 Hi Volker, you can try selectign 10k as before. It should be faster now as there is a static preview folder Daria Quote Link to comment Share on other sites More sharing options...
Volker Posted August 19, 2022 Author Report Share Posted August 19, 2022 Hi Daria, I switched back to batches of about 10k to 20k. Unfortunately I cannot see any increase of speed. It would be helpful if I could find all those images that do not have a thumbnail yet, because then I could avoid recreating the thumbnails several times for some of the images. Volker Quote Link to comment Share on other sites More sharing options...
Daria Kotilainen Posted August 19, 2022 Report Share Posted August 19, 2022 There is no such a search. You can proceed with the update thumbs operation or the thumbs will be created and cached when you scroll down to the file that does not have thumbs yet Quote Link to comment Share on other sites More sharing options...
Volker Posted August 22, 2022 Author Report Share Posted August 22, 2022 Hi Daria, I am near despair. The connection to the server (running on the same machine) keeps crashing. Meanwhile it even crashes before I can start the recreation of the thumbnails: The next issue is the low speed. When I succeed in starting the recreation it takes more than one hour for 1,000 thumbnails. Volker Quote Link to comment Share on other sites More sharing options...
Daria Kotilainen Posted August 23, 2022 Report Share Posted August 23, 2022 Hi Volker, is it possible to schedule a TeamViewer session? If yes, please drop me an email Daria Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.