[1048] Timeout error at updating

[exterminador]

Hi there,

 

First of all, congrats on the 3.3 release!!!! :)

 

 

I've experienced some slowness with the latest builds, not sure since which one, checking the error logs, every time Daminion Server starts I'm getting this timeout error logged. I've been able to reproduce the error on the large database I've sent you for a similar case (please let me know if you need the URL to download it again).

 

I guess setting a larger timeout would do the work for large databases, however I've tested the index creation that seems to trigger the time out (CREATE INDEX FileNameUpper on files (upper(filename));) directly in the database but it doesn't take that much, less than a minute on a db with around 1 million records.

 

2014-07-05 02:22:12,970 [9] DEBUG SQL [(null)] - UPDATE Settings SET Ver = @Version; (@Version=31)
2014-07-05 02:22:12,977 [9] DEBUG SQL [(null)] - select count(id) from users ()
2014-07-05 02:22:13,276 [9] DEBUG SQL [(null)] - DROP INDEX IF EXISTS FileNameUpper;DROP INDEX IF EXISTS RelativePathUpper;DROP INDEX IF EXISTS Id_OriginValue; ()
2014-07-05 02:22:13,279 [9] DEBUG SQL [(null)] - CREATE INDEX FileNameUpper on files (upper(filename)); ()
2014-07-05 02:22:33,332 [9] ERROR PicaJet.Daminion.Service.Utils.CheckValidateAndUpdateCommand [(null)] - Error: (1)
Npgsql.NpgsqlException:
A timeout has occured. If you were establishing a connection, increase Timeout value in ConnectionString. If you were executing a command, increase the CommandTimeout value in ConnectionString or in your NpgsqlCommand object.
  at Npgsql.NpgsqlState.ProcessBackendResponsesEnum(NpgsqlConnector context) in C:\projects\Npgsql2\src\Npgsql\NpgsqlState.cs:line 389
  at Npgsql.NpgsqlReadyState.QueryEnum(NpgsqlConnector context, NpgsqlCommand command) in C:\projects\Npgsql2\src\Npgsql\NpgsqlReadyState.cs:line 67
  at Npgsql.NpgsqlConnector.QueryEnum(NpgsqlCommand queryCommand) in C:\projects\Npgsql2\src\Npgsql\NpgsqlConnector.cs:line 301
  at Npgsql.NpgsqlCommand.GetReader(CommandBehavior cb) in C:\projects\Npgsql2\src\Npgsql\NpgsqlCommand.cs:line 609
  at Npgsql.NpgsqlCommand.ExecuteNonQuery() in C:\projects\Npgsql2\src\Npgsql\NpgsqlCommand.cs:line 512
  at PicaJet.Daminion.Service.DbCommandWrapper.ExecuteNonQuery() in c:\DaminionAuto\Code\Service.DB\DbCommandWrapper.cs:line 41
  at PicaJet.Daminion.Service.Utils.UpdateDatabaseVersion32.CreateIndexesForSpeedUpImport(DbConnection connection) in c:\DaminionAuto\Code\Service.Utils.Uni\Command\UpdateDatabaseVersion32.cs:line 41
  at PicaJet.Daminion.Service.Utils.UpdateDatabaseVersion32.DoIt(DbConnection connection) in c:\DaminionAuto\Code\Service.Utils.Uni\Command\UpdateDatabaseVersion32.cs:line 19
  at PicaJet.Daminion.Service.DbCommandExecutor.ExecWithTransaction(Execute execDelegate, IDatabaseEnvironment databaseEnvironment, DbConnection connection, Boolean processErrorHandler) in c:\DaminionAuto\Code\Service.DB\DbCommandExecutor.cs:line 70
  at PicaJet.Daminion.Service.DbCommandExecutor.ExecWithTransaction(Execute execDelegate, IDatabaseEnvironment databaseEnvironment, Boolean processErrorHandler) in c:\DaminionAuto\Code\Service.DB\DbCommandExecutor.cs:line 23
  at PicaJet.Daminion.Service.DbCommandExecutor.ExecWithTransaction(Execute execDelegate, IDatabaseEnvironment databaseEnvironment) in c:\DaminionAuto\Code\Service.DB\DbCommandExecutor.cs:line 14
  at PicaJet.Daminion.Service.Utils.UpdateDatabaseSuperclass.Process(DbConnection connection) in c:\DaminionAuto\Code\Service.Utils.Uni\Command\UpdateDatabaseSuperclass.cs:line 48
  at PicaJet.Daminion.Service.Utils.CheckValidateAndUpdateCommand.Start(DbConnection connection) in c:\DaminionAuto\Code\Service.Utils.Uni\Command\CheckValidateAndUpdateCommand.cs:line 205
  at PicaJet.Daminion.Service.Utils.DatabaseCommand.Start() in c:\DaminionAuto\Code\Service.Utils.Uni\DatabaseCommand.cs:line 109
  at PicaJet.Daminion.Service.Utils.DatabaseCommand.Process() in c:\DaminionAuto\Code\Service.Utils.Uni\DatabaseCommand.cs:line 50
2014-07-05 02:22:33,354 [9] DEBUG PicaJet.Daminion.Service.Utils.InitWatchedFoldersManagerCommand [(null)] - Start: (2)
2014-07-05 02:22:33,367 [9] DEBUG SQL [(null)] - select ID, Guid, ValuesTableName, FileValuesField, FileValuesTable, DataType, GuiType, Caption, Description, UniqueValue, AllowGroups, IsAllowChangeParent, ExcludeFromUI, PropertyInspectorTitleAlign, CanAssign, MappedInDatabaseAsMultipleValues, IsMultiplyValues, ReadOnly, MaxLevelHierarchy, Units, Multiplier, TagGroupGuid from IndexedTags ()
2014-07-05 02:22:33,376 [9] DEBUG PicaJet.Daminion.Service.Utils.LoggedMetadataService [(null)] - Start: SetCustomIndexedTagSpecifications
2014-07-05 02:22:33,384 [9] DEBUG PicaJet.Daminion.Service.Utils.LoggedMetadataService [(null)] - End: SetCustomIndexedTagSpecifications

 

Thanks!

[Murat]

Upper indexes will be created once and they allowed to drastically increase the import speed to large shared catalogs (up to 5x times). They will be created once during the database upgrade.

 

However there might be a time-out exception when retrieving large number of files due to the hidden stacks functionality that requires grouping of images into stacks (will be visible in the next update).