1019 Exception during upgrade

[exterminador]

Hi there,

 

First of all, congrats on the new build! :)

 

I tried upgrading from build 994 to 1019 but it seems the upgrade process over the database didn't finished as expected. It seems to be a timeout during the upgrade process. However, I'm not sure I should be getting these errors as the note in the forum post for build 1019 says:

 

Note: This Daminion version contains some time-consuming database update functions. The upgrade process might take up to 20-40 mins for large databases (>500k and more files). So please be patient when you will see the below message:

 

But I don't get to the waiting part (Daminion Server shows immediately the green "Running" message after starting and I get the errors in the log). Any ideas?

 

PD. Murat, in case you try to reproduce, this is the error log from the database I shared with you in OneDrive.

 

2014-06-01 00:46:34,115 [8] DEBUG PicaJet.Daminion.Service.WCF.CatalogServiceHost [(null)] - host_Opened
2014-06-01 00:46:34,155 [8] DEBUG PicaJet.Daminion.Service.WCF.FileTransferServiceHost [(null)] - host_Opening
2014-06-01 00:46:34,165 [8] DEBUG PicaJet.Daminion.Service.WCF.FileTransferServiceHost [(null)] - host_Opened
2014-06-01 00:46:34,170 [8] DEBUG Service.WCF.ServerService.DaminionService [(null)] - Done creating hosting: 06/01/2014 00:46:34
2014-06-01 00:46:42,400 [9] DEBUG PicaJet.Daminion.Service.Utils.UniversalCatalogService [(null)] - Program version: Daminion Server 3.3.0 (build 1019) 
2014-06-01 00:46:42,455 [9] DEBUG PicaJet.Daminion.Service.Utils.CheckValidateAndUpdateCommand [(null)] - Start: (1)
2014-06-01 00:46:42,475 [9] DEBUG SQL [(null)] - select Ver from Settings ()
2014-06-01 00:46:42,550 [9] DEBUG SQL [(null)] - select NewRelative from Settings ()
2014-06-01 00:46:42,575 [9] DEBUG SQL [(null)] - UPDATE IndexedTags SET isallowchangeparent = @False WHERE GUID = @GUID (@GUID=e6521660-2859-459f-8f59-6c68e6814fe9, @False=False)
2014-06-01 00:46:42,755 [9] DEBUG SQL [(null)] - select 1 from information_schema.tables where table_schema = 'public' and Upper(table_name) = 'KEYWORDS_SYNONYM' ()
2014-06-01 00:46:43,176 [9] DEBUG SQL [(null)] - CREATE TABLE keywords_synonym (
Id bigserial NOT NULL PRIMARY KEY,
Value TEXT NOT NULL,
ValueId bigint NOT NULL,
IsPrimary boolean NOT NULL,
lng TEXT);

()
2014-06-01 00:46:43,751 [9] DEBUG SQL [(null)] - INSERT INTO keywords_synonym (Value, ValueId, IsPrimary) SELECT Value, Id, @True FROM keywords_table; (@True=True)
2014-06-01 00:46:43,916 [9] DEBUG SQL [(null)] - UPDATE SystemCollection_File SET Id_OriginValue = Id_MediaItem; ()
2014-06-01 00:46:56,809 [9] DEBUG SQL [(null)] - UPDATE Settings SET Ver = @Version; (@Version=25)
2014-06-01 00:46:57,024 [9] DEBUG SQL [(null)] - UPDATE Settings SET Ver = @Version; (@Version=26)
2014-06-01 00:46:57,029 [9] DEBUG SQL [(null)] - select ID, Guid, ValuesTableName, FileValuesField, FileValuesTable, DataType, GuiType, Caption, Description, UniqueValue, AllowGroups, IsAllowChangeParent, ExcludeFromUI, CanAssign, MappedInDatabaseAsMultipleValues, IsMultiplyValues, ReadOnly, MaxLevelHierarchy, Units, Multiplier, TagGroupGuid from IndexedTags WHERE GUID = @GUID (@GUID=09bba98e-7112-42fe-9ed1-3624a881d160)
2014-06-01 00:46:57,039 [9] DEBUG SQL [(null)] - select id from smarttag_table where Value = 'Full dublicates' ()
2014-06-01 00:46:57,154 [9] DEBUG SQL [(null)] - SELECT max(SortOrder), (select Id from SmartTag_Table where Value = @SmartTagValue) FROM SmartTag_Table (@SmartTagValue=Full dublicates)
2014-06-01 00:46:57,279 [9] DEBUG SQL [(null)] - insert into SmartTag_Table (Value, ParentValueId, IndexedTagId, SortOrder, Count, IsGroup, HasChilds, IsDefaultValue, HierarchyLevel, SerializedQuery) values (@Value, @ParentValueId, @IndexedTagId, @SortOrder, @Count, @IsGroup, @HasChilds, @IsDefaultValue, @HierarchyLevel, @SerializedQuery); select lastval(); (@Value=Full dublicates, @ParentValueId=0, @IndexedTagId=33, @SortOrder=4, @Count=0, @IsGroup=False, @HasChilds=False, @IsDefaultValue=True, @HierarchyLevel=0, @SerializedQuery=<?xml version="1.0" encoding="utf-16"?>
<Transpor...)
2014-06-01 00:46:57,359 [9] DEBUG SQL [(null)] - SELECT Id FROM IndexedTags WHERE GUID = @GUID (@GUID=9a208aa0-0be0-4843-bb76-6a2265a44dcc)
2014-06-01 00:46:57,364 [9] DEBUG SQL [(null)] - insert into IndexedTags (Guid, ValuesTableName, FileValuesField, FileValuesTable, DataType, GuiType, Caption, Description, UniqueValue, AllowGroups, IsAllowChangeParent, ExcludeFromUI, PropertyInspectorTitleAlign, CanAssign, MappedInDatabaseAsMultipleValues, IsMultiplyValues, ReadOnly, MaxLevelHierarchy, Units, Multiplier, TagGroupGuid) values (@Guid, @ValuesTableName, @FileValuesField, @FileValuesTable, @DataType, @GuiType, @Caption, @Description, @UniqueValue, @AllowGroups, @IsAllowChangeParent, @ExcludeFromUI, @PropertyInspectorTitleAlign, @CanAssign, @MappedInDatabaseAsMultipleValues, @IsMultiplyValues, @ReadOnly, @MaxLevelHierarchy, @Units, @Multiplier, @TagGroupGuid); select lastval(); (@Guid=9a208aa0-0be0-4843-bb76-6a2265a44dcc, @ValuesTableName=Scene_Table, @FileValuesField=ID_Value, @FileValuesTable=Scene_File, @DataType=System.String, @GuiType=Text, @Caption=Scene, @Description=, @UniqueValue=False, @AllowGroups=True, @IsAllowChangeParent=False, @ExcludeFromUI=False, @PropertyInspectorTitleAlign=Left, @CanAssign=True, @MappedInDatabaseAsMultipleValues=True, @IsMultiplyValues=True, @ReadOnly=False, @MaxLevelHierarchy=0, @Units=, @Multiplier=1, @TagGroupGuid=b92efc4c-e804-4995-9762-75ecd6862193)
2014-06-01 00:46:57,479 [9] DEBUG SQL [(null)] - CREATE TABLE Scene_Table (
ID bigserial NOT NULL PRIMARY KEY,
Id_Icon bigint,
Hidded boolean,
Value text,
HelperValue text,
Id_View bigint,
HasChilds boolean,
ParentValueId bigint,
IndexedTagId bigint NOT NULL,
IsGroup boolean,
SortOrder integer,
IsDefaultValue boolean NOT NULL,
HierarchyLevel integer);

()
2014-06-01 00:46:57,830 [9] DEBUG SQL [(null)] - insert into Scene_Table (Value, HelperValue, ParentValueId, IndexedTagId, SortOrder, IsGroup, HasChilds, IsDefaultValue, HierarchyLevel, Id_Icon) values (@Value, @HelperValue, @ParentValueId, @IndexedTagId, @SortOrder, @IsGroup, @HasChilds, @IsDefaultValue, @HierarchyLevel, @Id_Icon); select lastval();; select lastval(); (@Value=, @HelperValue=, @ParentValueId=0, @IndexedTagId=39, @SortOrder=0, @IsGroup=False, @HasChilds=False, @IsDefaultValue=True, @HierarchyLevel=0, @Id_Icon=)
2014-06-01 00:46:57,835 [9] DEBUG SQL [(null)] - CREATE TABLE Scene_File (
ID_MediaItem bigserial NOT NULL,
ID_Value bigserial NOT NULL,
ID_OriginValue bigint,	PRIMARY KEY (
ID_MediaItem, ID_Value));

()
2014-06-01 00:46:58,140 [9] DEBUG SQL [(null)] - INSERT INTO Scene_File (ID_MediaItem, ID_Value) SELECT ID, @DefaultValueId FROM MediaItems; (@DefaultValueId=1)
2014-06-01 00:47:18,258 [9] ERROR PicaJet.Daminion.Service.Utils.CheckValidateAndUpdateCommand [(null)] - Error: (1)
Npgsql.NpgsqlException:
A timeout has occured. If you were establishing a connection, increase Timeout value in ConnectionString. If you were executing a command, increase the CommandTimeout value in ConnectionString or in your NpgsqlCommand object.
  at Npgsql.NpgsqlState.ProcessBackendResponsesEnum(NpgsqlConnector context) in C:\projects\Npgsql2\src\Npgsql\NpgsqlState.cs:line 389
  at Npgsql.NpgsqlReadyState.QueryEnum(NpgsqlConnector context, NpgsqlCommand command) in C:\projects\Npgsql2\src\Npgsql\NpgsqlReadyState.cs:line 67
  at Npgsql.NpgsqlConnector.QueryEnum(NpgsqlCommand queryCommand) in C:\projects\Npgsql2\src\Npgsql\NpgsqlConnector.cs:line 301
  at Npgsql.NpgsqlCommand.GetReader(CommandBehavior cb) in C:\projects\Npgsql2\src\Npgsql\NpgsqlCommand.cs:line 609
  at Npgsql.NpgsqlCommand.ExecuteNonQuery() in C:\projects\Npgsql2\src\Npgsql\NpgsqlCommand.cs:line 512
  at PicaJet.Daminion.Service.DbCommandWrapper.ExecuteNonQuery() in c:\DaminionAuto\Code\Service.DB\DbCommandWrapper.cs:line 41
  at PicaJet.Daminion.Service.Utils.UpdateDatabaseSuperclass.CreateFileValuesTable(DbConnection connection, IndexedTagInfo newTag, Int64 defaultValueId) in c:\DaminionAuto\Code\Service.Utils.Uni\Command\UpdateDatabaseSuperclass.cs:line 228
  at PicaJet.Daminion.Service.Utils.UpdateDatabaseSuperclass.CreateIndexedTag(Guid guid, DbConnection connection) in c:\DaminionAuto\Code\Service.Utils.Uni\Command\UpdateDatabaseSuperclass.cs:line 163
  at PicaJet.Daminion.Service.Utils.UpdateDatabaseVersion27.CreateSceneIndexedTag(DbConnection connection) in c:\DaminionAuto\Code\Service.Utils.Uni\Command\UpdateDatabaseVersion27.cs:line 44
  at PicaJet.Daminion.Service.Utils.UpdateDatabaseVersion27.DoIt(DbConnection connection) in c:\DaminionAuto\Code\Service.Utils.Uni\Command\UpdateDatabaseVersion27.cs:line 23
  at PicaJet.Daminion.Service.DbCommandExecutor.ExecWithTransaction(Execute execDelegate, IDatabaseEnvironment databaseEnvironment, DbConnection connection, Boolean processErrorHandler) in c:\DaminionAuto\Code\Service.DB\DbCommandExecutor.cs:line 70
  at PicaJet.Daminion.Service.DbCommandExecutor.ExecWithTransaction(Execute execDelegate, IDatabaseEnvironment databaseEnvironment, Boolean processErrorHandler) in c:\DaminionAuto\Code\Service.DB\DbCommandExecutor.cs:line 23
  at PicaJet.Daminion.Service.DbCommandExecutor.ExecWithTransaction(Execute execDelegate, IDatabaseEnvironment databaseEnvironment) in c:\DaminionAuto\Code\Service.DB\DbCommandExecutor.cs:line 14
  at PicaJet.Daminion.Service.Utils.UpdateDatabaseSuperclass.Process(DbConnection connection) in c:\DaminionAuto\Code\Service.Utils.Uni\Command\UpdateDatabaseSuperclass.cs:line 48
  at PicaJet.Daminion.Service.Utils.CheckValidateAndUpdateCommand.Start(DbConnection connection) in c:\DaminionAuto\Code\Service.Utils.Uni\Command\CheckValidateAndUpdateCommand.cs:line 209
  at PicaJet.Daminion.Service.Utils.DatabaseCommand.Start() in c:\DaminionAuto\Code\Service.Utils.Uni\DatabaseCommand.cs:line 109
  at PicaJet.Daminion.Service.Utils.DatabaseCommand.Process() in c:\DaminionAuto\Code\Service.Utils.Uni\DatabaseCommand.cs:line 50
2014-06-01 00:47:18,278 [9] DEBUG PicaJet.Daminion.Service.Utils.InitWatchedFoldersManagerCommand [(null)] - Start: (2)
2014-06-01 00:47:18,283 [9] DEBUG SQL [(null)] - select ID, Guid, ValuesTableName, FileValuesField, FileValuesTable, DataType, GuiType, Caption, Description, UniqueValue, AllowGroups, IsAllowChangeParent, ExcludeFromUI, PropertyInspectorTitleAlign, CanAssign, MappedInDatabaseAsMultipleValues, IsMultiplyValues, ReadOnly, MaxLevelHierarchy, Units, Multiplier, TagGroupGuid from IndexedTags ()
2014-06-01 00:47:18,293 [9] DEBUG PicaJet.Daminion.Service.Utils.LoggedMetadataService [(null)] - Start: SetCustomIndexedTagSpecifications
2014-06-01 00:47:18,303 [9] DEBUG PicaJet.Daminion.Service.Utils.LoggedMetadataService [(null)] - End: SetCustomIndexedTagSpecifications
2014-06-01 00:47:18,313 [9] DEBUG SQL [(null)] - SELECT Id FROM Folder_Table WHERE Id_Icon = @IconId (@IconId=1)
2014-06-01 00:47:18,408 [9] DEBUG PicaJet.Daminion.Service.Utils.InitWatchedFoldersManagerCommand [(null)] - End: (2)

 

 

Regards!

[Murat]

Thanks for the detailed report. It seems a time-out issue due to the large database size... Could you please check the new 1021 build.

[exterminador]

Thanks for the detailed report. It seems a time-out issue due to the large database size... Could you please check the new 1021 build.

 

Thanks a lot Murat!

 

It seems it is working now, the update is still in progress, I will leave it running and let you know how it goes tomorrow.

 

I noticed a small detail, although the update is still running (I can tell because of the Daminion and db logs), the Daminion Server window showed the Daminion Server Status as "Running" almost immediatelly after starting. Would be nice if it stayed at "Start pending" while it is updating the database.

 

 

Thanks again!

[exterminador]

Hi there!

 

Update finished without any issues, I'm using build 1021 now!

 

Thanks!

[Murat]

the Daminion Server window showed the Daminion Server Status as "Running" almost immediatelly after starting. Would be nice if it stayed at "Start pending" while it is updating the database.

 

This indicator shows the status of the Daminion Server service. The update process is performed by the launched service, after it was started. You will see that the upgrade process is active when try to open the catalog.

 

BTW the latest build is 1022 with a few bug fixes.

[exterminador]

This indicator shows the status of the Daminion Server service. The update process is performed by the launched service, after it was started. You will see that the upgrade process is active when try to open the catalog.

 

BTW the latest build is 1022 with a few bug fixes.

 

That's great! I really didn't launch Daminion Client until I saw(based on the logs) that the update process was finished, but that's great to know for next time :)

 

Thanks!