870 Cannot import files (duplicate key exception - thumbnailstack_new_pkey)

[exterminador]

Hi,

 

I'm not being able to import new files on build 870 (tested with images and video files). Just updated from build 854. Any ideas of what may be causing this?

 

Log for a video file import (exception at the bottom):

 

2013-08-03 17:35:06,291 [sTP SmartThreadPool Thread #4] DEBUG SQL [(null)] - insert into subject (Id_MediaItem, CreationDatetime, Title, Description, RightsUsageTerms, Comments, DocSubject, DocManager) values (@MediaItemId, @CreationDatetime, @Title, @Description, @RightsUsageTerms, @Comments, @DocSubject, @DocManager) (@MediaItemId=978851, @CreationDatetime=28/07/2013 04:19:15 p. m., @Title=, @Description=, @RightsUsageTerms=, @Comments=, @DocSubject=, @DocManager=)
2013-08-03 17:35:06,291 [sTP SmartThreadPool Thread #4] DEBUG SQL [(null)] - insert into music (Id_MediaItem, MusicTitle, MusicAlbum, MusicConductor, MusicTrack) values (@MediaItemId, @MusicTitle, @MusicAlbum, @MusicConductor, @MusicTrack) (@MediaItemId=978851, @MusicTitle=, @MusicAlbum=, @MusicConductor=, @MusicTrack=0)
2013-08-03 17:35:06,291 [sTP SmartThreadPool Thread #4] DEBUG SQL [(null)] - select f.RelativePath, f.FileName from MediaItems mi left join Files f on mi.ID_File = f.ID where mi.ID = @MediaItemId (@MediaItemId=978851)
2013-08-03 17:35:06,291 [sTP SmartThreadPool Thread #4] DEBUG SQL [(null)] - select Id, RelativeDataPath, Dataoffset3, Length3 from ThumbnailStack where MediaItemId = @Id and RevisionId is null (@Id=978851)
2013-08-03 17:35:09,260 [sTP SmartThreadPool Thread #4] DEBUG SQL [(null)] - select ImageOrientation from image where ID_MediaItem = @Id (@Id=978851)
2013-08-03 17:35:09,260 [sTP SmartThreadPool Thread #4] DEBUG SQL [(null)] - select f.Id, f.ModifiedTime from Files f left join MediaItems m on f.ID = m.ID_File where m.ID = @Id (@Id=978851)
2013-08-03 17:35:09,260 [sTP SmartThreadPool Thread #4] DEBUG PicaJet.Daminion.Service.Utils.LoggedMetadataService [(null)] - Start: GetPreviewAsJPEGStream - \\htpc\MusicVideos$\Los Imposibles - Rock your world.mp4
2013-08-03 17:35:09,683 [sTP SmartThreadPool Thread #4] DEBUG PicaJet.Daminion.Service.Utils.LoggedMetadataService [(null)] - End: GetPreviewAsJPEGStream - \\htpc\MusicVideos$\Los Imposibles - Rock your world.mp4
2013-08-03 17:35:09,699 [sTP SmartThreadPool Thread #4] DEBUG SQL [(null)] - insert into ThumbnailStack (MediaItemId, RevisionId, RelativeDataPath, Dataoffset1, Length1, Dataoffset2, Length2, Dataoffset3, Length3) values (@MediaItemId, @RevisionId, @RelativeDataPath, @Dataoffset1, @Length1, @Dataoffset2, @Length2, @Dataoffset3, @Length3); select lastval(); (@MediaItemId=978851, @RevisionId=, @RelativeDataPath=2\ba\2ba3646b-9c8e-454c-a90d-a24a09c1c7d4.dat, @Dataoffset1=0, @Length1=3508, @Dataoffset2=3508, @Length2=9401, @Dataoffset3=12909, @Length3=28090)
2013-08-03 17:35:09,699 [sTP SmartThreadPool Thread #4] DEBUG PicaJet.Daminion.Service.Utils.LoggedMetadataService [(null)] - Start: GetMediaFormat - \\htpc\MusicVideos$\Los Imposibles - Rock your world.mp4
2013-08-03 17:35:09,699 [sTP SmartThreadPool Thread #4] DEBUG PicaJet.Daminion.Service.Utils.LoggedMetadataService [(null)] - End: GetMediaFormat - \\htpc\MusicVideos$\Los Imposibles - Rock your world.mp4
2013-08-03 17:35:09,699 [sTP SmartThreadPool Thread #4] DEBUG PicaJet.Daminion.Service.Utils.LoggedMetadataService [(null)] - Start: GetDefaultMediaFormatThumbnail - PicaJet.Daminion.MediaProcessing.MediaFormat
2013-08-03 17:35:09,699 [sTP SmartThreadPool Thread #4] DEBUG PicaJet.Daminion.Service.Utils.LoggedMetadataService [(null)] - End: GetDefaultMediaFormatThumbnail - PicaJet.Daminion.MediaProcessing.MediaFormat
2013-08-03 17:35:09,699 [sTP SmartThreadPool Thread #4] WARN  PicaJet.Daminion.Service.Utils.GetThumbnailServiceCommandV2 [(null)] - Npgsql.NpgsqlException:
llave duplicada viola restricción de unicidad «thumbnailstack_new_pkey»
Severity: ERROR
Code: 23505
  at Npgsql.NpgsqlState.<ProcessBackendResponses_Ver_3>d__a.MoveNext() in C:\projects\Npgsql2\src\Npgsql\NpgsqlState.cs:line 839
  at Npgsql.ForwardsOnlyDataReader.GetNextResponseObject() in C:\projects\Npgsql2\src\Npgsql\NpgsqlDataReader.cs:line 1163
  at Npgsql.ForwardsOnlyDataReader.GetNextRowDescription() in C:\projects\Npgsql2\src\Npgsql\NpgsqlDataReader.cs:line 1181
  at Npgsql.ForwardsOnlyDataReader.NextResult() in C:\projects\Npgsql2\src\Npgsql\NpgsqlDataReader.cs:line 1367
  at Npgsql.ForwardsOnlyDataReader..ctor(IEnumerable`1 dataEnumeration, CommandBehavior behavior, NpgsqlCommand command, NotificationThreadBlock threadBlock, Boolean synchOnReadError) in C:\projects\Npgsql2\src\Npgsql\NpgsqlDataReader.cs:line 1030
  at Npgsql.NpgsqlCommand.GetReader(CommandBehavior cb) in C:\projects\Npgsql2\src\Npgsql\NpgsqlCommand.cs:line 591
  at Npgsql.NpgsqlCommand.ExecuteScalar() in C:\projects\Npgsql2\src\Npgsql\NpgsqlCommand.cs:line 666
  at PicaJet.Daminion.Service.DbCommandWrapper.ExecuteScalar() in c:\DaminionAuto\Code\Service.DB\DbCommandWrapper.cs:line 59
  at PicaJet.Daminion.Service.Utils.Mapper.ThumbnailStackMapper.InsertExtended(IDatabaseEnvironment databaseEnvironment, IDbCommand command, ThumbnailStack insertItem) in c:\DaminionAuto\Code\Service.Utils.Uni\Mapper\ThumbnailStackMapper.cs:line 177
  at PicaJet.Daminion.Service.Utils.GetThumbnailServiceCommandV2.GenerateCacheFileClass.GenerateCacheFileAndSaveStack(DbConnection connection) in c:\DaminionAuto\Code\Service.Utils.Uni\Command\GetThumbnailServiceCommandV2.cs:line 348
  at PicaJet.Daminion.Service.Utils.GetThumbnailServiceCommandV2.Treat(DbConnection connection) in c:\DaminionAuto\Code\Service.Utils.Uni\Command\GetThumbnailServiceCommandV2.cs:line 97
2013-08-03 17:35:09,699 [sTP SmartThreadPool Thread #4] DEBUG PicaJet.Daminion.Service.Utils.ImportMediaItemFromFileCommand [(null)] - End: (3207)
2013-08-03 17:35:09,699 [19] DEBUG PicaJet.Daminion.Service.Utils.DirectImportFilesCommand [(null)] - End: (3206) - fe890e6e-a525-48ec-8668-f048abee8a43 - 1

[Murat]

We need a dump of the catalog with importing problem. Could you please share it?

[exterminador]

We need a dump of the catalog with importing problem. Could you please share it?

 

 

Hi Murat,

 

It seems I found what was happening. It seems that when upgrading to 870, the thumbnailstack_new_id_seq sequence was initialized with the field last_value = 1, which was making the import process to try to use the sequence id 2 (which is already used) when importing. Just updated the last_value field for the thumbnailstack_new_id_seq to the latest id on the thumbnailstack_new table and it is working fine now :)

 

I'm attaching some screenshots in case it helps.

 

Regards

[petrovich]

 

It seems I found what was happening. It seems that when upgrading to 870, the thumbnailstack_new_id_seq sequence was initialized with the field last_value = 1, which was making the import process to try to use the sequence id 2 (which is already used) when importing. Just updated the last_value field for the thumbnailstack_new_id_seq to the latest id on the thumbnailstack_new table and it is working fine now :)

 

I'm attaching some screenshots in case it helps.

 

 

 

Thanks for pointing to this issue! The bug-fix will be available in the next minor Daminion update.