ATDB-LDV

Task: 387302 (regular)

id (api)	387302
type	regular
slurm jobs (api)	jobs for task 387302 {'finished': 85}
priority	100
status	finished
workflow	29 - aggregated_compress_pipeline
inputs outputs metrics Quality
filter	lc8_019_np-comp
source location (inputs)
target location (processing)	srm.grid.sara.nl
project	lc8_019
activity (API) + status	626514, finished
specification (API)	-
creationTime	2025-02-24 10:20:48
purge_policy	yes
cleanup_policy	defining
resume	True
is_summary	False
stage_request_id	762374
dataproducts	81
size_to_process	99.8 GB
size_processed	27.7 GB
total_processing_time	15196
quality	moderate
calculated qualities	{'per_task': ['poor']}
remarks	None

Log Entries

service	step	status	timestamp	cpu_cycles	wall_clock_time	log
ARCHIVER	Success	finished	03-03-2025, 07:00:50	None	74401
ARCHIVER	cleaning	finishing	03-03-2025, 06:59:43	None	74334
ARCHIVER	Success	archived	03-03-2025, 06:59:42	None	74333
ARCHIVER	ingested	archiving	03-03-2025, 06:59:06	None	74297
ARCHIVER	restarting	archiving	03-03-2025, 06:58:53	None	74284
ARCHIVER	update_final_archiving	archived_failed	02-28-2025, 16:42:26	None	22897	XML-RPC Service; an Exception was raised in UpdateUriState; 'No FileObject found for StorageTicketResource(2DBC6BBC99BD4978E063164A17AC5E0A) with URI srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lofar/ops/projects/lc8_019/1449600/L1449600_SB179
ARCHIVER	update_final_archiving	archived_failed	02-28-2025, 16:42:25	None	22896	XML-RPC Service; an Exception was raised in UpdateUriState; 'No FileObject found for StorageTicketResource(2DBBF8EF899F4976E063164A17ACFC61) with URI srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lofar/ops/projects/lc8_019/1449600/L1449600_SB178
ARCHIVER	update_final_archiving	archived_failed	02-28-2025, 16:42:24	None	22895	XML-RPC Service; an Exception was raised in UpdateUriState; 'No FileObject found for StorageTicketResource(2DBC6BBC99B44978E063164A17AC5E0A) with URI srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lofar/ops/projects/lc8_019/1449600/L1449600_SB177
ARCHIVER	update_final_archiving	archived_failed	02-28-2025, 16:42:23	None	22894	XML-RPC Service; an Exception was raised in UpdateUriState; 'No FileObject found for StorageTicketResource(2DBBF8EF89944976E063164A17ACFC61) with URI srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lofar/ops/projects/lc8_019/1449600/L1449600_SB176
ARCHIVER	update_final_archiving	archived_failed	02-28-2025, 16:42:22	None	22893	XML-RPC Service; an Exception was raised in UpdateUriState; 'No FileObject found for StorageTicketResource(2DBBF8EF89924976E063164A17ACFC61) with URI srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lofar/ops/projects/lc8_019/1449600/L1449600_SB175
ARCHIVER	update_final_archiving	archived_failed	02-28-2025, 16:42:21	None	22892	XML-RPC Service; an Exception was raised in UpdateUriState; 'No FileObject found for StorageTicketResource(2DBC6BBC99B04978E063164A17AC5E0A) with URI srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lofar/ops/projects/lc8_019/1449600/L1449600_SB174
ARCHIVER	update_final_archiving	archived_failed	02-28-2025, 16:42:20	None	22891	XML-RPC Service; an Exception was raised in UpdateUriState; 'No FileObject found for StorageTicketResource(2DBC6BBC99AF4978E063164A17AC5E0A) with URI srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lofar/ops/projects/lc8_019/1449600/L1449600_SB173
ARCHIVER	update_final_archiving	archived_failed	02-28-2025, 16:42:19	None	22890	XML-RPC Service; an Exception was raised in UpdateUriState; 'No FileObject found for StorageTicketResource(2DBC6BBC99AB4978E063164A17AC5E0A) with URI srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lofar/ops/projects/lc8_019/1449600/L1449600_SB172
ARCHIVER	update_final_archiving	archived_failed	02-28-2025, 16:42:18	None	22889	XML-RPC Service; an Exception was raised in UpdateUriState; 'No FileObject found for StorageTicketResource(2DBBF8EF898F4976E063164A17ACFC61) with URI srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lofar/ops/projects/lc8_019/1449600/L1449600_SB171
ARCHIVER	update_final_archiving	archived_failed	02-28-2025, 16:42:17	None	22888	XML-RPC Service; an Exception was raised in UpdateUriState; 'No FileObject found for StorageTicketResource(2DBC6BBC99A94978E063164A17AC5E0A) with URI srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lofar/ops/projects/lc8_019/1449600/L1449600_SB170
ARCHIVER	update_final_archiving	archived_failed	02-28-2025, 16:42:16	None	22887	XML-RPC Service; an Exception was raised in UpdateUriState; 'No FileObject found for StorageTicketResource(2DBC6BBC99A74978E063164A17AC5E0A) with URI srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lofar/ops/projects/lc8_019/1449600/L1449600_SB169
ARCHIVER	update_final_archiving	archived_failed	02-28-2025, 16:42:14	None	22885	XML-RPC Service; an Exception was raised in UpdateUriState; 'No FileObject found for StorageTicketResource(2DBC6BBC99A54978E063164A17AC5E0A) with URI srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lofar/ops/projects/lc8_019/1449600/L1449600_SB168
ARCHIVER	update_final_archiving	archived_failed	02-28-2025, 16:42:13	None	22884	XML-RPC Service; an Exception was raised in UpdateUriState; 'No FileObject found for StorageTicketResource(2DBBF8EF898D4976E063164A17ACFC61) with URI srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lofar/ops/projects/lc8_019/1449600/L1449600_SB167
ARCHIVER	update_final_archiving	archived_failed	02-28-2025, 16:42:12	None	22883	XML-RPC Service; an Exception was raised in UpdateUriState; 'No FileObject found for StorageTicketResource(2DBBF8EF898B4976E063164A17ACFC61) with URI srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lofar/ops/projects/lc8_019/1449600/L1449600_SB166
ARCHIVER	update_final_archiving	archived_failed	02-28-2025, 16:42:11	None	22882	XML-RPC Service; an Exception was raised in UpdateUriState; 'No FileObject found for StorageTicketResource(2DBBF8EF89894976E063164A17ACFC61) with URI srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lofar/ops/projects/lc8_019/1449600/L1449600_SB165
ARCHIVER	update_final_archiving	archived_failed	02-28-2025, 16:42:10	None	22881	XML-RPC Service; an Exception was raised in UpdateUriState; 'No FileObject found for StorageTicketResource(2DBBF8EF89874976E063164A17ACFC61) with URI srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lofar/ops/projects/lc8_019/1449600/L1449600_SB164
ARCHIVER	update_final_archiving	archived_failed	02-28-2025, 16:42:09	None	22880	XML-RPC Service; an Exception was raised in UpdateUriState; 'No FileObject found for StorageTicketResource(2DBC6BBC99A34978E063164A17AC5E0A) with URI srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lofar/ops/projects/lc8_019/1449600/L1449600_SB163
ARCHIVER	update_final_archiving	archived_failed	02-28-2025, 16:42:08	None	22879	XML-RPC Service; an Exception was raised in UpdateUriState; 'No FileObject found for StorageTicketResource(2DBBF8EF89854976E063164A17ACFC61) with URI srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lofar/ops/projects/lc8_019/1449600/L1449600_SB162
ARCHIVER	submitting	archiving	02-28-2025, 16:36:59	None	22570
ARCHIVER	submitting	archiving	02-28-2025, 16:36:58	None	22569
ARCHIVER	submitting	archiving	02-28-2025, 16:36:56	None	22567
ARCHIVER	submitting	archiving	02-28-2025, 16:36:55	None	22566
ARCHIVER	submitting	archiving	02-28-2025, 16:36:54	None	22565
ARCHIVER	submitting	archiving	02-28-2025, 16:36:53	None	22564
ARCHIVER	submitting	archiving	02-28-2025, 16:36:52	None	22563
ARCHIVER	submitting	archiving	02-28-2025, 16:36:51	None	22562
ARCHIVER	submitting	archiving	02-28-2025, 16:36:50	None	22561
ARCHIVER	submitting	archiving	02-28-2025, 16:36:48	None	22559
ARCHIVER	submitting	archiving	02-28-2025, 16:36:47	None	22558
ARCHIVER	submitting	archiving	02-28-2025, 16:36:46	None	22557
ARCHIVER	submitting	archiving	02-28-2025, 16:36:45	None	22556
ARCHIVER	submitting	archiving	02-28-2025, 16:36:44	None	22555
ARCHIVER	submitting	archiving	02-28-2025, 16:36:43	None	22554
ARCHIVER	submitting	archiving	02-28-2025, 16:36:41	None	22552
ARCHIVER	submitting	archiving	02-28-2025, 16:36:40	None	22551
ARCHIVER	submitting	archiving	02-28-2025, 16:36:39	None	22550
ARCHIVER	submitting	archiving	02-28-2025, 16:36:38	None	22549
ARCHIVER	submitting	archiving	02-28-2025, 16:36:37	None	22548
ARCHIVER	submitting	archiving	02-28-2025, 16:36:36	None	22547
ARCHIVER	submitting	archiving	02-28-2025, 16:36:34	None	22545
ARCHIVER	submitting	archiving	02-28-2025, 16:36:33	None	22544
ARCHIVER	submitting	archiving	02-28-2025, 16:36:31	None	22542
ARCHIVER	submitting	archiving	02-28-2025, 16:36:30	None	22541
ARCHIVER	submitting	archiving	02-28-2025, 16:36:29	None	22540
ARCHIVER	submitting	archiving	02-28-2025, 16:36:27	None	22538
ARCHIVER	submitting	archiving	02-28-2025, 16:36:26	None	22537
ARCHIVER	submitting	archiving	02-28-2025, 16:36:25	None	22536
ARCHIVER	submitting	archiving	02-28-2025, 16:36:24	None	22535
ARCHIVER	submitting	archiving	02-28-2025, 16:36:22	None	22533
ARCHIVER	submitting	archiving	02-28-2025, 16:36:21	None	22532
ARCHIVER	submitting	archiving	02-28-2025, 16:36:20	None	22531
ARCHIVER	submitting	archiving	02-28-2025, 16:36:18	None	22529
ARCHIVER	submitting	archiving	02-28-2025, 16:36:17	None	22528
ARCHIVER	submitting	archiving	02-28-2025, 16:36:16	None	22527
ARCHIVER	submitting	archiving	02-28-2025, 16:36:14	None	22525
ARCHIVER	submitting	archiving	02-28-2025, 16:36:13	None	22524
ARCHIVER	submitting	archiving	02-28-2025, 16:36:11	None	22522
ARCHIVER	submitting	archiving	02-28-2025, 16:36:10	None	22521
ARCHIVER	submitting	archiving	02-28-2025, 16:36:08	None	22519
ARCHIVER	submitting	archiving	02-28-2025, 16:36:07	None	22518
ARCHIVER	submitting	archiving	02-28-2025, 16:36:06	None	22517
ARCHIVER	submitting	archiving	02-28-2025, 16:36:05	None	22516
ARCHIVER	submitting	archiving	02-28-2025, 16:36:04	None	22515
ARCHIVER	submitting	archiving	02-28-2025, 16:36:03	None	22514
ARCHIVER	submitting	archiving	02-28-2025, 16:36:02	None	22513
ARCHIVER	submitting	archiving	02-28-2025, 16:36:00	None	22511
ARCHIVER	submitting	archiving	02-28-2025, 16:35:59	None	22510
ARCHIVER	submitting	archiving	02-28-2025, 16:35:58	None	22509
ARCHIVER	submitting	archiving	02-28-2025, 16:35:57	None	22508
ARCHIVER	submitting	archiving	02-28-2025, 16:35:56	None	22507
ARCHIVER	submitting	archiving	02-28-2025, 16:35:55	None	22506
ARCHIVER	submitting	archiving	02-28-2025, 16:35:54	None	22505
ARCHIVER	submitting	archiving	02-28-2025, 16:35:53	None	22504
ARCHIVER	submitting	archiving	02-28-2025, 16:35:51	None	22502
ARCHIVER	submitting	archiving	02-28-2025, 16:35:50	None	22501
ARCHIVER	submitting	archiving	02-28-2025, 16:35:49	None	22500
ARCHIVER	submitting	archiving	02-28-2025, 16:35:48	None	22499
ARCHIVER	submitting	archiving	02-28-2025, 16:35:47	None	22498
ARCHIVER	submitting	archiving	02-28-2025, 16:35:46	None	22497
ARCHIVER	submitting	archiving	02-28-2025, 16:35:45	None	22496
ARCHIVER	submitting	archiving	02-28-2025, 16:35:43	None	22494
ARCHIVER	submitting	archiving	02-28-2025, 16:35:42	None	22493
ARCHIVER	submitting	archiving	02-28-2025, 16:35:41	None	22492
ARCHIVER	submitting	archiving	02-28-2025, 16:35:40	None	22491
ARCHIVER	submitting	archiving	02-28-2025, 16:35:38	None	22489
ARCHIVER	submitting	archiving	02-28-2025, 16:35:37	None	22488
ARCHIVER	submitting	archiving	02-28-2025, 16:35:36	None	22487
ARCHIVER	submitting	archiving	02-28-2025, 16:35:35	None	22486
ARCHIVER	submitting	archiving	02-28-2025, 16:35:33	None	22484
ARCHIVER	submitting	archiving	02-28-2025, 16:35:32	None	22483
ARCHIVER	submitting	archiving	02-28-2025, 16:35:31	None	22482
ARCHIVER	submitting	archiving	02-28-2025, 16:35:29	None	22480
ARCHIVER	submitting	archiving	02-28-2025, 16:35:28	None	22479
ARCHIVER	submitting	archiving	02-28-2025, 16:35:27	None	22478
ARCHIVER	submitting	archiving	02-28-2025, 16:35:25	None	22476
ARCHIVER	submitting	archiving	02-28-2025, 16:35:24	None	22475
ARCHIVER	submitting	archiving	02-28-2025, 16:35:23	None	22474
ARCHIVER	submitting	archiving	02-28-2025, 16:35:22	None	22473
ARCHIVER	submitting	archiving	02-28-2025, 16:35:21	None	22472
ARCHIVER	submitting	archiving	02-28-2025, 16:35:19	None	22470
ARCHIVER	submitting	archiving	02-28-2025, 16:35:18	None	22469
ARCHIVER	submitting	archiving	02-28-2025, 16:35:17	None	22468
ARCHIVER	submitting	archiving	02-28-2025, 16:35:16	None	22467
ARCHIVER	submitting	archiving	02-28-2025, 16:35:15	None	22466
ARCHIVER	submitting	archiving	02-28-2025, 16:35:14	None	22465
ARCHIVER	submitting	archiving	02-28-2025, 16:35:13	None	22464
ARCHIVER	submitting	archiving	02-28-2025, 16:35:11	None	22462
ARCHIVER	submitting	archiving	02-28-2025, 16:35:10	None	22461
ARCHIVER	submitting	archiving	02-28-2025, 16:35:09	None	22460
ARCHIVER	submitting	archiving	02-28-2025, 16:35:08	None	22459
ARCHIVER	submitting	archiving	02-28-2025, 16:35:07	None	22458
ARCHIVER	submitting	archiving	02-28-2025, 16:35:06	None	22457
ARCHIVER	submitting	archiving	02-28-2025, 16:35:05	None	22456
ARCHIVER	submitting	archiving	02-28-2025, 16:35:04	None	22455
ARCHIVER	submitting	archiving	02-28-2025, 16:35:03	None	22454
ARCHIVER	submitting	archiving	02-28-2025, 16:35:01	None	22452
ARCHIVER	submitting	archiving	02-28-2025, 16:35:00	None	22451
PREARCHIVER	SIP created	pre_archived	02-28-2025, 16:34:53	None	22444
PREARCHIVER	submitting	pre_archiving	02-28-2025, 16:11:28	None	21039
PREARCHIVER	submitting	pre_archiving	02-27-2025, 18:38:01	None	29832
PREARCHIVER	unknown error	pre_archived_failed	02-25-2025, 10:08:44	None	85675	ERROR at get_project_info_from_lta Can not retrieve project information of sas_id=626514 due to 'HTTPSConnectionPool(host='lta-ingest.lofar.eu', port=9443): Max retries exceeded with url: /RPC2 (Caused by NewConnectionError('
PREARCHIVER	submitting	pre_archiving	02-25-2025, 10:08:33	None	85664
STAGER	STAGER	scrubbed	02-25-2025, 09:42:49	None	84120	None
STAGER	STAGER	scrubbing	02-25-2025, 09:42:46	None	84117	None
DATAMANAGER	copy_finished	stored	02-25-2025, 03:25:58	None	61509
DATAMANAGER	copy_issued	storing	02-24-2025, 19:57:18	None	34589
DATAMANAGER	issuing_copying	storing	02-24-2025, 19:52:53	None	34324
AGGREGATOR	collected H5	processed	02-24-2025, 19:52:16	None	34287
AGGREGATOR	collect_h5	aggregating	02-24-2025, 19:52:15	None	34286
EXECUTOR	running	processed	02-24-2025, 19:52:14	None	15196	None
EXECUTOR	running	processing	02-24-2025, 15:16:28	None	17739	logfile
DATAMANAGER	copy_skipped	fetched	02-24-2025, 15:16:05	None	17716
STAGER	STAGER	staged	02-24-2025, 15:15:47	None	17698	None
STAGER	STAGER	staging	02-24-2025, 10:22:23	None	94	None