ATDB-LDV

Task: 393659 (regular)

id (api)	393659
type	regular
slurm jobs (api)	jobs for task 393659 {'finished': 13}
priority	100
status	finished
workflow	29 - aggregated_compress_pipeline
inputs outputs metrics Quality
filter	lt10_010-mi-comp
source location (inputs)
target location (processing)	srm.grid.sara.nl
project	lt10_010
activity (API) + status	654742, finished
specification (API)	-
creationTime	2025-03-18 14:58:14
purge_policy	yes
cleanup_policy	defining
resume	True
is_summary	False
stage_request_id	775656
dataproducts	9
size_to_process	11.8 GB
size_processed	3.3 GB
total_processing_time	2778
quality	poor
calculated qualities	{'per_task': ['poor']}
remarks	None

Log Entries

service	step	status	timestamp	cpu_cycles	wall_clock_time	log
ARCHIVER	Success	finished	03-24-2025, 05:56:36	None	53901
ARCHIVER	cleaning	finishing	03-24-2025, 05:56:13	None	53878
ARCHIVER	Success	archived	03-24-2025, 05:56:12	None	53877
ARCHIVER	ingested	archiving	03-24-2025, 05:55:24	None	53829
ARCHIVER	update_final_archiving	archived_failed	03-21-2025, 16:16:08	None	4673	XML-RPC Service; an Exception was raised in UpdateUriState; 'No FileObject found for StorageTicketResource(30567643928F2FBCE063164A17ACCA2C) with URI srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lofar/ops/projects/lt10_010/1505694/L1505694_SB20
ARCHIVER	update_final_archiving	archived_failed	03-21-2025, 16:16:07	None	4672	XML-RPC Service; an Exception was raised in UpdateUriState; 'No FileObject found for StorageTicketResource(30567643928E2FBCE063164A17ACCA2C) with URI srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lofar/ops/projects/lt10_010/1505694/L1505694_SB20
ARCHIVER	update_final_archiving	archived_failed	03-21-2025, 16:16:06	None	4671	XML-RPC Service; an Exception was raised in UpdateUriState; 'No FileObject found for StorageTicketResource(30AE9BAFCDAE2E1BE063164A17ACDB37) with URI srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lofar/ops/projects/lt10_010/1505694/L1505694_SB20
ARCHIVER	update_final_archiving	archived_failed	03-21-2025, 16:16:05	None	4670	XML-RPC Service; an Exception was raised in UpdateUriState; 'No FileObject found for StorageTicketResource(30AE9BAFCDAC2E1BE063164A17ACDB37) with URI srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lofar/ops/projects/lt10_010/1505694/L1505694_SB20
ARCHIVER	update_final_archiving	archived_failed	03-21-2025, 16:16:04	None	4669	XML-RPC Service; an Exception was raised in UpdateUriState; 'No FileObject found for StorageTicketResource(3056764392872FBCE063164A17ACCA2C) with URI srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lofar/ops/projects/lt10_010/1505694/L1505694_SB20
ARCHIVER	update_final_archiving	archived_failed	03-21-2025, 16:16:03	None	4668	XML-RPC Service; an Exception was raised in UpdateUriState; 'No FileObject found for StorageTicketResource(3056764392842FBCE063164A17ACCA2C) with URI srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lofar/ops/projects/lt10_010/1505694/L1505694_SB19
ARCHIVER	update_final_archiving	archived_failed	03-21-2025, 16:16:02	None	4667	XML-RPC Service; an Exception was raised in UpdateUriState; 'No FileObject found for StorageTicketResource(30AF3C04745B35B2E063164A17AC4B2D) with URI srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lofar/ops/projects/lt10_010/1505694/L1505694_SB19
ARCHIVER	restarting	archiving	03-21-2025, 16:15:57	None	4662
ARCHIVER	update_final_archiving	archived_failed	03-21-2025, 15:31:57	None	2022	XML-RPC Service; an Exception was raised in UpdateUriState; 'No FileObject found for StorageTicketResource(30567643928F2FBCE063164A17ACCA2C) with URI srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lofar/ops/projects/lt10_010/1505694/L1505694_SB20
ARCHIVER	update_final_archiving	archived_failed	03-21-2025, 15:31:56	None	2021	XML-RPC Service; an Exception was raised in UpdateUriState; 'No FileObject found for StorageTicketResource(30567643928E2FBCE063164A17ACCA2C) with URI srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lofar/ops/projects/lt10_010/1505694/L1505694_SB20
ARCHIVER	update_final_archiving	archived_failed	03-21-2025, 15:31:56	None	2021	XML-RPC Service; an Exception was raised in UpdateUriState; 'No FileObject found for StorageTicketResource(30AE9BAFCDAE2E1BE063164A17ACDB37) with URI srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lofar/ops/projects/lt10_010/1505694/L1505694_SB20
ARCHIVER	update_final_archiving	archived_failed	03-21-2025, 15:31:55	None	2020	XML-RPC Service; an Exception was raised in UpdateUriState; 'No FileObject found for StorageTicketResource(30AE9BAFCDAC2E1BE063164A17ACDB37) with URI srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lofar/ops/projects/lt10_010/1505694/L1505694_SB20
ARCHIVER	update_final_archiving	archived_failed	03-21-2025, 15:31:54	None	2019	XML-RPC Service; an Exception was raised in UpdateUriState; 'No FileObject found for StorageTicketResource(3056764392872FBCE063164A17ACCA2C) with URI srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lofar/ops/projects/lt10_010/1505694/L1505694_SB20
ARCHIVER	update_final_archiving	archived_failed	03-21-2025, 15:31:53	None	2018	XML-RPC Service; an Exception was raised in UpdateUriState; 'No FileObject found for StorageTicketResource(3056764392842FBCE063164A17ACCA2C) with URI srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lofar/ops/projects/lt10_010/1505694/L1505694_SB19
ARCHIVER	update_final_archiving	archived_failed	03-21-2025, 15:31:52	None	2017	XML-RPC Service; an Exception was raised in UpdateUriState; 'No FileObject found for StorageTicketResource(30AF3C04745B35B2E063164A17AC4B2D) with URI srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lofar/ops/projects/lt10_010/1505694/L1505694_SB19
ARCHIVER	submitting	archiving	03-21-2025, 15:30:44	None	1949
ARCHIVER	submitting	archiving	03-21-2025, 15:30:43	None	1948
ARCHIVER	submitting	archiving	03-21-2025, 15:30:42	None	1947
ARCHIVER	submitting	archiving	03-21-2025, 15:30:41	None	1946
ARCHIVER	submitting	archiving	03-21-2025, 15:30:39	None	1944
ARCHIVER	submitting	archiving	03-21-2025, 15:30:38	None	1943
ARCHIVER	submitting	archiving	03-21-2025, 15:30:37	None	1942
ARCHIVER	submitting	archiving	03-21-2025, 15:30:35	None	1940
ARCHIVER	submitting	archiving	03-21-2025, 15:30:34	None	1939
ARCHIVER	submitting	archiving	03-21-2025, 15:30:33	None	1938
ARCHIVER	submitting	archiving	03-21-2025, 15:30:31	None	1936
ARCHIVER	submitting	archiving	03-21-2025, 15:30:30	None	1935
ARCHIVER	submitting	archiving	03-21-2025, 15:30:28	None	1933
ARCHIVER	submitting	archiving	03-21-2025, 15:30:27	None	1932
ARCHIVER	submitting	archiving	03-21-2025, 15:30:25	None	1930
ARCHIVER	submitting	archiving	03-21-2025, 15:30:24	None	1929
PREARCHIVER	SIP created	pre_archived	03-21-2025, 15:30:03	None	1908
PREARCHIVER	submitting	pre_archiving	03-21-2025, 15:27:25	None	1750
PREARCHIVER	unknown error	pre_archived_failed	03-21-2025, 15:21:29	None	1394	HTTPSConnectionPool(host='lta-ingest.lofar.eu', port=9443): Max retries exceeded with url: /RPC2 (Caused by NewConnectionError(': Failed to establish a new connection: [Errno -2] Name or se
PREARCHIVER	submitting	pre_archiving	03-21-2025, 15:10:17	None	722
STAGER	STAGER	scrubbed	03-19-2025, 15:35:58	None	2263	None
STAGER	STAGER	scrubbing	03-19-2025, 15:35:33	None	2238	None
DATAMANAGER	copy_finished	stored	03-19-2025, 14:13:11	None	83696
DATAMANAGER	copy_issued	storing	03-19-2025, 14:00:15	None	82920
DATAMANAGER	issuing_copying	storing	03-19-2025, 13:59:39	None	82884
AGGREGATOR	collected H5	processed	03-19-2025, 13:53:53	None	82538
AGGREGATOR	collect_h5	aggregating	03-19-2025, 13:53:52	None	82537
EXECUTOR	running	processed	03-19-2025, 13:53:09	None	2778	None
EXECUTOR	running	processing	03-19-2025, 13:35:33	None	81438	logfile
DATAMANAGER	copy_skipped	fetched	03-19-2025, 13:34:35	None	81380
STAGER	STAGER	staged	03-19-2025, 13:29:40	None	81085	None
STAGER	STAGER	staging	03-19-2025, 11:12:59	None	72884	None