ATDB-LDV

Task: 387301 (regular)

id (api)	387301
type	regular
slurm jobs (api)	jobs for task 387301 {'finished': 85}
priority	100
status	finished
workflow	29 - aggregated_compress_pipeline
inputs outputs metrics Quality
filter	lc8_019_np-comp
source location (inputs)
target location (processing)	srm.grid.sara.nl
project	lc8_019
activity (API) + status	626514, finished
specification (API)	-
creationTime	2025-02-24 10:20:47
purge_policy	yes
cleanup_policy	defining
resume	True
is_summary	False
stage_request_id	762373
dataproducts	81
size_to_process	99.8 GB
size_processed	27.7 GB
total_processing_time	16100
quality	moderate
calculated qualities	{'per_task': ['moderate']}
remarks	None

Log Entries

service	step	status	timestamp	cpu_cycles	wall_clock_time	log
ARCHIVER	Success	finished	02-27-2025, 13:17:16	None	10588
ARCHIVER	cleaning	finishing	02-27-2025, 13:16:08	None	10520
ARCHIVER	Success	archived	02-27-2025, 13:16:07	None	10519
ARCHIVER	ingested	archiving	02-27-2025, 13:15:32	None	10484
ARCHIVER	submitting	archiving	02-27-2025, 13:10:10	None	10162
ARCHIVER	submitting	archiving	02-27-2025, 13:10:09	None	10161
ARCHIVER	submitting	archiving	02-27-2025, 13:10:08	None	10160
ARCHIVER	submitting	archiving	02-27-2025, 13:10:07	None	10159
ARCHIVER	submitting	archiving	02-27-2025, 13:10:06	None	10158
ARCHIVER	submitting	archiving	02-27-2025, 13:10:04	None	10156
ARCHIVER	submitting	archiving	02-27-2025, 13:10:03	None	10155
ARCHIVER	submitting	archiving	02-27-2025, 13:10:02	None	10154
ARCHIVER	submitting	archiving	02-27-2025, 13:10:01	None	10153
ARCHIVER	submitting	archiving	02-27-2025, 13:09:59	None	10151
ARCHIVER	submitting	archiving	02-27-2025, 13:09:58	None	10150
ARCHIVER	submitting	archiving	02-27-2025, 13:09:57	None	10149
ARCHIVER	submitting	archiving	02-27-2025, 13:09:56	None	10148
ARCHIVER	submitting	archiving	02-27-2025, 13:09:55	None	10147
ARCHIVER	submitting	archiving	02-27-2025, 13:09:53	None	10145
ARCHIVER	submitting	archiving	02-27-2025, 13:09:52	None	10144
ARCHIVER	submitting	archiving	02-27-2025, 13:09:50	None	10142
ARCHIVER	submitting	archiving	02-27-2025, 13:09:49	None	10141
ARCHIVER	submitting	archiving	02-27-2025, 13:09:48	None	10140
ARCHIVER	submitting	archiving	02-27-2025, 13:09:46	None	10138
ARCHIVER	submitting	archiving	02-27-2025, 13:09:45	None	10137
ARCHIVER	submitting	archiving	02-27-2025, 13:09:44	None	10136
ARCHIVER	submitting	archiving	02-27-2025, 13:09:43	None	10135
ARCHIVER	submitting	archiving	02-27-2025, 13:09:42	None	10134
ARCHIVER	submitting	archiving	02-27-2025, 13:09:41	None	10133
ARCHIVER	submitting	archiving	02-27-2025, 13:09:39	None	10131
ARCHIVER	submitting	archiving	02-27-2025, 13:09:38	None	10130
ARCHIVER	submitting	archiving	02-27-2025, 13:09:37	None	10129
ARCHIVER	submitting	archiving	02-27-2025, 13:09:36	None	10128
ARCHIVER	submitting	archiving	02-27-2025, 13:09:35	None	10127
ARCHIVER	submitting	archiving	02-27-2025, 13:09:33	None	10125
ARCHIVER	submitting	archiving	02-27-2025, 13:09:32	None	10124
ARCHIVER	submitting	archiving	02-27-2025, 13:09:31	None	10123
ARCHIVER	submitting	archiving	02-27-2025, 13:09:30	None	10122
ARCHIVER	submitting	archiving	02-27-2025, 13:09:29	None	10121
ARCHIVER	submitting	archiving	02-27-2025, 13:09:27	None	10119
ARCHIVER	submitting	archiving	02-27-2025, 13:09:26	None	10118
ARCHIVER	submitting	archiving	02-27-2025, 13:09:25	None	10117
ARCHIVER	submitting	archiving	02-27-2025, 13:09:24	None	10116
ARCHIVER	submitting	archiving	02-27-2025, 13:09:22	None	10114
ARCHIVER	submitting	archiving	02-27-2025, 13:09:21	None	10113
ARCHIVER	submitting	archiving	02-27-2025, 13:09:20	None	10112
ARCHIVER	submitting	archiving	02-27-2025, 13:09:18	None	10110
ARCHIVER	submitting	archiving	02-27-2025, 13:09:17	None	10109
ARCHIVER	submitting	archiving	02-27-2025, 13:09:16	None	10108
ARCHIVER	submitting	archiving	02-27-2025, 13:09:14	None	10106
ARCHIVER	submitting	archiving	02-27-2025, 13:09:13	None	10105
ARCHIVER	submitting	archiving	02-27-2025, 13:09:12	None	10104
ARCHIVER	submitting	archiving	02-27-2025, 13:09:11	None	10103
ARCHIVER	submitting	archiving	02-27-2025, 13:09:09	None	10101
ARCHIVER	submitting	archiving	02-27-2025, 13:09:08	None	10100
ARCHIVER	submitting	archiving	02-27-2025, 13:09:07	None	10099
ARCHIVER	submitting	archiving	02-27-2025, 13:09:06	None	10098
ARCHIVER	submitting	archiving	02-27-2025, 13:09:05	None	10097
ARCHIVER	submitting	archiving	02-27-2025, 13:09:04	None	10096
ARCHIVER	submitting	archiving	02-27-2025, 13:09:03	None	10095
ARCHIVER	submitting	archiving	02-27-2025, 13:09:01	None	10093
ARCHIVER	submitting	archiving	02-27-2025, 13:09:00	None	10092
ARCHIVER	submitting	archiving	02-27-2025, 13:08:59	None	10091
ARCHIVER	submitting	archiving	02-27-2025, 13:08:58	None	10090
ARCHIVER	submitting	archiving	02-27-2025, 13:08:56	None	10088
ARCHIVER	submitting	archiving	02-27-2025, 13:08:54	None	10086
ARCHIVER	submitting	archiving	02-27-2025, 13:08:53	None	10085
ARCHIVER	submitting	archiving	02-27-2025, 13:08:52	None	10084
ARCHIVER	submitting	archiving	02-27-2025, 13:08:51	None	10083
ARCHIVER	submitting	archiving	02-27-2025, 13:08:49	None	10081
ARCHIVER	submitting	archiving	02-27-2025, 13:08:48	None	10080
ARCHIVER	submitting	archiving	02-27-2025, 13:08:47	None	10079
ARCHIVER	submitting	archiving	02-27-2025, 13:08:46	None	10078
ARCHIVER	submitting	archiving	02-27-2025, 13:08:44	None	10076
ARCHIVER	submitting	archiving	02-27-2025, 13:08:43	None	10075
ARCHIVER	submitting	archiving	02-27-2025, 13:08:42	None	10074
ARCHIVER	submitting	archiving	02-27-2025, 13:08:40	None	10072
ARCHIVER	submitting	archiving	02-27-2025, 13:08:39	None	10071
ARCHIVER	submitting	archiving	02-27-2025, 13:08:37	None	10069
ARCHIVER	submitting	archiving	02-27-2025, 13:08:36	None	10068
ARCHIVER	submitting	archiving	02-27-2025, 13:08:35	None	10067
ARCHIVER	submitting	archiving	02-27-2025, 13:08:33	None	10065
ARCHIVER	submitting	archiving	02-27-2025, 13:08:32	None	10064
ARCHIVER	submitting	archiving	02-27-2025, 13:08:31	None	10063
ARCHIVER	submitting	archiving	02-27-2025, 13:08:29	None	10061
PREARCHIVER	SIP created	pre_archived	02-27-2025, 13:08:22	None	10054
PREARCHIVER	submitting	pre_archiving	02-27-2025, 12:44:30	None	8622
PREARCHIVER	unknown error	pre_archived_failed	02-25-2025, 10:08:30	None	85662	ERROR at get_project_info_from_lta Can not retrieve project information of sas_id=626514 due to 'HTTPSConnectionPool(host='lta-ingest.lofar.eu', port=9443): Max retries exceeded with url: /RPC2 (Caused by NewConnectionError('
PREARCHIVER	submitting	pre_archiving	02-25-2025, 10:08:19	None	85651
STAGER	STAGER	scrubbed	02-25-2025, 09:43:21	None	84153	None
STAGER	STAGER	scrubbing	02-25-2025, 09:43:21	None	84153	None
DATAMANAGER	copy_finished	stored	02-25-2025, 03:39:44	None	62336
DATAMANAGER	copy_issued	storing	02-25-2025, 03:37:18	None	62190
DATAMANAGER	issuing_copying	storing	02-25-2025, 03:32:53	None	61925
AGGREGATOR	collected H5	processed	02-25-2025, 03:30:54	None	61806
AGGREGATOR	collect_h5	aggregating	02-25-2025, 03:30:53	None	61805
EXECUTOR	running	processed	02-24-2025, 21:42:13	None	16100	None
EXECUTOR	running	processing	02-24-2025, 15:17:23	None	17795	logfile
DATAMANAGER	copy_skipped	fetched	02-24-2025, 15:17:08	None	17780
STAGER	STAGER	staged	02-24-2025, 15:16:52	None	17764	None
STAGER	STAGER	staging	02-24-2025, 10:22:22	None	94	None