ATDB-LDV

Task: 399887 (regular)

id (api)	399887
type	regular
slurm jobs (api)	jobs for task 399887 {'finished': 7}
priority	100
status	finished
workflow	29 - aggregated_compress_pipeline
inputs outputs metrics Quality
filter	lt10_010-aa-comp
source location (inputs)
target location (processing)	srm.grid.sara.nl
project	lt10_010
activity (API) + status	657122, finished
specification (API)	-
creationTime	2025-04-15 11:43:26
purge_policy	yes
cleanup_policy	defining
resume	True
is_summary	False
stage_request_id	788132
dataproducts	3
size_to_process	177.3 GB
size_processed	49.0 GB
total_processing_time	20808
quality	moderate
calculated qualities	{'per_task': ['poor']}
remarks	{'quality_sasid': 'One RS with 100% data loss. Busy RFI profile, especially at high frequencies. Validated moderate to look into further.'}

Log Entries

service	step	status	timestamp	cpu_cycles	wall_clock_time	log
ARCHIVER	Success	finished	05-02-2025, 06:24:41	None	67274
ARCHIVER	cleaning	finishing	05-02-2025, 06:24:23	None	67256
ARCHIVER	Success	archived	05-02-2025, 06:24:22	None	67255
ARCHIVER	ingested	archiving	05-02-2025, 06:23:42	None	67215
ARCHIVER	submitting	archiving	05-02-2025, 06:01:36	None	65889
ARCHIVER	submitting	archiving	05-02-2025, 06:01:35	None	65888
ARCHIVER	submitting	archiving	05-02-2025, 06:01:34	None	65887
ARCHIVER	auto_recovery	pre_archived	05-02-2025, 06:01:06	None	65859	Force to retry due to status FAILED retrieved from FTS
ARCHIVER	auto_recovery	pre_archived	05-02-2025, 06:01:05	None	65858	Force to retry due to status FAILED retrieved from FTS
ARCHIVER	auto_recovery	pre_archived	05-02-2025, 06:01:04	None	65857	Force to retry due to status FAILED retrieved from FTS
ARCHIVER	submitting	archiving	04-22-2025, 17:21:25	None	20278
ARCHIVER	submitting	archiving	04-22-2025, 17:21:24	None	20277
ARCHIVER	submitting	archiving	04-22-2025, 17:21:23	None	20276
PREARCHIVER	SIP created	pre_archived	04-22-2025, 17:21:10	None	20263
PREARCHIVER	submitting	pre_archiving	04-22-2025, 17:20:22	None	20215
PREARCHIVER	unknown error	pre_archived_failed	04-22-2025, 11:32:52	None	85765	HTTPSConnectionPool(host='lofar.astron.nl', port=443): Max retries exceeded with url: /useradministration/user/systemlogin.do (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has
PREARCHIVER	submitting	pre_archiving	04-22-2025, 11:32:51	None	85764
STAGER	STAGER	scrubbed	04-22-2025, 11:10:41	None	84434
STAGER	STAGER	scrubbing	04-22-2025, 11:09:52	None	84385
DATAMANAGER	copy_finished	stored	04-18-2025, 16:49:52	None	18385
DATAMANAGER	copy_issued	storing	04-18-2025, 16:46:34	None	18187
DATAMANAGER	issuing_copying	storing	04-18-2025, 16:46:17	None	18170
AGGREGATOR	collected H5	processed	04-18-2025, 16:45:49	None	18142
AGGREGATOR	collect_h5	aggregating	04-18-2025, 16:45:48	None	18141
EXECUTOR	running	processed	04-18-2025, 16:45:43	None	20808	None
EXECUTOR	running	processing	04-18-2025, 15:50:04	None	14797	logfile
DATAMANAGER	copy_skipped	fetched	04-18-2025, 15:49:52	None	14785
STAGER	STAGER	staged	04-18-2025, 15:49:27	None	14760	None
STAGER	STAGER	staging	04-18-2025, 08:58:46	None	76519	None