ATDB-LDV

Task: 399822 (regular)

id (api)	399822
type	regular
slurm jobs (api)	jobs for task 399822 {'finished': 7}
priority	100
status	finished
workflow	29 - aggregated_compress_pipeline
inputs outputs metrics Quality
filter	lt10_010-aa-comp
source location (inputs)
target location (processing)	srm.grid.sara.nl
project	lt10_010
activity (API) + status	657122, finished
specification (API)	-
creationTime	2025-04-15 11:42:52
purge_policy	yes
cleanup_policy	defining
resume	True
is_summary	False
stage_request_id	788071
dataproducts	3
size_to_process	177.3 GB
size_processed	49.0 GB
total_processing_time	19024
quality	moderate
calculated qualities	{'per_task': ['poor']}
remarks	{'quality_sasid': 'One RS with 100% data loss. Busy RFI profile, especially at high frequencies. Validated moderate to look into further.'}

Log Entries

service	step	status	timestamp	cpu_cycles	wall_clock_time	log
ARCHIVER	Success	finished	05-02-2025, 09:07:47	None	77094
ARCHIVER	cleaning	finishing	05-02-2025, 09:07:29	None	77076
ARCHIVER	Success	archived	05-02-2025, 09:07:27	None	77074
ARCHIVER	ingested	archiving	05-02-2025, 09:07:10	None	77057
ARCHIVER	submitting	archiving	05-02-2025, 08:57:31	None	76478
ARCHIVER	submitting	archiving	05-02-2025, 08:57:29	None	76476
ARCHIVER	submitting	archiving	05-02-2025, 08:57:28	None	76475
ARCHIVER	NA	archived_failed	04-23-2025, 01:18:53	None	48960	Task is too long in archiving state
ARCHIVER	submitting	archiving	04-23-2025, 00:58:19	None	47726
ARCHIVER	submitting	archiving	04-23-2025, 00:58:17	None	47724
ARCHIVER	submitting	archiving	04-23-2025, 00:58:16	None	47723
ARCHIVER	auto_recovery	pre_archived	04-23-2025, 00:57:47	None	47694	Force to retry due to status FAILED retrieved from FTS
ARCHIVER	auto_recovery	pre_archived	04-23-2025, 00:57:46	None	47693	Force to retry due to status FAILED retrieved from FTS
ARCHIVER	auto_recovery	pre_archived	04-23-2025, 00:57:45	None	47692	Force to retry due to status FAILED retrieved from FTS
ARCHIVER	submitting	archiving	04-23-2025, 00:37:16	None	46463
ARCHIVER	submitting	archiving	04-23-2025, 00:37:15	None	46462
ARCHIVER	submitting	archiving	04-23-2025, 00:37:13	None	46460
ARCHIVER	auto_recovery	pre_archived	04-23-2025, 00:36:41	None	46428	Force to retry due to status FAILED retrieved from FTS
ARCHIVER	auto_recovery	pre_archived	04-23-2025, 00:36:40	None	46427	Force to retry due to status FAILED retrieved from FTS
ARCHIVER	auto_recovery	pre_archived	04-23-2025, 00:36:39	None	46426	Force to retry due to status FAILED retrieved from FTS
ARCHIVER	submitting	archiving	04-22-2025, 16:16:22	None	16409
ARCHIVER	submitting	archiving	04-22-2025, 16:16:20	None	16407
ARCHIVER	submitting	archiving	04-22-2025, 16:16:19	None	16406
PREARCHIVER	SIP created	pre_archived	04-22-2025, 16:15:59	None	16386
PREARCHIVER	submitting	pre_archiving	04-22-2025, 16:15:11	None	16338
PREARCHIVER	unknown error	pre_archived_failed	04-22-2025, 11:18:27	None	84934	HTTPSConnectionPool(host='lofar.astron.nl', port=443): Max retries exceeded with url: /useradministration/user/systemlogin.do (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has
PREARCHIVER	submitting	pre_archiving	04-22-2025, 11:18:26	None	84933
PREARCHIVER	unknown error	pre_archived_failed	04-22-2025, 11:15:15	None	84742	HTTPSConnectionPool(host='lofar.astron.nl', port=443): Max retries exceeded with url: /useradministration/user/systemlogin.do (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has
PREARCHIVER	submitting	pre_archiving	04-22-2025, 11:15:13	None	84740
PREARCHIVER	unknown error	pre_archived_failed	04-22-2025, 11:12:46	None	84593	HTTPSConnectionPool(host='lofar.astron.nl', port=443): Max retries exceeded with url: /useradministration/user/systemlogin.do (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has
PREARCHIVER	submitting	pre_archiving	04-22-2025, 11:12:44	None	84591
STAGER	STAGER	scrubbed	04-22-2025, 11:10:03	None	84430
STAGER	STAGER	scrubbing	04-22-2025, 11:09:16	None	84383
DATAMANAGER	copy_finished	stored	04-18-2025, 19:04:03	None	26470
DATAMANAGER	copy_issued	storing	04-18-2025, 19:02:08	None	26355
DATAMANAGER	issuing_copying	storing	04-18-2025, 19:01:51	None	26338
AGGREGATOR	collected H5	processed	04-18-2025, 19:01:25	None	26312
AGGREGATOR	collect_h5	aggregating	04-18-2025, 19:01:24	None	26311
EXECUTOR	running	processed	04-18-2025, 19:00:56	None	19024	None
EXECUTOR	running	processing	04-18-2025, 18:20:05	None	23832	logfile
DATAMANAGER	copy_skipped	fetched	04-18-2025, 18:18:57	None	23764
STAGER	STAGER	staged	04-18-2025, 18:18:43	None	23750	None
STAGER	STAGER	staging	04-18-2025, 08:57:32	None	76479	None