Task: 399870 (regular)

id (api)399870
typeregular
slurm jobs (api)jobs for task 399870 {'finished': 7}
priority 100
statusfinished
workflow 29 - aggregated_compress_pipeline
 inputs    outputs    metrics Quality  
filterlt10_010-aa-comp
source location (inputs)
target location (processing)srm.grid.sara.nl
projectlt10_010
activity (API) + status 657122, finished
specification (API) -
creationTime2025-04-15 11:43:18
purge_policyyes
cleanup_policydefining
resumeTrue
is_summaryFalse
stage_request_id788115
dataproducts3
size_to_process177.3 GB
size_processed49.0 GB
total_processing_time27320
qualitymoderate
calculated qualities{'per_task': ['poor']}
remarks{'quality_sasid': 'One RS with 100% data loss. Busy RFI profile, especially at high frequencies. Validated moderate to look into further.'}

Log Entries

servicestepstatustimestampcpu_cycleswall_clock_timelog
ARCHIVERSuccessfinished05-01-2025, 19:43:37None28818
ARCHIVERcleaningfinishing05-01-2025, 19:43:20None28801
ARCHIVERSuccessarchived05-01-2025, 19:43:19None28800
ARCHIVERingestedarchiving05-01-2025, 19:42:35None28756
ARCHIVERsubmittingarchiving05-01-2025, 19:32:33None28154
ARCHIVERsubmittingarchiving05-01-2025, 19:32:31None28152
ARCHIVERsubmittingarchiving05-01-2025, 19:32:30None28151
ARCHIVERauto_recoverypre_archived05-01-2025, 19:31:59None28120Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived05-01-2025, 19:31:58None28119Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived05-01-2025, 19:31:56None28117Force to retry due to status FAILED retrieved from FTS
ARCHIVERsubmittingarchiving04-22-2025, 17:04:28None19269
ARCHIVERsubmittingarchiving04-22-2025, 17:04:26None19267
ARCHIVERsubmittingarchiving04-22-2025, 17:04:25None19266
PREARCHIVERSIP createdpre_archived04-22-2025, 17:04:11None19252
PREARCHIVERsubmittingpre_archiving04-22-2025, 17:03:24None19205
PREARCHIVERunknown errorpre_archived_failed04-22-2025, 11:29:09None85550HTTPSConnectionPool(host='lofar.astron.nl', port=443): Max retries exceeded with url: /useradministration/user/systemlogin.do (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has
PREARCHIVERsubmittingpre_archiving04-22-2025, 11:29:07None85548
STAGERSTAGERscrubbed04-22-2025, 11:10:34None84435
STAGERSTAGERscrubbing04-22-2025, 11:09:45None84386
DATAMANAGERcopy_finishedstored04-18-2025, 19:24:22None27663
DATAMANAGERcopy_issuedstoring04-18-2025, 19:21:09None27470
DATAMANAGERissuing_copyingstoring04-18-2025, 19:20:53None27454
AGGREGATORcollected H5processed04-18-2025, 19:20:41None27442
AGGREGATORcollect_h5aggregating04-18-2025, 19:20:40None27441
EXECUTORrunningprocessed04-18-2025, 19:20:13None27320None
EXECUTORrunningprocessing04-18-2025, 18:22:17None23938logfile
DATAMANAGERcopy_skippedfetched04-18-2025, 18:21:47None23908
STAGERSTAGERstaged04-18-2025, 18:21:22None23883None
STAGERSTAGERstaging04-18-2025, 08:58:28None76509None

Version 2 May 2025