Task: 399885 (regular)

id (api)399885
typeregular
slurm jobs (api)jobs for task 399885 {'finished': 7}
priority 100
statusfinished
workflow 29 - aggregated_compress_pipeline
 inputs    outputs    metrics Quality  
filterlt10_010-aa-comp
source location (inputs)
target location (processing)srm.grid.sara.nl
projectlt10_010
activity (API) + status 657122, finished
specification (API) -
creationTime2025-04-15 11:43:25
purge_policyyes
cleanup_policydefining
resumeTrue
is_summaryFalse
stage_request_id788130
dataproducts3
size_to_process177.3 GB
size_processed49.1 GB
total_processing_time22984
qualitymoderate
calculated qualities{'per_task': ['poor']}
remarks{'quality_sasid': 'One RS with 100% data loss. Busy RFI profile, especially at high frequencies. Validated moderate to look into further.'}

Log Entries

servicestepstatustimestampcpu_cycleswall_clock_timelog
ARCHIVERSuccessfinished05-02-2025, 06:22:56None67170
ARCHIVERcleaningfinishing05-02-2025, 06:22:36None67150
ARCHIVERSuccessarchived05-02-2025, 06:22:36None67150
ARCHIVERingestedarchiving05-02-2025, 06:21:56None67110
ARCHIVERsubmittingarchiving05-02-2025, 06:20:35None67029
ARCHIVERsubmittingarchiving05-02-2025, 06:20:34None67028
ARCHIVERsubmittingarchiving05-02-2025, 06:20:33None67027
ARCHIVERauto_recoverypre_archived05-02-2025, 06:20:06None67000Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived05-02-2025, 06:20:05None66999Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived05-02-2025, 06:20:04None66998Force to retry due to status FAILED retrieved from FTS
ARCHIVERsubmittingarchiving04-22-2025, 17:19:29None20163
ARCHIVERsubmittingarchiving04-22-2025, 17:19:27None20161
ARCHIVERsubmittingarchiving04-22-2025, 17:19:26None20160
PREARCHIVERSIP createdpre_archived04-22-2025, 17:19:09None20143
PREARCHIVERsubmittingpre_archiving04-22-2025, 17:18:22None20096
PREARCHIVERunknown errorpre_archived_failed04-22-2025, 11:32:26None85740HTTPSConnectionPool(host='lofar.astron.nl', port=443): Max retries exceeded with url: /useradministration/user/systemlogin.do (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has
PREARCHIVERsubmittingpre_archiving04-22-2025, 11:32:25None85739
STAGERSTAGERscrubbed04-22-2025, 11:10:40None84434
STAGERSTAGERscrubbing04-22-2025, 11:09:51None84385
DATAMANAGERcopy_finishedstored04-18-2025, 16:36:38None17592
DATAMANAGERcopy_issuedstoring04-18-2025, 16:33:00None17374
DATAMANAGERissuing_copyingstoring04-18-2025, 16:32:43None17357
AGGREGATORcollected H5processed04-18-2025, 16:32:30None17344
AGGREGATORcollect_h5aggregating04-18-2025, 16:32:29None17343
EXECUTORrunningprocessed04-18-2025, 16:31:59None22984None
EXECUTORrunningprocessing04-18-2025, 15:42:44None14358logfile
DATAMANAGERcopy_skippedfetched04-18-2025, 15:42:31None14345
STAGERSTAGERstaged04-18-2025, 15:42:05None14319None
STAGERSTAGERstaging04-18-2025, 08:58:44None76518None