Task: 399857 (regular)

id (api)399857
typeregular
slurm jobs (api)jobs for task 399857 {'finished': 7}
priority 100
statusfinished
workflow 29 - aggregated_compress_pipeline
 inputs    outputs    metrics Quality  
filterlt10_010-aa-comp
source location (inputs)
target location (processing)srm.grid.sara.nl
projectlt10_010
activity (API) + status 657122, finished
specification (API) -
creationTime2025-04-15 11:43:12
purge_policyyes
cleanup_policydefining
resumeTrue
is_summaryFalse
stage_request_id788102
dataproducts3
size_to_process177.3 GB
size_processed49.0 GB
total_processing_time27632
qualitymoderate
calculated qualities{'per_task': ['poor']}
remarks{'quality_sasid': 'One RS with 100% data loss. Busy RFI profile, especially at high frequencies. Validated moderate to look into further.'}

Log Entries

servicestepstatustimestampcpu_cycleswall_clock_timelog
ARCHIVERSuccessfinished05-02-2025, 10:17:59None81286
ARCHIVERcleaningfinishing05-02-2025, 10:17:41None81268
ARCHIVERSuccessarchived05-02-2025, 10:17:40None81267
ARCHIVERingestedarchiving05-02-2025, 10:16:56None81223
ARCHIVERsubmittingarchiving05-02-2025, 09:45:26None79333
ARCHIVERsubmittingarchiving05-02-2025, 09:45:25None79332
ARCHIVERsubmittingarchiving05-02-2025, 09:45:24None79331
ARCHIVERNAarchived_failed04-24-2025, 01:34:16None49863Task is too long in archiving state
ARCHIVERsubmittingarchiving04-24-2025, 01:15:11None48718
ARCHIVERsubmittingarchiving04-24-2025, 01:15:10None48717
ARCHIVERsubmittingarchiving04-24-2025, 01:15:08None48715
ARCHIVERauto_recoverypre_archived04-24-2025, 01:14:38None48685Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived04-24-2025, 01:14:37None48684Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived04-24-2025, 01:14:36None48683Force to retry due to status FAILED retrieved from FTS
ARCHIVERsubmittingarchiving04-24-2025, 00:53:52None47439
ARCHIVERsubmittingarchiving04-24-2025, 00:53:51None47438
ARCHIVERsubmittingarchiving04-24-2025, 00:53:49None47436
ARCHIVERauto_recoverypre_archived04-24-2025, 00:53:18None47405Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived04-24-2025, 00:53:17None47404Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived04-24-2025, 00:53:16None47403Force to retry due to status FAILED retrieved from FTS
ARCHIVERsubmittingarchiving04-22-2025, 16:51:30None18497
ARCHIVERsubmittingarchiving04-22-2025, 16:51:29None18496
ARCHIVERsubmittingarchiving04-22-2025, 16:51:28None18495
PREARCHIVERSIP createdpre_archived04-22-2025, 16:50:57None18464
PREARCHIVERsubmittingpre_archiving04-22-2025, 16:50:09None18416
PREARCHIVERunknown errorpre_archived_failed04-22-2025, 11:26:16None85383HTTPSConnectionPool(host='lofar.astron.nl', port=443): Max retries exceeded with url: /useradministration/user/systemlogin.do (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has
PREARCHIVERsubmittingpre_archiving04-22-2025, 11:26:14None85381
STAGERSTAGERscrubbed04-22-2025, 11:10:24None84431
STAGERSTAGERscrubbing04-22-2025, 11:09:36None84383
DATAMANAGERcopy_finishedstored04-18-2025, 18:36:07None24774
DATAMANAGERcopy_issuedstoring04-18-2025, 18:33:35None24622
DATAMANAGERissuing_copyingstoring04-18-2025, 18:33:18None24605
AGGREGATORcollected H5processed04-18-2025, 18:32:54None24581
AGGREGATORcollect_h5aggregating04-18-2025, 18:32:53None24580
EXECUTORrunningprocessed04-18-2025, 18:32:33None27632None
EXECUTORrunningprocessing04-18-2025, 17:33:58None21045logfile
DATAMANAGERcopy_skippedfetched04-18-2025, 17:33:35None21022
STAGERSTAGERstaged04-18-2025, 17:32:57None20984None
STAGERSTAGERstaging04-18-2025, 08:58:11None76498None