Task: 399839 (regular)

id (api)399839
typeregular
slurm jobs (api)jobs for task 399839 {'finished': 7}
priority 100
statusfinished
workflow 29 - aggregated_compress_pipeline
 inputs    outputs    metrics Quality  
filterlt10_010-aa-comp
source location (inputs)
target location (processing)srm.grid.sara.nl
projectlt10_010
activity (API) + status 657122, finished
specification (API) -
creationTime2025-04-15 11:43:01
purge_policyyes
cleanup_policydefining
resumeTrue
is_summaryFalse
stage_request_id788085
dataproducts3
size_to_process177.3 GB
size_processed49.0 GB
total_processing_time22248
qualitymoderate
calculated qualities{'per_task': ['poor']}
remarks{'quality_sasid': 'One RS with 100% data loss. Busy RFI profile, especially at high frequencies. Validated moderate to look into further.'}

Log Entries

servicestepstatustimestampcpu_cycleswall_clock_timelog
ARCHIVERSuccessfinished05-02-2025, 09:41:50None79128
ARCHIVERcleaningfinishing05-02-2025, 09:41:31None79109
ARCHIVERSuccessarchived05-02-2025, 09:41:30None79108
ARCHIVERingestedarchiving05-02-2025, 09:40:37None79055
ARCHIVERsubmittingarchiving05-02-2025, 09:21:42None77920
ARCHIVERsubmittingarchiving05-02-2025, 09:21:40None77918
ARCHIVERsubmittingarchiving05-02-2025, 09:21:39None77917
ARCHIVERNAarchived_failed04-23-2025, 13:06:14None4992Task is too long in archiving state
ARCHIVERsubmittingarchiving04-23-2025, 12:47:38None3876
ARCHIVERauto_recoverypre_archived04-23-2025, 12:47:07None3845Force to retry due to status FAILED retrieved from FTS
ARCHIVERsubmittingarchiving04-23-2025, 12:47:01None3839
ARCHIVERsubmittingarchiving04-23-2025, 12:47:00None3838
ARCHIVERauto_recoverypre_archived04-23-2025, 12:46:29None3807Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived04-23-2025, 12:46:28None3806Force to retry due to status FAILED retrieved from FTS
ARCHIVERsubmittingarchiving04-23-2025, 12:26:04None2582
ARCHIVERsubmittingarchiving04-23-2025, 12:26:02None2580
ARCHIVERsubmittingarchiving04-23-2025, 12:26:01None2579
ARCHIVERauto_recoverypre_archived04-23-2025, 12:25:31None2549Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived04-23-2025, 12:25:30None2548Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived04-23-2025, 12:25:29None2547Force to retry due to status FAILED retrieved from FTS
ARCHIVERsubmittingarchiving04-22-2025, 16:33:37None17435
ARCHIVERsubmittingarchiving04-22-2025, 16:33:36None17434
ARCHIVERsubmittingarchiving04-22-2025, 16:33:34None17432
PREARCHIVERSIP createdpre_archived04-22-2025, 16:33:07None17405
PREARCHIVERsubmittingpre_archiving04-22-2025, 16:32:20None17358
PREARCHIVERunknown errorpre_archived_failed04-22-2025, 11:22:16None85154HTTPSConnectionPool(host='lofar.astron.nl', port=443): Max retries exceeded with url: /useradministration/user/systemlogin.do (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has
PREARCHIVERsubmittingpre_archiving04-22-2025, 11:22:14None85152
STAGERSTAGERscrubbed04-22-2025, 11:11:52None84530
STAGERSTAGERscrubbing04-22-2025, 11:11:33None84511
DATAMANAGERcopy_finishedstored04-18-2025, 17:36:12None21190
DATAMANAGERcopy_issuedstoring04-18-2025, 17:33:01None20999
DATAMANAGERissuing_copyingstoring04-18-2025, 17:32:44None20982
AGGREGATORcollected H5processed04-18-2025, 17:31:58None20936
AGGREGATORcollect_h5aggregating04-18-2025, 17:31:57None20935
EXECUTORrunningprocessed04-18-2025, 17:31:29None22248None
EXECUTORrunningprocessing04-18-2025, 16:41:20None17898logfile
DATAMANAGERcopy_skippedfetched04-18-2025, 16:41:13None17891
STAGERSTAGERstaged04-18-2025, 16:40:54None17872None
STAGERSTAGERstaging04-18-2025, 08:57:47None76485None