Task: 399851 (regular)

id (api)399851
typeregular
slurm jobs (api)jobs for task 399851 {'finished': 7}
priority 100
statusfinished
workflow 29 - aggregated_compress_pipeline
 inputs    outputs    metrics Quality  
filterlt10_010-aa-comp
source location (inputs)
target location (processing)srm.grid.sara.nl
projectlt10_010
activity (API) + status 657122, finished
specification (API) -
creationTime2025-04-15 11:43:08
purge_policyyes
cleanup_policydefining
resumeTrue
is_summaryFalse
stage_request_id788096
dataproducts3
size_to_process177.3 GB
size_processed49.0 GB
total_processing_time19592
qualitymoderate
calculated qualities{'per_task': ['poor']}
remarks{'quality_sasid': 'One RS with 100% data loss. Busy RFI profile, especially at high frequencies. Validated moderate to look into further.'}

Log Entries

servicestepstatustimestampcpu_cycleswall_clock_timelog
ARCHIVERSuccessfinished05-02-2025, 10:06:14None80585
ARCHIVERcleaningfinishing05-02-2025, 10:05:55None80566
ARCHIVERSuccessarchived05-02-2025, 10:05:54None80565
ARCHIVERingestedarchiving05-02-2025, 10:04:36None80487
ARCHIVERsubmittingarchiving05-02-2025, 09:36:48None78819
ARCHIVERsubmittingarchiving05-02-2025, 09:36:46None78817
ARCHIVERsubmittingarchiving05-02-2025, 09:36:45None78816
ARCHIVERNAarchived_failed04-23-2025, 21:20:49None34660Task is too long in archiving state
ARCHIVERsubmittingarchiving04-23-2025, 21:01:10None33481
ARCHIVERsubmittingarchiving04-23-2025, 21:01:09None33480
ARCHIVERsubmittingarchiving04-23-2025, 21:01:07None33478
ARCHIVERauto_recoverypre_archived04-23-2025, 21:00:37None33448Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived04-23-2025, 21:00:36None33447Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived04-23-2025, 21:00:35None33446Force to retry due to status FAILED retrieved from FTS
ARCHIVERsubmittingarchiving04-23-2025, 20:39:58None32209
ARCHIVERsubmittingarchiving04-23-2025, 20:39:56None32207
ARCHIVERsubmittingarchiving04-23-2025, 20:39:55None32206
ARCHIVERauto_recoverypre_archived04-23-2025, 20:39:25None32176Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived04-23-2025, 20:39:24None32175Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived04-23-2025, 20:39:22None32173Force to retry due to status FAILED retrieved from FTS
ARCHIVERsubmittingarchiving04-22-2025, 16:45:17None18128
ARCHIVERsubmittingarchiving04-22-2025, 16:45:16None18127
ARCHIVERsubmittingarchiving04-22-2025, 16:45:14None18125
PREARCHIVERSIP createdpre_archived04-22-2025, 16:45:00None18111
PREARCHIVERsubmittingpre_archiving04-22-2025, 16:44:13None18064
PREARCHIVERunknown errorpre_archived_failed04-22-2025, 11:24:56None85307HTTPSConnectionPool(host='lofar.astron.nl', port=443): Max retries exceeded with url: /useradministration/user/systemlogin.do (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has
PREARCHIVERsubmittingpre_archiving04-22-2025, 11:24:55None85306
STAGERSTAGERscrubbed04-22-2025, 11:11:55None84526
STAGERSTAGERscrubbing04-22-2025, 11:11:35None84506
DATAMANAGERcopy_finishedstored04-18-2025, 17:54:46None22297
DATAMANAGERcopy_issuedstoring04-18-2025, 17:51:59None22130
DATAMANAGERissuing_copyingstoring04-18-2025, 17:51:42None22113
AGGREGATORcollected H5processed04-18-2025, 17:50:37None22048
AGGREGATORcollect_h5aggregating04-18-2025, 17:50:36None22047
EXECUTORrunningprocessed04-18-2025, 17:50:02None19592None
EXECUTORrunningprocessing04-18-2025, 17:01:56None19127logfile
DATAMANAGERcopy_skippedfetched04-18-2025, 17:01:16None19087
STAGERSTAGERstaged04-18-2025, 17:00:53None19064None
STAGERSTAGERstaging04-18-2025, 08:58:03None76494None