Task: 399883 (regular)

id (api)399883
typeregular
slurm jobs (api)jobs for task 399883 {'finished': 7}
priority 100
statusfinished
workflow 29 - aggregated_compress_pipeline
 inputs    outputs    metrics Quality  
filterlt10_010-aa-comp
source location (inputs)
target location (processing)srm.grid.sara.nl
projectlt10_010
activity (API) + status 657122, finished
specification (API) -
creationTime2025-04-15 11:43:24
purge_policyyes
cleanup_policydefining
resumeTrue
is_summaryFalse
stage_request_id788128
dataproducts3
size_to_process177.3 GB
size_processed49.0 GB
total_processing_time21736
qualitymoderate
calculated qualities{'per_task': ['poor']}
remarks{'quality_sasid': 'One RS with 100% data loss. Busy RFI profile, especially at high frequencies. Validated moderate to look into further.'}

Log Entries

servicestepstatustimestampcpu_cycleswall_clock_timelog
ARCHIVERSuccessfinished05-02-2025, 06:19:49None66984
ARCHIVERcleaningfinishing05-02-2025, 06:19:31None66966
ARCHIVERSuccessarchived05-02-2025, 06:19:30None66965
ARCHIVERingestedarchiving05-02-2025, 06:19:14None66949
ARCHIVERsubmittingarchiving05-02-2025, 06:17:40None66855
ARCHIVERsubmittingarchiving05-02-2025, 06:17:39None66854
ARCHIVERsubmittingarchiving05-02-2025, 06:17:37None66852
ARCHIVERauto_recoverypre_archived05-02-2025, 06:17:09None66824Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived05-02-2025, 06:17:08None66823Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived05-02-2025, 06:17:07None66822Force to retry due to status FAILED retrieved from FTS
ARCHIVERsubmittingarchiving04-22-2025, 17:17:34None20049
ARCHIVERsubmittingarchiving04-22-2025, 17:17:33None20048
ARCHIVERsubmittingarchiving04-22-2025, 17:17:32None20047
PREARCHIVERSIP createdpre_archived04-22-2025, 17:17:09None20024
PREARCHIVERsubmittingpre_archiving04-22-2025, 17:16:22None19977
PREARCHIVERunknown errorpre_archived_failed04-22-2025, 11:32:00None85715HTTPSConnectionPool(host='lofar.astron.nl', port=443): Max retries exceeded with url: /useradministration/user/systemlogin.do (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has
PREARCHIVERsubmittingpre_archiving04-22-2025, 11:31:59None85714
STAGERSTAGERscrubbed04-22-2025, 11:10:39None84434
STAGERSTAGERscrubbing04-22-2025, 11:09:49None84384
DATAMANAGERcopy_finishedstored04-18-2025, 17:13:31None19806
DATAMANAGERcopy_issuedstoring04-18-2025, 17:10:05None19600
DATAMANAGERissuing_copyingstoring04-18-2025, 17:09:49None19584
AGGREGATORcollected H5processed04-18-2025, 17:09:46None19581
AGGREGATORcollect_h5aggregating04-18-2025, 17:09:45None19580
EXECUTORrunningprocessed04-18-2025, 17:09:17None21736None
EXECUTORrunningprocessing04-18-2025, 16:01:28None15483logfile
DATAMANAGERcopy_skippedfetched04-18-2025, 16:01:06None15461
STAGERSTAGERstaged04-18-2025, 16:00:56None15451None
STAGERSTAGERstaging04-18-2025, 08:58:42None76517None