Task: 399861 (regular)

id (api)399861
typeregular
slurm jobs (api)jobs for task 399861 {'finished': 7}
priority 100
statusfinished
workflow 29 - aggregated_compress_pipeline
 inputs    outputs    metrics Quality  
filterlt10_010-aa-comp
source location (inputs)
target location (processing)srm.grid.sara.nl
projectlt10_010
activity (API) + status 657122, finished
specification (API) -
creationTime2025-04-15 11:43:14
purge_policyyes
cleanup_policydefining
resumeTrue
is_summaryFalse
stage_request_id788106
dataproducts3
size_to_process177.3 GB
size_processed49.0 GB
total_processing_time19200
qualitymoderate
calculated qualities{'per_task': ['poor']}
remarks{'quality_sasid': 'One RS with 100% data loss. Busy RFI profile, especially at high frequencies. Validated moderate to look into further.'}

Log Entries

servicestepstatustimestampcpu_cycleswall_clock_timelog
ARCHIVERSuccessfinished05-02-2025, 10:25:44None81749
ARCHIVERcleaningfinishing05-02-2025, 10:24:11None81656
ARCHIVERSuccessarchived05-02-2025, 10:24:10None81655
ARCHIVERingestedarchiving05-02-2025, 10:23:50None81635
ARCHIVERsubmittingarchiving05-02-2025, 09:50:57None79662
ARCHIVERsubmittingarchiving05-02-2025, 09:50:55None79660
ARCHIVERsubmittingarchiving05-02-2025, 09:50:54None79659
ARCHIVERNAarchived_failed04-24-2025, 04:20:46None59851Task is too long in archiving state
ARCHIVERsubmittingarchiving04-24-2025, 04:00:55None58660
ARCHIVERsubmittingarchiving04-24-2025, 04:00:54None58659
ARCHIVERsubmittingarchiving04-24-2025, 04:00:52None58657
ARCHIVERauto_recoverypre_archived04-24-2025, 04:00:21None58626Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived04-24-2025, 04:00:20None58625Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived04-24-2025, 04:00:19None58624Force to retry due to status FAILED retrieved from FTS
ARCHIVERsubmittingarchiving04-24-2025, 03:39:55None57400
ARCHIVERsubmittingarchiving04-24-2025, 03:39:54None57399
ARCHIVERsubmittingarchiving04-24-2025, 03:39:52None57397
ARCHIVERauto_recoverypre_archived04-24-2025, 03:39:22None57367Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived04-24-2025, 03:39:21None57366Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived04-24-2025, 03:39:20None57365Force to retry due to status FAILED retrieved from FTS
ARCHIVERsubmittingarchiving04-22-2025, 16:55:21None18726
ARCHIVERsubmittingarchiving04-22-2025, 16:55:19None18724
ARCHIVERsubmittingarchiving04-22-2025, 16:55:18None18723
PREARCHIVERSIP createdpre_archived04-22-2025, 16:54:54None18699
PREARCHIVERsubmittingpre_archiving04-22-2025, 16:54:07None18652
PREARCHIVERunknown errorpre_archived_failed04-22-2025, 11:27:10None85435HTTPSConnectionPool(host='lofar.astron.nl', port=443): Max retries exceeded with url: /useradministration/user/systemlogin.do (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has
PREARCHIVERsubmittingpre_archiving04-22-2025, 11:27:08None85433
STAGERSTAGERscrubbed04-22-2025, 11:10:27None84432
STAGERSTAGERscrubbing04-22-2025, 11:09:38None84383
DATAMANAGERcopy_finishedstored04-18-2025, 18:21:58None23923
DATAMANAGERcopy_issuedstoring04-18-2025, 18:19:19None23764
DATAMANAGERissuing_copyingstoring04-18-2025, 18:18:58None23743
AGGREGATORcollected H5processed04-18-2025, 18:18:30None23715
AGGREGATORcollect_h5aggregating04-18-2025, 18:18:28None23713
EXECUTORrunningprocessed04-18-2025, 18:18:14None19200None
EXECUTORrunningprocessing04-18-2025, 17:34:58None21103logfile
DATAMANAGERcopy_skippedfetched04-18-2025, 17:34:12None21057
STAGERSTAGERstaged04-18-2025, 17:34:05None21050None
STAGERSTAGERstaging04-18-2025, 08:58:17None76502None