Task: 399884 (regular)

id (api)399884
typeregular
slurm jobs (api)jobs for task 399884 {'finished': 7}
priority 100
statusfinished
workflow 29 - aggregated_compress_pipeline
 inputs    outputs    metrics Quality  
filterlt10_010-aa-comp
source location (inputs)
target location (processing)srm.grid.sara.nl
projectlt10_010
activity (API) + status 657122, finished
specification (API) -
creationTime2025-04-15 11:43:24
purge_policyyes
cleanup_policydefining
resumeTrue
is_summaryFalse
stage_request_id788129
dataproducts3
size_to_process177.3 GB
size_processed49.1 GB
total_processing_time18864
qualitymoderate
calculated qualities{'per_task': ['poor']}
remarks{'quality_sasid': 'One RS with 100% data loss. Busy RFI profile, especially at high frequencies. Validated moderate to look into further.'}

Log Entries

servicestepstatustimestampcpu_cycleswall_clock_timelog
ARCHIVERSuccessfinished05-01-2025, 19:56:10None29565
ARCHIVERcleaningfinishing05-01-2025, 19:55:51None29546
ARCHIVERSuccessarchived05-01-2025, 19:55:49None29544
ARCHIVERingestedarchiving05-01-2025, 19:54:54None29489
ARCHIVERsubmittingarchiving05-01-2025, 19:53:04None29379
ARCHIVERsubmittingarchiving05-01-2025, 19:53:02None29377
ARCHIVERsubmittingarchiving05-01-2025, 19:53:01None29376
ARCHIVERauto_recoverypre_archived05-01-2025, 19:52:31None29346Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived05-01-2025, 19:52:30None29345Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived05-01-2025, 19:52:29None29344Force to retry due to status FAILED retrieved from FTS
ARCHIVERsubmittingarchiving04-22-2025, 17:18:32None20107
ARCHIVERsubmittingarchiving04-22-2025, 17:18:31None20106
ARCHIVERsubmittingarchiving04-22-2025, 17:18:29None20104
PREARCHIVERSIP createdpre_archived04-22-2025, 17:18:09None20084
PREARCHIVERsubmittingpre_archiving04-22-2025, 17:17:22None20037
PREARCHIVERunknown errorpre_archived_failed04-22-2025, 11:32:13None85728HTTPSConnectionPool(host='lofar.astron.nl', port=443): Max retries exceeded with url: /useradministration/user/systemlogin.do (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has
PREARCHIVERsubmittingpre_archiving04-22-2025, 11:32:12None85727
STAGERSTAGERscrubbed04-22-2025, 11:10:39None84434
STAGERSTAGERscrubbing04-22-2025, 11:09:50None84385
DATAMANAGERcopy_finishedstored04-18-2025, 19:22:51None27566
DATAMANAGERcopy_issuedstoring04-18-2025, 19:20:18None27413
DATAMANAGERissuing_copyingstoring04-18-2025, 19:20:01None27396
AGGREGATORcollected H5processed04-18-2025, 19:19:07None27342
AGGREGATORcollect_h5aggregating04-18-2025, 19:19:06None27341
EXECUTORrunningprocessed04-18-2025, 19:19:02None18864None
EXECUTORrunningprocessing04-18-2025, 18:39:16None24951logfile
DATAMANAGERcopy_skippedfetched04-18-2025, 18:32:44None24559
STAGERSTAGERstaged04-18-2025, 18:32:14None24529None
STAGERSTAGERstaging04-18-2025, 08:58:43None76518None