Task: 399846 (regular)

id (api)399846
typeregular
slurm jobs (api)jobs for task 399846 {'finished': 7}
priority 100
statusfinished
workflow 29 - aggregated_compress_pipeline
 inputs    outputs    metrics Quality  
filterlt10_010-aa-comp
source location (inputs)
target location (processing)srm.grid.sara.nl
projectlt10_010
activity (API) + status 657122, finished
specification (API) -
creationTime2025-04-15 11:43:05
purge_policyyes
cleanup_policydefining
resumeTrue
is_summaryFalse
stage_request_id788091
dataproducts3
size_to_process177.3 GB
size_processed49.0 GB
total_processing_time18888
qualitymoderate
calculated qualities{'per_task': ['poor']}
remarks{'quality_sasid': 'One RS with 100% data loss. Busy RFI profile, especially at high frequencies. Validated moderate to look into further.'}

Log Entries

servicestepstatustimestampcpu_cycleswall_clock_timelog
ARCHIVERSuccessfinished05-02-2025, 09:53:42None79836
ARCHIVERcleaningfinishing05-02-2025, 09:53:23None79817
ARCHIVERSuccessarchived05-02-2025, 09:53:22None79816
ARCHIVERingestedarchiving05-02-2025, 09:53:07None79801
ARCHIVERsubmittingarchiving05-02-2025, 09:30:15None78429
ARCHIVERsubmittingarchiving05-02-2025, 09:30:14None78428
ARCHIVERsubmittingarchiving05-02-2025, 09:30:13None78427
ARCHIVERNAarchived_failed04-23-2025, 17:54:31None22285Task is too long in archiving state
ARCHIVERsubmittingarchiving04-23-2025, 17:36:15None21189
ARCHIVERauto_recoverypre_archived04-23-2025, 17:35:45None21159Force to retry due to status FAILED retrieved from FTS
ARCHIVERsubmittingarchiving04-23-2025, 17:35:39None21153
ARCHIVERsubmittingarchiving04-23-2025, 17:35:38None21152
ARCHIVERauto_recoverypre_archived04-23-2025, 17:35:07None21121Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived04-23-2025, 17:35:06None21120Force to retry due to status FAILED retrieved from FTS
ARCHIVERsubmittingarchiving04-23-2025, 17:14:45None19899
ARCHIVERsubmittingarchiving04-23-2025, 17:14:44None19898
ARCHIVERsubmittingarchiving04-23-2025, 17:14:42None19896
ARCHIVERauto_recoverypre_archived04-23-2025, 17:14:12None19866Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived04-23-2025, 17:14:11None19865Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived04-23-2025, 17:14:10None19864Force to retry due to status FAILED retrieved from FTS
ARCHIVERsubmittingarchiving04-22-2025, 16:40:31None17845
ARCHIVERsubmittingarchiving04-22-2025, 16:40:30None17844
ARCHIVERsubmittingarchiving04-22-2025, 16:40:29None17843
PREARCHIVERSIP createdpre_archived04-22-2025, 16:40:03None17817
PREARCHIVERsubmittingpre_archiving04-22-2025, 16:39:16None17770
PREARCHIVERunknown errorpre_archived_failed04-22-2025, 11:23:50None85244HTTPSConnectionPool(host='lofar.astron.nl', port=443): Max retries exceeded with url: /useradministration/user/systemlogin.do (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has
PREARCHIVERsubmittingpre_archiving04-22-2025, 11:23:48None85242
STAGERSTAGERscrubbed04-22-2025, 11:10:17None84431
STAGERSTAGERscrubbing04-22-2025, 11:09:28None84382
DATAMANAGERcopy_finishedstored04-18-2025, 18:49:34None25588
DATAMANAGERcopy_issuedstoring04-18-2025, 18:46:21None25395
DATAMANAGERissuing_copyingstoring04-18-2025, 18:46:04None25378
AGGREGATORcollected H5processed04-18-2025, 18:45:19None25333
AGGREGATORcollect_h5aggregating04-18-2025, 18:45:18None25332
EXECUTORrunningprocessed04-18-2025, 18:45:13None18888None
EXECUTORrunningprocessing04-18-2025, 18:03:42None22836logfile
DATAMANAGERcopy_skippedfetched04-18-2025, 18:03:31None22825
STAGERSTAGERstaged04-18-2025, 18:02:41None22775None
STAGERSTAGERstaging04-18-2025, 08:57:55None76489None