justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 262948.54@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID262948.54@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3455
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 06:17:55
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce01
Last heartbeat2024-09-26 08:58:49
From worker nodeHostnameccwcondor0789
cpuinfoAMD EPYC 7453 28-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit106200 (29 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 06:23:17
Input fileshd-protodune:np04hd_raw_run029109_0671_dataflow3_datawriter_0_20240910T041719.hdf5
JobscriptExit code0
Real time1h (3985s)
CPU time1h (3816s = 95%)
Outputting started2024-09-26 07:29:43
Output fileshd-protodune-det-reco:np04hd_raw_run029109_0671_dataflow3_datawriter_0_20240910T041719_reco_stage1_reco_stage2_20240926T072930_keepup.root
hd-protodune-det-reco:np04hd_raw_run029109_0671_dataflow3_datawriter_0_20240910T041719_reco_stage1_reco_stage2_20240926T072930_keepup_hists.root
Finished2024-09-26 08:58:49
Saved logsjustin-logs:262948.54-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ping as is
Retagger: tagging trace set: wiener with 52532 traces, 52532 summary
Retagger: tagging trace set: gauss with 39089 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 39089 traces tagged "gauss"
FrameSaver: q=796003 n=742858 tag=gauss
wclsFrameSaver: saving 52532 traces tagged "wiener"
FrameSaver: q=845333 n=666263 tag=wiener
3076 hits in TPC 0
2478 hits in TPC 1
5195 hits in TPC 2
1477 hits in TPC 3
3807 hits in TPC 4
6176 hits in TPC 5
4729 hits in TPC 6
855 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 40 XUs and 61 XVs -> 1 XUVs
C:0 T:2 14984 XUs and 22968 XVs -> 1157 XUVs
C:0 T:3 88 XUs and 140 XVs -> 5 XUVs
C:0 T:4 32 XUs and 97 XVs -> 0 XUVs
C:0 T:5 30102 XUs and 64192 XVs -> 2085 XUVs
C:0 T:6 17072 XUs and 23510 XVs -> 1125 XUVs
C:0 T:7 78 XUs and 87 XVs -> 2 XUVs
4375 XUVs total
1466 collection wire objects
4375 potential space points
Neighbour search...
392647 tests to find 205274 neighbours
Iterating with no regularization...
Begin: 4.89168e+06
0 4.34277e+06
1 4.3097e+06
2 4.3055e+06
Now with regularization...
Begin: 3.97457e+06
0 3.97309e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

26-Sep-2024 09:29:30 CEST  Closed output file "np04hd_raw_run029109_0671_dataflow3_datawriter_0_20240910T041719_reco_stage1_reco_stage2_20240926T072930_keepup.root"
26-Sep-2024 09:29:30 CEST  Closed input file "np04hd_raw_run029109_0671_dataflow3_datawriter_0_20240910T041719_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              71.6695       97.4474       150.454       92.8437       19.4461        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000605521   0.00303294    0.00489742    0.00346095     0.0013151       30     
produce:fembfilter:PDHDFEMBFilter                       0.49739      0.653739      0.775605      0.660435      0.082607        30     
produce:wclsdatahd:WireCellToolkit                      33.4467       39.7596       45.3868        40.15        2.9189         30     
produce:gaushit:GausHitFinder                          0.379676      0.680671       1.26301      0.669695      0.203846        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000227105   0.000348634   0.000632021   0.000335972   8.31174e-05      30     
produce:reco3d:SpacePointSolver                        0.188291       1.05735       3.79643      0.812187      0.847407        30     
produce:hitpdune:DisambigFromSpacePoints               0.142817      0.549293       1.48792      0.492934       0.32954        30     
produce:pandora:StandardPandora                         5.09688       12.8639       35.587         10.51        6.65506        30     
produce:pandoraWriter:StandardPandora                  0.0915273     0.163059      0.258489      0.160396      0.0386135       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.588972       1.78357       3.55408       1.66131      0.777016        30     
produce:pandoraShower:LArPandoraShowerCreation          0.55035       2.37461       6.60801       2.11225       1.39621        30     
produce:pandoracalo:Calorimetry                        0.285525       0.87802       2.10799      0.836393      0.375369        30     
produce:pandoracalonosce:Calorimetry                   0.276293      0.811608        1.876       0.722288      0.375259        30     
produce:pandorapid:Chi2ParticleID                     0.00120745    0.00207109    0.00380805    0.00202433    0.000595867      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.573424       1.97462       5.28625       1.72034       1.16738        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.498169       1.89169       5.1016        1.72787       1.04909        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0678006     0.140927      0.249097      0.141176      0.0408876       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0248576     0.0532554     0.0923201     0.0501953     0.0172307       30     
produce:emtrkmichelid:EmTrackMichelId                   22.0543       30.069        47.9604       28.7011       6.45674        30     
[art]:TriggerResults:TriggerResultInserter            3.7721e-05    6.99623e-05   0.000140292   6.8583e-05    1.87807e-05      30     
end_path:out1:RootOutput                               8.767e-06    1.9272e-05    6.6444e-05    1.80285e-05   9.41685e-06      30     
end_path:michelremoving:michelremoving                 0.020157      0.0914776     0.250877      0.0621128     0.0600064       30     
end_path:michelremovinggnocchi:michelremoving          0.0251847     0.0828219     0.241517      0.0529406     0.0558036       30     
end_path:calibanagnocchi:CalibAnaTree                  0.239379      0.586217       1.39972      0.531807      0.238737        30     
end_path:out1:RootOutput(write)                        0.437748      0.746142       1.19282      0.752396      0.175475        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4954.57 MB
  Peak resident set size usage (VmHWM): 2370.49 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029109_0671_dataflow3_datawriter_0_20240910T041719_reco_stage1_reco_stage2_20240926T072930_keepup.root
\tHists: np04hd_raw_run029109_0671_dataflow3_datawriter_0_20240910T041719_reco_stage1_reco_stage2_20240926T072930_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029109_0671_dataflow3_datawriter_0_20240910T041719_reco_stage1_reco_stage2_20240926T072930_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029109_0671_dataflow3_datawriter_0_20240910T041719_reco_stage1_reco_stage2_20240926T072930_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727332800.0,
    "core.end_time": 1727335771.0,
    "core.events": [
      161083,
      161091,
      161099,
      161107,
      161115,
      161123,
      161131,
      161139,
      161147,
      161155,
      161163,
      161171,
      161179,
      161187,
      161195,
      161203,
      161211,
      161219,
      161227,
      161235,
      161243,
      161251,
      161259,
      161267,
      161275,
      161283,
      161291,
      161299,
      161323,
      161331
    ],
    "core.event_count": 30,
    "core.first_event_number": 161083,
    "core.last_event_number": 161331,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29109
    ],
    "core.runs_subruns": [
      2910900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029109_0671_dataflow3_datawriter_0_20240910T041719.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029109_0671_dataflow3_datawriter_0_20240910T041719_reco_stage1_reco_stage2_20240926T072930_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727332800.0,
    "core.end_time": 1727335771.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29109
    ],
    "core.runs_subruns": [
      2910900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029109_0671_dataflow3_datawriter_0_20240910T041719.hdf5"
    }
  ]
}
justIN time: 2024-09-29 11:23:32 UTC       justIN version: 01.01.08