/trunk/src Developers: dav

Login name:
dav
Total Commits:
802 (6.8%)
Lines of Code:
28,927 (17.2%)
Most Recent Commit:
2014-12-26 21:01
Tweet this:
Tweet this

Activity by Clock Time

Activity by Hour of Day for dav

Activity by Day of Week for dav

Activity in Directories

Directory Changes Lines of Code Lines per Change
Totals 802 (100.0%) 28927 (100.0%) 36.0
CCA/Components/Wasatch/Transport/ 73 (9.1%) 10978 (38.0%) 150.3
/ 60 (7.5%) 4701 (16.3%) 78.3
Core/DataArchive/ 11 (1.4%) 1591 (5.5%) 144.6
Core/Grid/ 37 (4.6%) 1517 (5.2%) 41.0
CCA/Components/Schedulers/ 59 (7.4%) 1485 (5.1%) 25.1
CCA/Components/SimulationController/ 18 (2.2%) 1190 (4.1%) 66.1
CCA/Components/LoadBalancers/ 39 (4.9%) 962 (3.3%) 24.6
Core/Containers/ 10 (1.2%) 808 (2.8%) 80.8
Core/ProblemSpec/ 10 (1.2%) 796 (2.8%) 79.6
CCA/Components/DataArchiver/ 16 (2.0%) 761 (2.6%) 47.5
Core/Util/ 23 (2.9%) 649 (2.2%) 28.2
Core/OS/ 14 (1.7%) 386 (1.3%) 27.5
StandAlone/ 29 (3.6%) 264 (0.9%) 9.1
CCA/Components/Solvers/ 15 (1.9%) 238 (0.8%) 15.8
StandAlone/tools/extractors/ 16 (2.0%) 203 (0.7%) 12.6
Core/Geometry/ 12 (1.5%) 151 (0.5%) 12.5
Core/Parallel/ 6 (0.7%) 146 (0.5%) 24.3
CCA/Components/ProblemSpecification/ 8 (1.0%) 136 (0.5%) 17.0
Core/Grid/Variables/ 7 (0.9%) 115 (0.4%) 16.4
Core/Datatypes/ 33 (4.1%) 109 (0.4%) 3.3
CCA/Ports/ 15 (1.9%) 109 (0.4%) 7.2
CCA/Components/Wasatch/Expressions/BoundaryConditions/ 3 (0.4%) 102 (0.4%) 34.0
CCA/Components/Arches/ 22 (2.7%) 92 (0.3%) 4.1
CCA/Components/Arches/Radiation/ 9 (1.1%) 86 (0.3%) 9.5
CCA/Components/Parent/ 11 (1.4%) 81 (0.3%) 7.3
Core/Disclosure/ 2 (0.2%) 80 (0.3%) 40.0
include/sci_defs/ 8 (1.0%) 65 (0.2%) 8.1
CCA/Components/Examples/ 5 (0.6%) 61 (0.2%) 12.2
Core/Math/ 4 (0.5%) 58 (0.2%) 14.5
StandAlone/tools/puda/ 21 (2.6%) 54 (0.2%) 2.5
Core/Exceptions/ 13 (1.6%) 51 (0.2%) 3.9
StandAlone/tools/ 4 (0.5%) 43 (0.1%) 10.7
Core/Thread/ 9 (1.1%) 40 (0.1%) 4.4
Core/IO/ 6 (0.7%) 38 (0.1%) 6.3
CCA/Components/Wasatch/Expressions/ 4 (0.5%) 38 (0.1%) 9.5
CCA/Components/ReduceUda/ 3 (0.4%) 37 (0.1%) 12.3
build_scripts/ 2 (0.2%) 33 (0.1%) 16.5
CCA/Components/Solvers/AMR/ 5 (0.6%) 29 (0.1%) 5.8
CCA/Components/Regridder/ 9 (1.1%) 29 (0.1%) 3.2
CCA/Components/MPM/ConstitutiveModel/fortran/ 5 (0.6%) 29 (0.1%) 5.8
CCA/Components/OnTheFlyAnalysis/ 3 (0.4%) 26 (0.1%) 8.6
CCA/Components/Arches/Radiation/fortran/ 5 (0.6%) 24 (0.1%) 4.8
Core/Grid/BoundaryConditions/ 2 (0.2%) 23 (0.1%) 11.5
CCA/Components/Models/Radiation/fortran/ 2 (0.2%) 23 (0.1%) 11.5
CCA/Components/MPMArches/fortran/ 2 (0.2%) 23 (0.1%) 11.5
CCA/Components/Arches/fortran/ 2 (0.2%) 23 (0.1%) 11.5
testprograms/Thread/ 4 (0.5%) 22 (0.1%) 5.5
CCA/Components/SwitchingCriteria/ 2 (0.2%) 21 (0.1%) 10.5
testprograms/TestMatrix3/ 2 (0.2%) 18 (0.1%) 9.0
StandAlone/tools/mpi_test/ 2 (0.2%) 18 (0.1%) 9.0
StandAlone/tools/fsspeed/ 2 (0.2%) 18 (0.1%) 9.0
CCA/Components/ 2 (0.2%) 18 (0.1%) 9.0
testprograms/Malloc/ 2 (0.2%) 17 (0.1%) 8.5
testprograms/CubeRootTest/ 2 (0.2%) 17 (0.1%) 8.5
CCA/Components/Arches/SourceTerms/ 3 (0.4%) 16 (0.1%) 5.3
CCA/Components/Arches/Transport/ 1 (0.1%) 15 (0.1%) 15.0
testprograms/TestFastMatrix/ 2 (0.2%) 13 (0.0%) 6.5
CCA/Components/Arches/TransportEqns/ 2 (0.2%) 13 (0.0%) 6.5
testprograms/RegionTest/ 2 (0.2%) 12 (0.0%) 6.0
StandAlone/tools/pfs/ 5 (0.6%) 12 (0.0%) 2.4
testprograms/PatchBVH/ 2 (0.2%) 11 (0.0%) 5.5
testprograms/IteratorTest/ 2 (0.2%) 11 (0.0%) 5.5
StandAlone/tools/tracker/ 2 (0.2%) 11 (0.0%) 5.5
StandAlone/tools/graphview/ 2 (0.2%) 11 (0.0%) 5.5
StandAlone/tools/dumpfields/ 2 (0.2%) 11 (0.0%) 5.5
Core/Malloc/ 1 (0.1%) 11 (0.0%) 11.0
testprograms/Regridders/ 1 (0.1%) 10 (0.0%) 10.0
testprograms/BNRRegridder/ 2 (0.2%) 10 (0.0%) 5.0
testprograms/ 1 (0.1%) 10 (0.0%) 10.0
StandAlone/tools/compare_mms/ 2 (0.2%) 10 (0.0%) 5.0
StandAlone/Benchmarks/ 2 (0.2%) 10 (0.0%) 5.0
CCA/Components/Arches/ChemMix/ 3 (0.4%) 10 (0.0%) 3.3
CCA/Components/Wasatch/Operators/ 2 (0.2%) 9 (0.0%) 4.5
CCA/Components/Models/Radiation/ 2 (0.2%) 9 (0.0%) 4.5
CCA/Components/Wasatch/Expressions/Turbulence/ 2 (0.2%) 8 (0.0%) 4.0
CCA/Components/Wasatch/Expressions/PBE/ 2 (0.2%) 8 (0.0%) 4.0
CCA/Components/Models/ 4 (0.5%) 8 (0.0%) 2.0
include/ 2 (0.2%) 7 (0.0%) 3.5
CCA/Components/Arches/PropertyModels/ 4 (0.5%) 7 (0.0%) 1.7
CCA/Components/Arches/PropertyModelsV2/ 6 (0.7%) 6 (0.0%) 1.0
CCA/Components/Wasatch/ 5 (0.6%) 5 (0.0%) 1.0
CCA/Components/Models/Radiation/RMCRT/ 2 (0.2%) 5 (0.0%) 2.5
Core/Persistent/ 6 (0.7%) 4 (0.0%) 0.6
CCA/Components/Arches/CoalModels/ 6 (0.7%) 4 (0.0%) 0.6
tools/StackTrace/ 2 (0.2%) 3 (0.0%) 1.5
Core/Tracker/ 3 (0.4%) 2 (0.0%) 0.6
CCA/Components/MPM/ 2 (0.2%) 2 (0.0%) 1.0
CCA/Components/Wasatch/Expressions/EmbeddedGeometry/ 2 (0.2%) 1 (0.0%) 0.5
Core/GeometryPiece/ 4 (0.5%) 0 (0.0%) 0.0
CCA/Components/Wasatch/transport/ 15 (1.9%) 0 (0.0%) 0.0
CCA/Components/Solvers/AMR/HyprePreconds/ 2 (0.2%) 0 (0.0%) 0.0
CCA/Components/Models/Radiation/floatRMCRT/ 2 (0.2%) 0 (0.0%) 0.0

Activity of dav

Most Recent Commits

dav 2014-12-26 21:01 Rev.: 52897

Reverting code to r52880 before my memory use fix commit. While most tests passed, the ones using AMR and the dynamic load balancer were not passing and the weeds are too deep within them to quickly figure out what is causing the problems. Next week I will attempt to figure out what is going on with them. My guess is that it will take quite a bit of effort to understand the inner workings of the dynamic loadbalancer in order to get everything to work, so it may be quite a while before this fix may go in.

4414 lines of code changed in 193 files:

  • CCA/Components/Arches: Arches.cc (-5), ArchesConstVariables.h (-1)
  • CCA/Components/Arches/CoalModels: BT.cc (del), BTDevol.h (del), EnthalpyShaddix.cc (+3 -7), HeatTransfer.cc (-3), HeatTransfer.h (+1 -1), sub.mk (-1)
  • CCA/Components/Arches/PropertyModels: PropertyModelBase.cc (+1 -14), RadProperties.cc (+5 -7)
  • CCA/Components/Arches/PropertyModelsV2: CoalTemperature.cc (+6 -39), CoalTemperature.h (-11), ConstEnvProperty.cc (del), ConstEnvProperty.h (del), PropertyModelFactoryV2.cc (-14), sub.mk (-1)
  • CCA/Components/Arches/Radiation: DORadiationModel.cc (+35 -155), DORadiationModel.h (+11 -40), RadHypreSolver.cc (+13 -4), RadPropertyCalculator.cc (+1 -201), RadPropertyCalculator.h (-45)
  • CCA/Components/Arches/Radiation/fortran: hottel.F (+1 -1), rdomsolve.F (+16 -15), rdomsolve.fspec (+5 -4), rdomsrcscattering.F (+1 -2), rdomsrcscattering.fspec (+1 -2)
  • CCA/Components/Arches/SourceTerms: DORadiation.cc (+9 -30), DORadiation.h (-2)
  • CCA/Components/DataArchiver: DataArchiver.cc (new), DataArchiver.h (+25 -28)
  • CCA/Components/LoadBalancers: CostModelForecaster.cc (+60 -66), CostModeler.h (+5 -3), CostProfiler.cc (+4 -2), DynamicLoadBalancer.cc (+167 -70), DynamicLoadBalancer.h (+36 -25), LoadBalancerCommon.cc (+57 -134), LoadBalancerCommon.h (new), ParticleLoadBalancer.cc (+123 -20), ParticleLoadBalancer.h (new), ProfileDriver.cc (new), SingleProcessorLoadBalancer.h (new)
  • CCA/Components/Parent: Switcher.cc (new)
  • CCA/Components/ProblemSpecification: ProblemSpecReader.cc (new), ProblemSpecReader.h (new)
  • CCA/Components/Regridder: RegridderCommon.cc (new), SingleLevelRegridder.cc (+2 -2), TiledRegridder.cc (new)
  • CCA/Components/Schedulers: DWDatabase.h (new), DetailedTasks.cc (new), DetailedTasks.h (+104 -94), MPIScheduler.cc (new), OnDemandDataWarehouse.cc (new), SchedulerCommon.cc (+17 -16), TaskGraph.cc (new), TaskGraph.h (+28 -23)
  • CCA/Components/SimulationController: AMRSimulationController.cc (+55 -55), SimulationController.cc (+47 -46)
  • CCA/Components/Solvers/AMR: AMRSolver.cc (new)
  • CCA/Components/Wasatch/Expressions: BasicExprBuilder.cc (+23 -22)
  • CCA/Components/Wasatch/Expressions/BoundaryConditions: BoundaryConditions.h (+57 -42), VardenMMSBCs.cc (+8 -10), VardenMMSBCs.h (+37 -36)
  • CCA/Components/Wasatch/Transport: ScalarTransportEquation.cc (+1 -1)
  • CCA/Ports: LoadBalancer.h (new), Output.h (new), ProblemSpecInterface.h (new)
  • Core/Containers: HashTable.h (new), StringUtil.cc (new 610), StringUtil.h (new 188), sub.mk (new)
  • Core/DataArchive: DataArchive.cc (new), DataArchive.h (new)
  • Core/Geometry: IntVector.cc (+2 -32), IntVector.h (new), Vector.cc (+7 -38), Vector.h (new)
  • Core/Grid: Grid.cc (+49 -455), Grid.h (new), Level.cc (new), Level.h (new), Patch.cc (+69 -74), Patch.h (new), SimulationState.cc (new), SimulationState.h (+18 -19), SimulationTime.cc (new), Task.cc (+198 -255)
  • Core/OS: Dir.cc (+51 -63), Dir.h (+14 -14), Dir_boost.cc (new)
  • Core/Persistent: Persistent.cc (+1 -1), Pstreams.cc (+1 -1)
  • Core/ProblemSpec: ProblemSpec.cc (+126 -73), ProblemSpec.h (+285 -288), sub.mk (new)
  • Core/Tracker: TrackerServer.cc (new)
  • Core/Util: DynamicLoader.cc (new), FileUtils.cc (+1 -2), StringUtil.cc (del), StringUtil.h (del), XMLUtils.cc (del), XMLUtils.h (del), sub.mk (+7 -9)
  • StandAlone: compare_uda.cc (new), partvarRange.cc (new), restart_merger.cc (new), slb.cc (+1 -1), sus.cc (new)
  • StandAlone/tools/extractors: extractF.cc (new), extractV.cc (new), partextract.cc (new)
  • StandAlone/tools/pfs: rawToUniqueGrains.cc (new)
  • StandAlone/tools/puda: PIC.cc (+1 -1), POL.cc (+1 -1), jim1.cc (+3 -3), jim3.cc (+1 -1), puda.cc (new), varsummary.cc (new)
dav 2014-12-26 11:43 Rev.: 52896

Fix so puda will run - some libs now use proc0cout which requires Uintah::Parallel to be initialized (even if we are not running MPI).

5 lines of code changed in 1 file:

  • StandAlone/tools/puda: puda.cc (+5 -1)
dav 2014-12-23 20:17 Rev.: 52889


Finishing cleaning up the memory reduction commit... Main fix
was to add "delete d_archive" back to SimulationController.cc.

M CCA/Components/SimulationController/SimulationController.cc

- Add back in "delete d_archive"... This still needs to be investigated.

M CCA/Components/LoadBalancers/CostProfiler.cc
M CCA/Components/LoadBalancers/DynamicLoadBalancer.cc

- Remove warning: numLevels is unsigned now.
- Cosmetics: coding standard, white space, {}s, etc

M Core/Grid/Patch.cc
M CCA/Components/Schedulers/DWDatabase.h
M CCA/Components/Schedulers/MPIScheduler.cc
M CCA/Components/Schedulers/OnDemandDataWarehouse.cc

- Cosmetics: line up variables, untabify, coding standard, white space, {}s, etc

M CCA/Components/Schedulers/SchedulerCommon.cc

- Remove warning: numLevels is unsigned now.

257 lines of code changed in 8 files:

  • CCA/Components/LoadBalancers: CostProfiler.cc (+2 -4), DynamicLoadBalancer.cc (+48 -45)
  • CCA/Components/Schedulers: DWDatabase.h (+143 -109), MPIScheduler.cc (+12 -10), OnDemandDataWarehouse.cc (+17 -22), SchedulerCommon.cc (+1 -1)
  • CCA/Components/SimulationController: SimulationController.cc (+7 -4)
  • Core/Grid: Patch.cc (+27 -30)
dav 2014-12-23 00:29 Rev.: 52884

Hopefully this fixes errors from the previous larege memory use reduction commit.

M CCA/Components/SimulationController/SimulationController.cc

- I need to investigate the delete of the temporary data archive... Commenting it out for now.

M CCA/Components/DataArchiver/DataArchiver.cc

- White space clean up.
- Removed a releaseDocument() that should not have been there. (The release happens
automatically when the var goes out of scope.)

M Core/Grid/Grid.cc

- Handle periodic boundaries in the input xml file.

65 lines of code changed in 3 files:

  • CCA/Components/DataArchiver: DataArchiver.cc (+45 -43)
  • CCA/Components/SimulationController: SimulationController.cc (+4 -1)
  • Core/Grid: Grid.cc (+16 -8)
dav 2014-12-22 17:18 Rev.: 52883


Two minor fixes to get Mac and GPU builds compiling after previous major commit.

M CCA/Components/Schedulers/DetailedTasks.cc

- Minor fix (variable name change) for GPU only code.

M Core/ProblemSpec/sub.mk

- Remove extra Core/Exceptions. Add needed Core/Math. (Found on Mac)

4 lines of code changed in 2 files:

  • CCA/Components/Schedulers: DetailedTasks.cc (+3 -3)
  • Core/ProblemSpec: sub.mk (+1 -1)
dav 2014-12-22 15:49 Rev.: 52882


This is the first commit (of what may be several over the next month or so) dealing with Uintah's excessive use
of memory with respect to its XML data structures (that are used for I/O) when running on thousands of patches.
This commit specificly addresses the excessive use of memory when restarting a simulation. Before this commit,
Uintah would read in a timestep.xml file (from the checkpoints/t00000/) directory and create an huge DOM
structure in memory. (On 8K patches on Vulcan (BGQ - LLNL) memory per process would increase by 100% (by
20 MB per process on the advect sample problem). On 30K patches, memory use of 200 MB or more has been observed.)
To solve this problem, instead of reading the XML into memory, we parse it on the fly and extract the data we need,
but do not save it. Note, there are two parts of the timestep.xml file that cause the memory issue: the 1000s of
<Grid> and <DataItem> tags. Small XML nodes are not a problem, and thus we still use them for some things (for
example, the component section read from the timestep.xml file. A full DOM of this node is created (during the
streaming read of the rest of the file) and this node is passed down to the component as before.

A number of changes in this commit are cosmetic, dealing with white space and coding standards, and were made
while I was digging through the code to understand where the memory issue was and how to fix it. To better
see real changes in the code, I highly suggest that you use a diff that ignores generic white space changes,
such as:

svn diff --diff-cmd diff --extensions -w <file_name>

Note,asIgetolderInolongercanreadtextlikethis,soIamaddingspacesintothecodetomakeit easier to see. :)

M CCA/Components/SimulationController/AMRSimulationController.cc

- Number of levels in a Grid (grid->numLevels()) cannot be negative and thus should be an unsigned int... it is now.
- Costmetic: English sentences start with capital letters and end with punctuation... yeah yeah I know.

M CCA/Components/SimulationController/SimulationController.cc

- queryGrid: pass through a pointer, don't create a new copy.
- Unsigned int for grid level number.
- Cosmetic white space/coding standards/English updates. Fixed some strange indentation. Untabify.

M CCA/Components/Parent/Switcher.cc

- Unsigned int for grid level number.
- Cosmetic: Swatted some evil endl's. :) (Why write 8 more characters of code, when 2 will do? And makes it easier to add to strings later...)

M CCA/Components/LoadBalancers/ParticleLoadBalancer.cc
M CCA/Components/LoadBalancers/ParticleLoadBalancer.h

- Updates to consolidate code in load balancers... Still needs some direct attention as opposed to this
first pass while working on something else.

M CCA/Components/LoadBalancers/SingleProcessorLoadBalancer.h

- Add 'do-nothing' implementation of restartInitialize() to this class.

M CCA/Components/LoadBalancers/CostModelForecaster.cc

- Cosmetic: Untabbify, white space, {} around one line ifs, English.

M CCA/Components/LoadBalancers/DynamicLoadBalancer.h
M CCA/Components/LoadBalancers/DynamicLoadBalancer.cc

- Moved restartInitialize() (and a number of supporting class d_ variables) into LoadBalancerCommon.
- Cosmetic: Line up variables, untabbify, white space, {} around one line ifs, English.

M CCA/Components/LoadBalancers/ProfileDriver.cc
M CCA/Components/LoadBalancers/CostModeler.h

- grid->numLevels() is now unsigned updates.
- Coding standard cleanups / English / white space.

M CCA/Components/LoadBalancers/LoadBalancerCommon.cc

- Cosmetic: Alphabetize/sort #includes, line up variables, untabbify, white space, {} around one line ifs, English.
- Make global DebugStream variables be less global (made static to file).
- Unsigned int for grid level number.
- Move restartInitialize() from DynamicLoadBalancer and ParticleLoadBalancer (code was exact duplicate in both files) here.

M CCA/Components/Solvers/AMR/AMRSolver.cc

- Cosmetic: White space, line up variables, English.
- Unsigned int for grid level number.

M CCA/Components/DataArchiver/DataArchiver.cc
M CCA/Components/DataArchiver/DataArchiver.h

- Comment added for where next XML memory fix should take place.
- Cosmetic: Alphabetize/sort #includes, line up variables, untabbify, white space, {} around one line ifs, English.

M CCA/Ports/ProblemSpecInterface.h
M CCA/Components/ProblemSpecification/ProblemSpecReader.h
M CCA/Components/ProblemSpecification/ProblemSpecReader.cc

- Created new version of readInputFile() which takes a list of patches that are specific to this processor. However,
I don't think anyone (me?) is using it yet, and I'm actually not convinced that it is the right function to fix
(see comments in code). I'm committing it just in case it turns out that we need it as we fix the rest of the
XML memory bloat issues. However, at that point if it turns out not to be useful, it should be removed.

M CCA/Components/Schedulers/TaskGraph.h
M CCA/Components/Schedulers/TaskGraph.cc

- Add some consistency to the member variable naming in this file. Half the variables use d_, and the other half
have a trailing _, and the third half ;) didn't do either one... sigh. Some examples.

lb -> d_lb
dts_ -> d_dts

- A few cosmetic fixes - variable line up, white space, etc.
- Removed var/matl from lb->getOldProcessorAssignment()... need to verify that this is correct... see above.

M CCA/Components/Schedulers/OnDemandDataWarehouse.cc

- Removed unused parameters to lb->getOldProcessorAssignment(). However, the DynamicLoadBalancer still uses the
version with parameters (though it doesn't really need them either). It is unclear why getOldProcessorAssignment()
is not declared in LoadBalancerCommon common or several of the other Load Balancers, and also unclear which function
is actually being called. This is defined in the LoadBalancer.h in CCA/Ports/. This needs more investigation.

M CCA/Components/Schedulers/DetailedTasks.h
M CCA/Components/Schedulers/DetailedTasks.cc

- Almost all cosmetic, white space, untabbify, lining up vars, English, etc changes.
- Add trailing _ to numPendingInternalDependencies to denote member var.

M CCA/Components/Schedulers/MPIScheduler.cc

- Few cosmetic cleanups.

M CCA/Components/Schedulers/SchedulerCommon.cc
M StandAlone/tools/pfs/rawToUniqueGrains.cc
M StandAlone/tools/puda/PIC.cc
M StandAlone/tools/extractors/extractV.cc
M StandAlone/tools/extractors/extractF.cc
M StandAlone/tools/extractors/partextract.cc
M StandAlone/partvarRange.cc
M StandAlone/tools/puda/jim1.cc
M StandAlone/tools/puda/jim3.cc
M StandAlone/tools/puda/varsummary.cc
M StandAlone/tools/puda/puda.cc
M StandAlone/tools/puda/POL.cc
M StandAlone/slb.cc

- Cosmetic white space fixes.
- numLevels() casts to avoid warnings.

M CCA/Components/Arches/Radiation/RadHypreSolver.cc

- Few cosmetic changes.

M CCA/Components/Regridder/RegridderCommon.cc
M CCA/Components/Regridder/SingleLevelRegridder.cc
M CCA/Components/Regridder/TiledRegridder.cc

- Cosmetic white space fixes.
- numLevels() casts to avoid warnings.

M CCA/Ports/Output.h

- Use const vars when possible.
- White space, English.

M CCA/Ports/LoadBalancer.h

- Cosmetic: Alphabetize/sort #includes, line up variables, untabbify, white space, {} around one line ifs, English.

M Core/OS/Dir.h
M Core/OS/Dir.cc
M Core/OS/Dir_boost.cc

- Use 'const' when variables don't change.
- Cosmetic: line up variables, untabbify, white space, {} around one line ifs, English.
- Don't use "std::" in half the file and not in the other half.

M Core/Grid/Patch.h
M Core/Grid/Patch.cc

- Cosmetic: Line up variables, untabbify, white space, {} around one line ifs, English.

M Core/Grid/Grid.h
M Core/Grid/Grid.cc

- Added readLevelsFromFile(), parseLevelFromFile(), and parseGridFromFile() to parse XML without creating a full DOM.
This provides a 50% memory decrease (per process) on Vulcan (LLNL-BGQ) for 8K processors when restarting the
advect problem. At some point in the future it might be nice to replace my (brute force - straightfoward -
assumes that the input xml file is very well behaved) approach with the streaming reader functions from the
lib xml library. This is not done at this point as it is unclear how well that library will fit into our use
case, how much time it will take to convert to, and the fact that we want to get this pushed out to the users asap.
- Cosmetic: Line up variables, untabbify, white space, {} around one line ifs, English, coding standards.
- numLevels is now an unsigned int.

M Core/Grid/Task.cc

- Cosmetic: Alphabetize/sort #includes, line up variables, untabbify, white space, {} around one line ifs, English.

M Core/Grid/SimulationState.h
M Core/Grid/SimulationState.cc

- Cosmetic: Alphabetize/sort #includes.

M Core/Grid/Level.h
M Core/Grid/Level.cc

- Returned patch from addPatch() is not used anywhere so remove the return type.
- Cosmetic: line up variables, untabbify, white space, {} around one line ifs, English.

M Core/Geometry/Vector.h
M Core/Geometry/Vector.cc

- Added the fromString() function.
- Cosmetic: Alphabetize/sort #includes.

M Core/Geometry/IntVector.h
M Core/Geometry/IntVector.cc

- Added the fromString() function.

M Core/Containers/HashTable.h

- Moved the call to first() into the constructor... Not quite sure what the reason for this is,
but everywhere a HashTable is created, "first()" is immediately called, so it makes sense
to just do it in once place instead of having to do it each time it is used.

D Core/Containers/StringUtil.cc
D Core/Containers/StringUtil.h
A + Core/Util/StringUtil.h
A + Core/Util/StringUtil.cc
M Core/Grid/SimulationTime.cc
M Core/Tracker/TrackerServer.cc
M Core/Persistent/Pstreams.cc
M Core/Persistent/Persistent.cc
M Core/Util/FileUtils.cc

- Moved StringUtil.* to Core/Util/ to all its use in other locations (higher up the build tree).

M Core/Containers/sub.mk

- Untabbify.

M Core/DataArchive/DataArchive.h
M Core/DataArchive/DataArchive.cc

- Rename variables so they are readable, eg: d_tsurl becomes d_ts_path_and_filename, d_tstimes becomes d_ts_times, etc.
- Change a few more functions to parse xml file data on the fly (instead of parsing DOMs), eg: queryEndiannessAndBits()
- Use NULL instead of 0.
- Pass strings as 'const &' instead of copying them every time.
- Cosmetic: Alphabetize/sort #includes, line up variables, untabbify, white space, {} around one line ifs, English.

M Core/ProblemSpec/ProblemSpec.h
M Core/ProblemSpec/ProblemSpec.cc

- Added constructor to take in a string buffer to create a new DOM from. (Use: stream parse an xml file and put the
needed pieces into a string, then turn only that information into a DOM.)
- Added routines to help in the stream parsing of an XML file: findBlock()
- checkForInputError() replaced.
- parseIntVector replaced with fromString() in respective files.

M Core/Util/DynamicLoader.cc

- Alphabetize #includes.

M Core/Util/sub.mk

- Alphabetize

A Core/Util/XMLUtils.h
A Core/Util/XMLUtils.cc

- Added new helper functions for parsing xml files on the fly.

M StandAlone/compare_uda.cc

- Cosmetic: Alphabetize/sort #includes, line up variables, untabbify, white space, {} around one line ifs, English.
- numLevels() is unsigned now.
- Bulletproofing - verify input args are actually directories.

M StandAlone/restart_merger.cc

- Minor cosmetic fixes.

M StandAlone/sus.cc

- Bulletproofing - catch case when user accidentally runs sus with a UDA and not a UPS.

4453 lines of code changed in 82 files:

  • CCA/Components/Arches/Radiation: RadHypreSolver.cc (+4 -13)
  • CCA/Components/DataArchiver: DataArchiver.cc (+211 -179), DataArchiver.h (+28 -25)
  • CCA/Components/LoadBalancers: CostModelForecaster.cc (+66 -60), CostModeler.h (+3 -5), DynamicLoadBalancer.cc (+22 -122), DynamicLoadBalancer.h (+25 -36), LoadBalancerCommon.cc (+134 -57), LoadBalancerCommon.h (+23 -2), ParticleLoadBalancer.cc (+20 -123), ParticleLoadBalancer.h (-21), ProfileDriver.cc (+14 -14), SingleProcessorLoadBalancer.h (+6)
  • CCA/Components/Parent: Switcher.cc (+26 -25)
  • CCA/Components/ProblemSpecification: ProblemSpecReader.cc (+103 -13), ProblemSpecReader.h (+17 -3)
  • CCA/Components/Regridder: RegridderCommon.cc (+10 -8), SingleLevelRegridder.cc (+2 -2), TiledRegridder.cc (+3 -4)
  • CCA/Components/Schedulers: DetailedTasks.cc (+137 -121), DetailedTasks.h (+94 -104), MPIScheduler.cc (+8 -10), OnDemandDataWarehouse.cc (+5 -5), SchedulerCommon.cc (+15 -16), TaskGraph.cc (+171 -152), TaskGraph.h (+23 -28)
  • CCA/Components/SimulationController: AMRSimulationController.cc (+55 -55), SimulationController.cc (+41 -48)
  • CCA/Components/Solvers/AMR: AMRSolver.cc (+4 -3)
  • CCA/Ports: LoadBalancer.h (+23 -18), Output.h (+3 -4), ProblemSpecInterface.h (+9 -3)
  • Core/Containers: HashTable.h (+3 -2), StringUtil.cc (del), StringUtil.h (del), sub.mk (+2 -3)
  • Core/DataArchive: DataArchive.cc (+611 -554), DataArchive.h (+196 -174)
  • Core/Geometry: IntVector.cc (+32 -2), IntVector.h (+32 -38), Vector.cc (+38 -7), Vector.h (+2)
  • Core/Grid: Grid.cc (+447 -49), Grid.h (+18 -9), Level.cc (+132 -72), Level.h (+30 -35), Patch.cc (+47 -39), Patch.h (+11 -15), SimulationState.cc (+10 -9), SimulationState.h (+19 -18), SimulationTime.cc (+1 -2), Task.cc (+255 -198)
  • Core/OS: Dir.cc (+63 -51), Dir.h (+14 -14), Dir_boost.cc (+51 -47)
  • Core/Persistent: Persistent.cc (+1 -1), Pstreams.cc (+1 -1)
  • Core/ProblemSpec: ProblemSpec.cc (+73 -126), ProblemSpec.h (+288 -285)
  • Core/Tracker: TrackerServer.cc (+1 -1)
  • Core/Util: DynamicLoader.cc (+3 -3), FileUtils.cc (+2 -1), StringUtil.cc (new 310), StringUtil.h (new 96), XMLUtils.cc (new 127), XMLUtils.h (new 76), sub.mk (+9 -7)
  • StandAlone: compare_uda.cc (+95 -54), partvarRange.cc (+5 -5), restart_merger.cc (+6 -6), slb.cc (+1 -1), sus.cc (+20 -6)
  • StandAlone/tools/extractors: extractF.cc (+5 -5), extractV.cc (+1 -1), partextract.cc (+3 -3)
  • StandAlone/tools/pfs: rawToUniqueGrains.cc (+1 -1)
  • StandAlone/tools/puda: PIC.cc (+1 -1), POL.cc (+1 -1), jim1.cc (+3 -3), jim3.cc (+1 -1), puda.cc (+3 -3), varsummary.cc (+1 -1)
dav 2014-12-11 17:53 Rev.: 52808

M ProblemSpec/ProblemSpec.cc

Remove bizarre code fragment that seems to do nothing... And yes, I
did run 'svn blame' and know who you are... ;)

0 lines of code changed in 1 file:

  • Core/ProblemSpec: ProblemSpec.cc (-4)
dav 2014-11-25 14:34 Rev.: 52760


This fix correctly creates the <restarts> block and places the
<restart ...> into it. I tested this and restarts from old UDAs
continue to work. I think only restart_merger uses the <restarts>
block anyway. Also, this has the benefit of keeping the history
of restarts on an UDA, as before it only showed the very last one.

3 lines of code changed in 1 file:

  • CCA/Components/DataArchiver: DataArchiver.cc (+3 -3)
dav 2014-11-14 15:08 Rev.: 52718

M CCA/Components/Parent/ComponentFactory.cc

- Needed to #include Arches.h (if Arches is specified). Apparently it
was previously brought in indirectly through MPMArches. This fixes
builds where only the Arches component is specified to configure.

M Makefile.in

- Fix informational message on location of svn_info.h

0 lines of code changed in 4 files:

  • Makefile.in (new)
  • CCA/Components/Parent: ComponentFactory.cc (new)
dav 2014-11-14 11:36 Rev.: 52717

If MPM or Arches is turned off, don't include MPMArches.

4 lines of code changed in 1 file:

  • CCA/Components/Parent: ComponentFactory.cc (+4 -1)
dav 2014-11-13 21:24 Rev.: 52714

- Fixes for OP X Yosemite and a few minor other fixes. Tested on old OSX and 3 flavors of Linux including GPUs.

M configure.ac
M configure

- Fix excess spew from clang compiler during configure.
- Check for version 14 of OS x (Yosemite).
- Removed 'atlas' check under Darwin as it was actually a blas check.
- Put in checks for Blas and Lapack for old and new (yosemite) OS X.

M aclocal.m4

- Fix shell script output error when used in configure to show the results of `basename $1`.
- Clang compiler uses both stderr and stdout (sigh), and outputs in a different order then
other compilers (for --version). This commit handles this.
- Quote a few variables so that if they are blank, the shell doesn't give warning messages.

M include/sci_defs/blas_testdefs.h.in

- Fix to handle new/old OS X and other OSes in a cleaner manner.

M CCA/Components/Parent/sub.mk

- Arches now uses Boost (in Arches.h), so Parent needs to know to compile against boost.

M CCA/Components/Arches/Arches.h

- Move #if guards for multiple inclusion to the top of file so that the compiler has to do less work.
- Alphabetize #includes so I can see what is there.
- #include boost/shared_prt as it is used in this file.

M CCA/Components/Arches/Transport/URHS.h

- One of our compilers errored on the excessive use of 'typename', so trimmed back a little.

M CCA/Components/Arches/sub.mk

- Remove tabs, lined up, alphabetized, removed old crud.

M Core/Thread/ThreadLock.h

- Move #if guard for multiple inclusion to the top of file so that the compiler has to do less work.
- Fixed spelling in #if guard: Threadlock updated to ThreadLock (capital L).
- Lined things up a little.

M Core/DataArchive/DataArchive.h

- Cosmetic lineup of variables.

M Core/DataArchive/DataArchive.cc

- Cosmetic white space and coding standards update,
don't use "std::" if using "using namespace std".



1161 lines of code changed in 18 files:

  • aclocal.m4 (+9 -6), configure (+1018 -125), configure.ac (new)
  • CCA/Components/Arches: Arches.h (+12 -9), sub.mk (+21 -25)
  • CCA/Components/Arches/Transport: URHS.h (+15 -15)
  • CCA/Components/Parent: sub.mk (+2)
  • Core/DataArchive: DataArchive.cc (+13 -10), DataArchive.h (+2 -2)
  • Core/Thread: ThreadLock.h (+12 -14)
  • include/sci_defs: blas_testdefs.h.in (new)
dav 2014-11-03 16:46 Rev.: 52628

More cosmetic/standards/white space/untabbifying/etc updates I missed in previous commit.

156 lines of code changed in 2 files:

  • CCA/Components/SimulationController: SimulationController.cc (+64 -64), SimulationController.h (+92 -92)
dav 2014-11-03 16:38 Rev.: 52627

Cosmetic/standards/white space/untabbifying/etc updates before digging into code for excess memory usage on restarts.

592 lines of code changed in 2 files:

  • CCA/Components/SimulationController: SimulationController.cc (+561 -531), SimulationController.h (+31 -29)
dav 2014-10-17 11:18 Rev.: 52589

M Makefile.in
M Core/Util/sub.mk

Fix a strange linking error on Prism@CHPC (linux box) where the
tracker program would not link correctly due to missing symbols in
Core/Util (which are found in Core/Malloc) when SCI Malloc is turned
on. While this fix is valid (Core/Util does rely on Core/Malloc), it
should not be necessary as Core/Malloc is linked in other locations.

2 lines of code changed in 2 files:

  • Makefile.in (+1)
  • Core/Util: sub.mk (+1 -1)
dav 2014-10-16 18:14 Rev.: 52585

Fix GPU compilation error... Todd please verify this.

0 lines of code changed in 2 files:

  • CCA/Components/Models/Radiation/floatRMCRT: RayGPU.cc (new)
dav 2014-10-16 17:48 Rev.: 52584


This fixes the lineextract problem seen on BGQ machine vulcan@llnl.
However, it is likely that this same problem will/does occur on any
strange statically linked architecture. While this isn't a complete
fix, it will allow Jennifer to use the utility for now.

The problem in this case is that static variables are not always
(ever?) created (or at least their constructors are not called) upon
program startup (like they are supposed to be). The Uintah type
system creates a list of all variable types (eg: CCVariable<double>)
that are available to the program, and these are stored in the static
map variables 'types' found in Core/Disclosure/TypeDescription.cc.
However, these types are put into the 'types' variable by the
register_type() function which is called from the TypeDescription
constructor for each type.

Later, when a (textual) type decription is read from an UDA file, that
string is looked up in the 'types' map... If the map was never populated,
then an 'unknown type' type is returned and then an error occurs because
we don't know the real type.

To solve this problem, I just manually instantiate a number of
variable types in the bgq_hack() function in lineextract.cc.

M StandAlone/tools/extractors/lineextract.cc

- Line up variables (and their initialization) for easier viewing.
- Add white space, remove tabs and indent properly.
- Number of coding standard stylistic updates.
- Added bgq_hack() function to manually instantiate needed types.
- Added in warning message in case a needed type hasn't been hacked in yet.

M StandAlone/tools/extractors/timeextract.cc

- White space fixes.
- This file has not been 'hacked' like lineextract, but if it is needed, the
same hack would be easy to copy over.

M Core/DataArchive/DataArchive.cc
M Core/Disclosure/TypeDescription.cc

- Cosmetic updates - white space and coding standard clean ups.



278 lines of code changed in 7 files:

  • Core/DataArchive: DataArchive.cc (+24 -21)
  • Core/Disclosure: TypeDescription.cc (new)
  • StandAlone/tools/extractors: lineextract.cc (+170 -89), timeextract.cc (+4 -4)
dav 2014-10-14 16:38 Rev.: 52579

Needed to convert the ostringstream to a string...

3 lines of code changed in 1 file:

  • CCA/Components/DataArchiver: DataArchiver.cc (+3 -3)
dav 2014-10-14 16:34 Rev.: 52578


M HyprePrecondBase.cc

- Alphabetize #includes.

- Fix warning message on Mac where a char * is concatenated to an
integer using a +... using a ostringstream instead.


0 lines of code changed in 2 files:

  • CCA/Components/Solvers/AMR/HyprePreconds: HyprePrecondBase.cc (changed)
dav 2014-10-14 16:32 Rev.: 52577


M Makefile.in

The Mac is a little temperamental with the SVN info command... this fixes it.

M StandAlone/sub.mk

Removed tabs from incorrect locations.


23 lines of code changed in 3 files:

  • Makefile.in (+20 -8)
  • StandAlone: sub.mk (new)
dav 2014-10-14 15:19 Rev.: 52576


Two main fixes: Checkpointing (parsing of UPS file) fixed. Outputting
of correct SVN revision number for sus runs.

M Makefile.in
A + include/svn_info.h.template
D include/svn_info.h

Place accurate SVN information in svn_info.h each time 'make' is run.
This uses the 'svn info' command and populates the svn_info.h file
(bin/include/) using the svn_info.h.template file (src/include/).

M StandAlone/sub.mk

- sus.o depends on the svn_info.h file being created.

M CCA/Components/DataArchiver/DataArchiver.cc

- Fix checkpointing. Now both walltimeInterval and walltimeIntervalHours work.

- Updated the checkpointing code to try to open the checkpoint file
multiple times if the 'open' system call fails. This issues was
seen (at least) once on vulcan@llnl (bgq machine), and probably
occurred due to a file system glitch. It is likely that this 'fix'
will never be utilized, but it is there just in case.

57 lines of code changed in 5 files:

  • Makefile.in (+19)
  • CCA/Components/DataArchiver: DataArchiver.cc (+29 -10)
  • StandAlone: sub.mk (+2)
  • include: svn_info.h (del), svn_info.h.template (new 7)

(61 more)

Generated by StatSVN 0.7.0