DEM Processing – who’s the beast

(yes, I meant to say Beast).  Today I began to experiment with processing some large raster DEMs, and making contours.  I used ArcGIS, Manifold 9, and GDAL.  This was a nice initial test, and you’ll see some of the results and what I had to wrestle with below.  I think a lot of my friends could offer me advice on how to improve this test, and I would welcome that.


This was a fairly good sized DEM, so it can give us a nice challenge.  The particulars about the DEM are as follows:

Garrett County, MD (2015, 1m DEM)
51187, 60832 pixels (for those of you keeping score, that’s 3.1 billion pixels!)
Size: 13.5GB
Format: ESRI Coverage


Initial Results

I ran the contouring tests on a 64-bit Dell Precision T1700, i-7 3.4GHz processor with 18GB of RAM.  I used GDAL, Manifold Viewer (Edge version), and ArcGIS 10.3.


For GDAL, I simply used the following command to convert the DEM to a shapefile:

gdal_contour -a elev c:\temp\countywide\garrett15_1m\hdr.adf c:\temp\contour.shp -i 10.0


The process completed in 53m.   You’ll notice the CPU’s that were firing.  They weren’t flat, and it seemed that more than one was firing:


Manifold 9

The next test was to use Manifold.  I had Manifold 9 import the DEM data.  It took about 2 minutes to import the 13.5GB raster into Manifold.  From there, I used the contouring transform tool with “Run in parallel” checked.


The process completed in 1561s (24m 1s).  Twice as fast as GDAL.


Finally, I fired up ArcGIS and used the Contour (Spatial Analyst Tool).  You can see that ArcGIS does not use all the cores on the CPU:


However, I was surprised to see that the contours were completed in 7m 45 seconds – by far the fastest result.  I thought I must have done something wrong, so I ran it again, and instead of creating a geodatabase, I wrote the results out to a shapefile.  The timings were almost identical.

Display and Alignment

The next question, of course, was to see any differences in the results.  As you can see, Garrett County, even at 10m has fairly dense contours.



I decided to bring all three results into a single window.  You’ll see the red, green, and yellow (I changed the line thicknesses).  All  three products yield the same results.  So, they are obviously using a similar algorithm.


What does it all mean?

I was surprised that GDAL was so much slower.  Most people really like the speed of GDAL, but ArcGIS totally crushed it.  Also, seeing Manifold totally pinning the CPU in the parallel processing capabilities, I was surprised that ArcGIS was many times faster.  I wonder if using Manifold 9, rather than Manifold Viewer (Edge) might make a difference.   If anyone wants access to the dataset I used, feel free to email me.

2 thoughts on “DEM Processing – who’s the beast

  1. Hi Art. We experience similar results at Groff Engineering. Typical DEM’s (geotiff format) from photogrammetry surveys are >300-million pixels for a site that is a few hundred acres (e.g. 3 cm pixels). GDAL takes a long time (e.g. 20 minutes) to generate contours into .dxf format, and they are typically very jagged, contain millions of vertices, and are not CAD friendly. Even using a GDAL ogr2ogr command to simplify the line-work does not help. Manifold 8 produced similar results; it took a long time and contours were too complex. I have not tried Manifold 9 yet, though we have the ability to do so. We have found that using Global Mapper we can re-sample the original DEM (e.g. 9×9 pixels), contour it faster (e.g. 5 minutes) and smoother, and produce CAD friendly results. Additionally, we are able to better filter out small, insignificant, contours associated with trees and water; a common challenge when working with photogrammetry. So, why was Global Mapper better? First, it wasn’t trying to contour every single pixel! Second, the resampling method generated line-work with simpler geometry. Simpler geometry means smaller output files, less memory required, and less write time.

  2. Pingback: DEM Processing – return of the beast? | gisadvising

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s