Managing Data from a Different Angle.

Jul 10, 2014 | ESRI, GIS, postgis, QGIS, Spatial Connect

I wonder how many people read this blog and go “You’re nuts”. Well – yes.

I do a number of things here. One of the things is managing a database for a forestry client. This year has been rough on the data end of life. I had everything stored in a file based geodatabase. I wasn’t particularly happy with that setup as the data was growing more than I could keep up with it (not the fault of the data format at all). I ended up moving back to shapefiles with gave more ability with other software (QGIS). Still wasn’t happy with that as I was now having to do a ton of post processing with model builder to straighten out mistakes.

Databases are one of those things we don’t deal with well in GIS (or at least I never have). I’ve had this ever increasing fascination with PostGIS. I’ve always shied away from databases just because I’m visual. I want to look at data vs text. Except this client is slowly killing me with data.

So I started the trek into postgis. Granted my setup isn’t elegant but it’s working. I’m actually managing data and instead of repeating columns and fields at every corner I’ve now built in foreign keys and triggers Plus I’m now keeping up with dates of edits. It’s not a full audit (yet) but I’m getting there.

postgres_connectA big amount of heartburn has been ArcGIS. Not for any other reason except it’s slowly getting morphed into a cartography tool. Except I’ve stored all my data in postgis/postgres and for the uninitiated – the two don’t blend well. Let me back up – Didn’t. Over the last year or more there has been more of a push from ESRI to support in some shape or fashion Postgresql. You can use it as a backend with SDE to edit. Except my clients can’t afford that route. If you haven’t notived the minute you go past ArcView…or ArcGIS for Desktop Basic it’s pretty much a cluster of ArcGISOnline, ArcServer, ArcEditor and “OMG JUST BUY SOMETHING”. Hah. I’m kidding (not really).

Anyway – I’m running postgresql 9.3 on ubuntu 14.04. I’ve got ArcGIS 10.2.2 running over on a virtual machine (because I’m weird that way). So the ESRI customer site has downloads for library support for Postgresql. Download the Postgresql 9.2.2 libraries. Install them and copy the libraries (32 bit) into the ESRI bin directory. Then – connect. There’s a bit more magic that happens with definition layers….but it works. I can view postgresql/postgis (but not edit) tables.

There was a whole issue a few months back with maps. I opened the MXD’s and reconnected the data source to be Postgresql. I started pumping out more maps.

So what did we learn.

As you guys are going to hear me say more and more. Process trumps software. I’ve now moved a client that sits and wonders every year should they pay the $500 dollars worth of software maintenance into an better environment. PostGIS to store their data. QGIS for Editing which now enables their three employees three copies of desktop software. ArcGIS for map production. Total cost: $500 (if you ignore my time in moving and cleaning up the data which was actually ignored – I did this to prove it would work and to get the first client into what I’m calling the “Spatial Connect” Product). All that is left is some more data cleaning and training on using QGIS to maintain their data.

The big question – Should I toss ArcGIS? My answer is no. No reason as it still plays a role. If they were just starting out now would I tell them to purchase it? That’s a whole different discussion considering their industry.

 

You may also like

MAGIP and TNGIC in 2024

MAGIP and TNGIC in 2024

I just came off two conferences with one being in Montana and one being in Tennessee. Both Geo related. It was my first time attending the MAGIP conference. Not that you need a long overly drawn out review of both - here are some of the highlights: TNGIC was fun. It...

QGIS and LIDAR and Forestry Part 2

At the TNGIC conference I did a workshop on LIDAR and QGIS. I was completely blasted out by ESRI's Avenue for the Web class but I had a few souls come in and take a look at it. I finished it off with "I don't use LIDAR that much". Well.....I'm finally using it. It...

TNGIC 2024

TNGIC 2024

So - if you're coming to the 2024 TNGIC (TN Geographic Information Council) meeting (April 9-11 2024) to talk about how no one understands what you do......I'm doing a workshop. What workshop? It's a new workshop. QGIS and LIDAR data. As to what I do with the class...