North River Geographic Systems Inc

Spatial Problem Solving

QGIS

QGIS Processing: History

· ·

If you’re anything like me (hopefully you aren’t) you’ll do something and immediately wished you hadn’t closed the processing window. Clip, simplify, select by location……

So in this case I had a call about contouring a Digital Elevation Model. Contours are easy. I ran them at 10…or maybe 20.

QGIS and DEM

I decided to clip them with the county boundary since the DEM extends outside of the county into the neighboring counties and states.

QGIS and Clipped DEM

So the question is now “WHAT DID YOU DO”. You get up. You come back. Cat jumps in your lap. Your Mom calls. QGIS keeps a history of your processing commands. If you look at the processing toolbox you’ll see a small clock.

Click it and another windows opens

Here is the cool thing. You click any of the commands and you’ll be taken back to your original QGIS Processing menu. So if I can contours and don’t like them at 20 foot intervals? Go back and check the history, double click,  and change it to 10 and run it again. You like python? You have what you need to know and you can run that from the python console. I made one small change and dumped it to a shape this time vs a memory layer:

So if you do forget a tool setting in the processing tools after you closed it – just run it again by looking at your history for the processing toolbox.

 

QGIS North America Meeting 2020

· ·

The QGIS US Users Group & partners in North America are proud to announce the QGIS North America 2020 virtual conference to be held on Friday, July 17, 2020 (and Friday, July 24th if needed). We offer this meeting as a way to share our ideas and skills when so many in-person meetings cannot safely happen. We recognize that while we are all separated, we have the opportunity to include people in a greater diversity in locations and economic situations since travel and registration costs are not necessary. We invite participation from all over the globe, but presentation times will focus on the North American audience.

The cost to attend will be free, and we would like to suggest attendees make a donation to support QGIS at https://qgis.org/en/site/getinvolved/donations.html

Call for Participation

The organizers of the QGIS North America 2020 virtual conference would like to solicit proposals for participation in this conference to be held online on Friday, July 17th (and potentially Friday, July 24th, with sufficient interest) in the form of talks, workshops, birds-of-a-feather networking sessions, and ideas for other session. Sessions can focus on any aspect of QGIS and we particularly encourage talks about applications of the software, software and plugin development, and discussions of transitioning to using QGIS software from other tools. Proposals for sessions should be submitted online via our Google Form: https://docs.google.com/forms/d/e/1FAIpQLScXVbO58aMZMmHo1mT5QEpF7uPki79e8PCyRJ9tBna_2IcAvw/viewform?usp=sf_link

Proposals for talks, birds-of-a-feather networking sessions, and ideas for other session require

  • Contact information for the presenter
  • Title
  • Description or abstract

Proposals for workshops requires

  • Contact information for the presenter
  • Title
  • Description or abstract
  • Length (in hours) of the workshop
  • Software requirements
  • A list of people who can potentially act as helpers (does not need to be finalized at the time of submission)

The deadline for submission is Friday, June 12, 2020.

Fed Geo Day 2020 June 11th and 12th 2020

· ·

You know what I was going to do next week? Going to Washington DC and Teach a QGIS class.

You know what I’m doing now – Sitting in my house and teaching a class at Fed Geo Day on June 12th 2020

So what is Fed Geo Day:

———————————————————-

For decades open source software has been at the forefront of innovation in data collection, analysis, and visualization. Today, open source geospatial software has evolved into an “open ecosystem” of software, communities, and companies that enable field data collection and advanced visualization and lead the way in drone, lidar, IOT, and satellite imagery collection and analysis.

When open source software is combined with open standards for interoperability, government agencies have the most scalable, stable, secure and cost effective tools available to support activities including:

  • Empowering disadvantaged communities with limited funding
  • Enabling real-time data analysis at planetary scale
  • Optimizing release schedules for constituent facing tools

Join us for this one day conference in the heart of Washington DC. The morning plenaries will share how open source geospatial tools have become a critical part of operations within multiple federal agencies. The afternoon break out sessions will tackle technical and management solution use cases.

  • $20 dollars gets you into the conference
  • $20 dollars gets you into the QGIS Class. There are a lot of training options beyond the Introduction to QGIS class.

Attend! Support Open Source in the Federal Space!

QGIS and Editing: Widgets

· ·

I’ve been getting more questions lately on QGIS from all over the place. A pandemic will apparently: cause you to experiment with software, do some weird things with existing software, or call me up and ask “How do you work from home this sucks”. So one question started out with “I need to edit some data for the team and I need to keep up with what I edited and no it’s not in a database”.

In my perfect world you edit against postgresql/postgis and I set up some triggers to at the very least record who and when and possibly X and Y (or Y and X).  If you’re stuck with a shapefile, spatialite database, or Geopackage what can you do? So you have these things called widgets in QGIS……

So we’re going to play with a geopackage because that gives me some talking points for the next blog post. The ruggedly handsome client (me) has shoved some data into a geopackage. Geopackage has no login so I’m going to add my data to QGIS and do the following things:

  • Add two fields called ‘edituser’ and ‘editdate’
  • Set up two widgets in your QGIS Session.

If you right click on a data layer and go to properties you can set up a widget for your fields (under Attribute Forms). A widget can be a drop down list (something like a domain on a subtype for you over in ESRI Land).

So for the edituser field I will pick a simple text edit widget with a default value of ‘rjhale’ (At the Bottom of the menu).

The editdate field gets slightly more complicated. For that one I reach into the myriad of QGIS functions and pull out the $now. So I apply it as a default (and check that I want it to update if I move the line):

 

So moving forward I can at least keep up with “who” edited and “when”.

That’s possible the simplest use case of a widget you can have. What if you wanted to update the length of a line automatically? The QGIS Function is $length and you could apply that as a default to a widget on a field and have it calculate the length.

The big take away on this is you can do some very simple things to help your editing life. Two widgets with default values and you can keep up with what you’ve done (or maybe a co-worker) in an attempt to combine the data back together at a later time. A giant shoutout to Spatial Thoughts as I start to dive into more widget magic over the next bit.

 

The Quarantine Server Shuffle

· ·

No I’m not doing a post about Covid. Well I sort of am doing a post about covid.

I have a client that placed me on retainer to help them sort through their GEO life. They are an ArcGIS/QGIS/Trimble/Fulcrum/Collector/Compass/Paper map kind of group. Which isn’t any different than anyone else I run into these days. ArcGIS does some of what they want. QGIS does some of what they want. Shapefiles are spread everywhere. Paper maps make an appearance when the digital side of things don’t make sense. They have a GPS and there is something of a workflow – it’s just not great. Every non-profit/conservation group I deal with wrestles with GIS. There is some sort of desktop software, some sort of pile of data. The system is so unimportant you spend 0 dollars on it until the moment it’s important and then there’s a certain amount of hand wringing and everyone just keeps doing what they are doing.

I have some stories to tell on this but the important one is: Pandemic. We were close to the end of things with new gps, new data collection techniques, and a debate on how to store the data. Then Covid happened and I received a text of “Hey we’re closing up for a while…like in 15 minutes we are closing”. Everything (software/data) is stored on one computer and they have one map sitting on AGOL. Probably the last email from that computer was the File Based Geodatabase that stored the important stuff. I don’t think the myriad shapefiles and photos made it out – BUT – that’s not the important part.

The MASH Bugout Episode

The important part is we were able to move the whole project up into “the cloud” with minimal effort. I had an instance of Postgresql/PostGIS running on a Virtual Machine out in the uncharted parts of the internet. So in 2 hours:

  • exported the data out of the File Based Geodatabase into PostGIS
  • Connect QGIS to the postgis instance
  • Connect the important person so she can see it all
  • Set up a backup so that we all feel better.

Which with the exception of a few things (like dealing with their ESRI License), this isn’t terribly out of the ordinary of a setup. I’ve done it for other clients. Why write about it? It’s the first time I’ve done this for a conservation group. Way back in my past life of Federal and early days as a consultant it was “spend one day on IT problems and spend 1 day on what they needed to buy”. You spent half the time being an IT Technical Sales Person vs the guy that helps you with your data. I take for granted how easy stuff is in 2020. If you have $240 US you can have a server sitting out ‘THERE’ (points towards Atlanta because I think that’s where it is). A “I can edit GIS data” powerful enough server. In 2001 my department received a server that was probably in the top 10 in the state for processing power for a small amount of time – I won’t even mention the cost but put 6 numbers down before you get to the decimal space. So Conservation people – in your next line item for IT stuff -> $240 dollars a year for the base of a GIS system (computer included in that).

So in short we:

  • Panic’d
  • Shoved the data into a VM.
  • Keep working with a slightly new setup.

So the rest of the story is going to play out something like:

  • PANDEMIC
  • Making the Fulcrum import a little bit smoother
  • Documentation
  • Cartography I hope
  • AGOL Account

…..and the ultimate question is “is this better than what they were doing” and so far I think we’re 80% better. It would be nice if we weren’t in the middle of a crisis BUT since they are also in the middle of a project this hasn’t been something with a deadline. So this week I lay out permissions, map templates, and we try and figure out “Training” to make GIS less this giant black box and fade into the background and make it normal…and with the pandemic we have some room to adjust and play around if it’s not working as they want. Hey and I mentioned ESRI more than once and it didn’t end with “we deleted it” because it has a role also.

 

 

 

Contact