DuckDB and QGIS

Nov 27, 2023 | 911, address, Python, QGIS

I’ve not taken time over the last few months to “play” with geo. I’ve been hitting conferences and marketing and doing all the things I sort of don’t like that much. More talk of conferences coming.

One thing I’ve seen pop up more and more is duckdb. Wht is it? Basically a serverless database. It’s local. You use it for data analysis or data update locally. For everything I’ve been doing with a database lately duckdb won’t work – BUT – it’s interesting.

I downloaded it and ran it and basically after some hit or miss since I barely read the documentation I read in a shapefile. Basically after making a database and a table I did:

create table addresses as select * from st_read('../../temp/address_points.shp');

I did a little bit of SQL and had fun. DuckDB has a spatial extension so you can do things like load spatial data like a shapefile or Geopackage.

Why talk about it? This announcement from Oslandia:

So with a small amount of effort to install an experimental plugin (no I’m not telling you how to install an experimental plugin):

I can view the data and run processes – I just can’t edit it. Yet. At least I hope it’s a yet. I see much possibility in duckdb. Well – basically I see great possibility in anything where there is an open spec and a community growing around it. Plus this is pretty new and QGIS can already view the database.

The important part as taken from the blog post:

The following features are already identified. You can make them a reality through funding :

  • Layer editing (modify data, add/delete columns, create/delete entities, etc.)
  • Importing a spatial layer from QGIS directly into a DuckDB database
  • Better integration of DuckDB in QGIS
  • Support for tables with multiple geometry types
  • If you have any development requests, please don’t hesitate to contact us: contact@oslandia.com

You may also like

Update on the TN 911 Database

After not saying much up here for the last month - here's an update on the TN 911 Database. To catch you up if you don't know - Tn has a NG911 setup and generally 97% of everyone is running ESRI Arc Something to input data. A few years ago I moved one county over to...

Tips for Data Cleanup: Virtual Layers

What do you do when you're cleaning up data. Especially address data and you get down to the sloppy part of the data cleanup? I did 80% of this in Postgresql by shaking off the cobwebs on my sql skills but this part requires visual. I have addresses assigned to roads...

Opening a ArcPro Template in QGIS

Opening a ArcPro Template in QGIS

Sometime in 2020, I ordered the ArcGIS Home Program and ran it on some virtual machine I had sitting around. My problem is I have too much fun learning things on the open source side of the house so I didn't use it a lot. As I look back I'm pretty sure I stayed in the...