Tag Archives: open data institute

Making use of Open Data

Darllenwch y flogbost yn Gymraeg

The Wales Audit Office recently released our first Open Dataset. What happened next? Ben Proctor of Open Data Institute Cardiff talks us through how he made use of the data.

A screenshot of a dynamic map created by Ben Proctor to show levels of Council Tax per head of population in Wales

A screenshot of a dynamic map created by Ben Proctor to show levels of Council Tax per head of population in Wales

Oooo! new data

I was excited to see that the Wales Audit Office had released a set of data as open data. Open data is data that anyone can find access and use and it is the most useful sort of data.

Dyfrig Williams wrote about the process they’d gone through to release this data set (a summary of the audit data from each local authority in Wales for each year). The data is a simple table and you can download it as a CSV file (essentially a file that will work in any spreadsheet programme) here.

But there are problems

I downloaded the file and quickly spotted some problems. These are not errors exactly but just things that are missing or inconsistent and will make some uses of the data a bit harder. But this is not a complaint, because one of the attractive features of open data is that I could resolve these problems. I can do this because the Wales Audit Office have released the data under the Open Government Licence. This tells me I don’t need their permission to do anything with the data and there are no limits to what I can do with it (apart from I have to make it clear where it came from).

I can fix the problems

These are the things I did to my copy of the data.

I changed the format of the “financial year column” because in the Wales Audit Office file some of these are numbers and some are text.

I added a column of GSS codes. GSS codes are codes that are used to identify local authorities (and other boundaries). Having the GSS code means you don’t have to worry about whether the data says Anglesey Council, or Isle of Anglesey Council or Ynys Môn. And with the GSS code I could add “polygons” for each council. Polygons are basically instructions on how to draw the outline of each council and information about where to put the drawing on a map.

With these changes I was able to draw a series of maps showing the level of council tax per head in each local authority and how this has changed over time.

And given the Wales Audit Office an improved file

And I’ve been able to hand back to the Wales Audit Office a KML file. This is a file suitable for use in mapping software. Anyone who wants to visualise the Wales Audit Office data on a map can just open the KML file and get going.

You can download this mapping file yourself.

Why did I do this?

I’m part of the core team at ODI-Cardiff so I get excited about open data.
It took me a very few minutes.
I’m trying to get better at using a Google service called Fusion Tables and this is a good opportunity to experiment.
I’m actually quite interested in what this data might tell us.

What can Open Data do for public services?

The Wales Audit Office is holding a Google Hangout on Open Data. It will look at how Open Data can help public services to deliver joined up, transparent and effective public services. In this blogpost, Dyfrig Williams looks at why the Good Practice Exchange is interested in the topic.

Last year the Effective Services for Vulnerable Groups team at the Welsh Government approached us about the possibility of doing some work around highlighting good practice around effective data sharing. When we held a scoping meeting, we found ourselves being drawn into two slightly different discussions – one on sharing personal data, and another on the merits of Open Data. To do justice to both, we decided to hold two separate events. The event on personal data really helped bust some myths around data protection, especially where the Assistant Information Commissioner for Wales got to grips with the issues that public services face.

Open Data was subsequently added to our list of events for this year. At the same time, we found out that the Office for National Statistics was interested in running a webinar the topic, so in the spirit of collaboration, we’ll be running this Hangout jointly with them.

So what is Open Data?

Open data is data that anyone can access, use or share. When big companies or governments release non-personal data, it enables businesses and citizens to make improvements to their communities. The Open Data Institute has produced an introductory video to explain some of the benefits of Open Data.

Open Data Impact have identified four ways in which Open Data is changing the world:

  • Improving government (by tackling corruption, increasing transparency and improving public services)
  • Empowering citizens (to take control of their lives through informed decision making)
  • Creating opportunity (by fostering innovation, promoting economic growth and creating jobs)
  • Solving Public Problems (by giving access to new forms of data-driven assessment of the problems at hand. It also enables targeted interventions and enhanced collaboration)

What does this mean in reality?

There are lots of case studies of where public services have released Open Data to benefit wider society. Transport for London released data that has seen a 58:1 return on investment, which has led to the development of companies like Citymapper.

In Canada, open data exposed one of the biggest tax frauds in the country’s history through an examination of the publicly available Annual Information Returns.

There are also some great examples in local government. The Leeds Data Mill have a fantastic City Dashboard, which shares open data feeds through simple graphics to give a snapshot of the city at any given moment. The Hampshire Hub has undertaken lots of work, including how public services respond to a pending weather event. It also identified GP surgeries who’ll be most under pressure due to increases in demand.

So why isn’t everybody jumping on the bandwagon?

One of the issues is around understanding. Dan Slee has written a great post on why jargon and a lack of understanding is a big issue when it comes to sharing good practice around Open Data. And if like me you’re not a particularly techy individual, it makes it difficult to apply the learning to real world public service delivery.

Organisations also need to be clear about why they’re releasing data and the outcomes that they want. What does success look like? How will public services evidence the difference it’s made to their communities? The National Audit Office produced a fascinating report on Implementing transparency in 2012 that found that “government needs a better understanding of costs, benefits and use to assess whether transparency is meeting its objectives of increasing accountability, supporting service improvement and stimulating economic growth.” I suspect that the UK Government is not alone in that.

How can a webinar help?

This webinar with the Office for National Statistics will help us to examine how Open Data can help public services deliver joined up, transparent and effective public services. We’ll be looking at:

  • What Open Data is
  • How we can make data open
  • The tangible benefits
  • The next steps

The panel will include Rob Davidson from the Office for National Statistics, Esko Reinikainen from the Open Data Institute Node in Cardiff, and Helen Wilkinson from Natural Resources Wales, who will share practical learning from the Lle Portal.

The Hangout will be very participative, so we’d love to hear from you and to receive your questions before and during the discussion. And if you’re already making the most of Open Data, we’d love to find out whether it’s helping you to empower people, improve services and make the communities that you serve better places in which to live.