PublicData.eu was a research prototype of a pan-European data catalogue and federation mechanism, developed as part of the EU-funded LOD2 project. Based on CKAN, the website was developed as a use case and was an early adopter of the LOD2 linked data stack technologies. After the LOD2 project’s launch in September 2010, a first version of the website was released in June 2011.

Screenshot of publicdata.eu

The portal’s backend used CKAN’s harvesting framework to retrieve, normalize and convert data set metadata from 25 catalogues across Europe, including national and regional as well as official and community-driven efforts. For example, the portal included all instances of CKAN (such as data.gov.uk), France’s Data Publica, Swedens OpenGov.se, CSI Piemonte’s Dati Piemonte and several municipal catalogues, including those of London, Paris and Vienna. The site was also able to include geodata directories such as the EU’s national INSPIRE registries. The harvesting of datasets is performed via an automated service, using APIs where available and screen-scraping for the remaining catalogues. Further key functionalities of the portal include:

  • Multilingual metadata was managed within the system, allowing filtering and multilingual descriptions.
  • A SPARQL (RDF query language) endpoint offered additionally to the standard CKAN API to allow easy access to structured catalogue metadata. All dataset views were RDFa-enabled and a RDF/DCat representation for each individual data set was available through an extended API.
  • Applications and ideas developed during the Open Data Challenge competition were presented in an integrated catalogue with multiple screenshots and tagging. This helped highlight the value of available data in general, as well as specific datasets.
  • Categorisation was based on taxonomy normalisation, yielding a common set of dataset categories based on EUROVOC. This allowed topical navigation across multiple data set languages.
  • A custom visual style was applied to the portal, using CKANs advanced theming support to develop a functional and elegant interface.
  • A map-based overview of data availability throughout Europe, demonstrating which countries are leading in their effort to open up government information.

During the remainder of the four-year runtime of the LOD2 project, further extensions to the portal were planned, including full support for SKOS-based, multilingual thesauri, and work to integrate the LOD2 data processing components to enable automated conversion and refinement of linked data sources. Further research included the use of domain-specific descriptions for extended data set metadata, e.g. for financial and legislative information.

Publicdata.eu has been replaced by the European Data Portal.