Version classiqueVersion mobile
OpenEdition Books

Connecting the Knowledge Commons — From Projects to Sustainable Infrastructure

 | 
Leslie Chan
, 
Pierre Mounier

Availability of Cultural Heritage Structured Metadata in the World Wide Web

Nuno Freire, Pável Calado et Bruno Martins

Résumé

In the World Wide Web, a very large number of resources is made available through digital libraries. The existence of many individual digital libraries, maintained by different organizations, brings challenges to the discoverability, sharing and reuse of the resources. A widely-used approach is metadata aggregation, where centralized efforts like Europeana facilitate the discoverability and use of the resources by collecting their associated metadata. The cultural heritage domain embraced the aggregation approach while, at the same time, the technological landscape kept evolving. Nowadays, cultural heritage institutions are increasingly applying technologies designed for the wider interoperability on the Web. This paper presents a study of the current application by cultural heritage data providers of technological solutions in use for making structured metadata available for re-use in the Internet. We investigated the use of both linked data and technologies related with indexing of resources by Internet search engines. We have conducted a harvesting experiment of the landing pages from websites of digital libraries that participate in Europeana and collected statistics about the usage of these technologies. These technologies allow for representing structured data within HTML, or for structured data to be referred to by links within HTML or through HTTP headers capabilities. We conclude with a discussion of future work for establishing a solution for cultural heritage aggregation based on the current situation and the available technologies.

Texte intégral

We would like to acknowledge the supporting work by Antoine Isaac and Valentine Charles, from the Europeana Foundation, for their reviews and discussions regarding our work.

This work was partially supported by Portuguese national funds through Fundação para a Ciência e a Tecnologia (FCT) with reference UID/CEC/50021/2013, and by the European Commission under contract number 30-CE-0885387/00-80.

Introduction

1In the World Wide Web, a very large number of online cultural heritage digital resources is made available through digital libraries websites. These digital resources may consist of digitizations of physical objects (e.g., books, paintings, manuscripts) or born-digital objects (e.g., e-books, photographs). The discoverability of these resources through Internet search engines is still a challenge. Many cultural heritage resources are not of a textual nature (e.g., images, video or sound). Those that are textual often lack machine readable full-text, of which search engines are highly dependent, because they consist of digitized images where the application of optical character recognition (OCR) was not performed, due to lack of funding or availability of a mature OCR technology (e.g., for manuscripts or early printed materials). For discoverability, cultural heritage institutions have always relied on the creation of data records describing the resources.

2These descriptive records are the basis for accessing and retrieving the resources through each institutional digital library website, which are specifically built for retrieval of this kind of data. The existence of many individual digital libraries, maintained by different organizations, brings challenges to the discoverability and usage of the resources by potential users, making the adequate indexing of cultural heritage metadata in Internet search engines even more relevant.

3Across institutions, the discoverability problem is addressed by an organizational architecture based on a central organization (a role often fulfilled by a cultural heritage institution, but not always). These organizations approach discoverability of the resources by collecting their associated metadata descriptive records. The central organization has the possibility to further promote the usage of the resources by means that cannot be efficiently undertaken by each digital library in isolation. They typically provide Web portals that contain cultural heritage focused search engines, also specifically built for this kind of data records (“Dublin Core Metadata Element Set”).

4In the domain of cultural heritage, the data aggregation technologies used are not the same as for Internet search engines. OAI-PMH has been the embraced aggregation solution, since it is highly specialized in fulfilling the requirements for the aggregation of metadata datasets (Fielding et al.). However, the technological landscape around our domain has changed. Nowadays, with the technological improvements accomplished by network communications, computational capacity, Internet search engines, and semantic data interoperability, the motivation for adopting OAI-PMH is not as clear as it used to be in cultural heritage (Freire et al., “A Survey of Web”).

5In the last years, the cultural heritage domain has been able to create sustainable aggregation initiatives, with self-sustaining business models. Examples are Europeana, DPLA, DigitalNZ, Trove and Digital Library of India, which are collecting and providing access to the public digitized cultural assets from Europe, the United States of America, New Zealand, Australia and India, respectively. However, the costs related to the implementation of the technical solution for aggregation are high for data providers. For these aggregation initiatives, reducing the effort required for data providers would bring more participants to their networks and lower the overall costs, therefore increasing the sustainability of the whole network (Verwayen). In this context, if cultural heritage aggregators were able to re-use the technological solutions in use for indexing by Internet search engines, data providers could benefit from several advantages. In particular, it would give data providers the following motivations:

  • For those already implementing these technologies in their digital libraries, the process for sharing their data with cultural heritage aggregators would become extremely simple.
  • For those that do not yet have these technologies in use, implementing the technical requirements for cultural heritage aggregation would be more rewarding, since discoverability through Internet search engines would come as a valuable extra benefit.

6This paper presents a study of the current application by cultural heritage data providers of technological solutions in use for making structured data (or metadata, in the cultural heritage context) available for re-use in the Internet. We investigated the use of both linked data and technologies related with indexing of resources by Internet search engines. We have conducted a harvesting experiment of the landing pages from websites of cultural heritage digital libraries that participate in Europeana and collected statistics about the usage of these particular technologies. These technologies allow for representing structured data within HTML or allow for structured data to be referred to by links within HTML or through HTTP headers. An analysis and discussion of the collected statistics is also presented.

7We conclude with a discussion, based on the outcomes of this study, regarding future work for establishing a solution for cultural heritage aggregation based on the current cultural heritage scenario and the available technologies.

Related work

8Although the use of linked data in cultural heritage has been the focus of much research, most of the published literature addresses mainly the aspect of the publication of linked data and do not fully address how the common aggregation approach of cultural heritage can be based on the existing published cultural heritage linked data (Simou et al.; Hyvönen; Jones and Seikel).

9The most similar work to ours is that of the Dutch Digital Heritage Network (NDE) and the Research and Education Space project (RES)1 (Meijer and Valk). NDE is a Dutch national level program aiming to increase the social value of the collections maintained by the libraries, archives and museums in the Netherlands. NDE is still an ongoing project, and its initial proposals are based on specific APIs to enable data providers to centrally register the linked data URIs of their resources (“High Level Functional Design”). The current proposal of NDE, by being based in its own defined API, does not yet provide a solution purely based on linked data.

10The Research and Education Space project has ended in 2017 but its results are still available. It has successfully aggregated a considerable number of linked data resources from cultural heritage sources. The resulting aggregated dataset can be accessed online,2 but an evaluation of its aggregation procedures and results was not published. From the technical documentation available, we can see that RES managed to give significant steps in the specification of key tasks to enable the aggregation of linked data (McRoberts). Some tasks however were not fully specified by the end of the project, and no further information has been published afterwards.

11Generic technical solutions have been proposed by others to enable the aggregation of linked data (Rietveld et al.). However, a standards-based approach has not yet been put into practice within cultural heritage.

  • 3 The Europeana Network is a community of 1,700 experts with the shared mission to expand and improv (...)

12The work presented in this paper is done in the context of the research activities being carried out within the Europeana Network,3 for improving the network’s efficiency and sustainability (Verwayen). Linked data has been identified in our past work as one of the technical solutions with application potential (“Dublin Core”). The work described in this paper is part of a series of experiments addressing several Internet technologies for this purpose (Freire et al., “A Metadata Aggregation”; Freire et al., “Evaluation of Schema.org”).

The Experimental Setup

13In our harvesting experiment from the landing pages of resources from Europeana data providers, we have harvested samples from 31 different sources. In order to setup this test sample, we used the Europeana Search4 and Record5 APIs. The Search API was used first to discover the existing data providers of Europeana and their collections. Afterwards, on a second set of requests, Search API was used to discover a list of records from each collection. In subsequent requests, made on the Record API, we requested the complete metadata records of a sample of records per collection of each data provider. A diagram of the complete process of the experiment is shown in figure 1.

Figure 1. The experimental setup

Figure 1. The experimental setup
  • 6 ORE - Object Reuse and Exchange: Data Model.
  • 7 http://www.openarchives.org/ore/1.0/vocabulary#aggr

14At most, 100 records per collection were obtained. From these records we collected the URLs of the landing pages on the data providers’ digital libraries. The metadata records were obtained in the Europeana Data Model (EDM) format (“Definition of the Europeana Data Model”). The URLs were obtained from the EDM isShownAt, property of the ORE6 Aggregation7 element. In total, the sample comprehended URLs from 31 data providers, 609 collections and 52,866 resources.

15We issued two requests on each of the 52,866 landing pages: one request for the human readable version in HTML and a second request for the machine readable representation of the resource using HTTP content negotiation (“Sitemaps XML format”). We then processed the responses and collected statistics on the usage of three possible ways that these digital libraries could be encoding the metadata descriptions of the cultural heritage objects: HTML5 meta tags, RDFa/RDFa Lite and RDF data (in any of the commonly used serialization formats). For the analysis of the HTML5 meta tags, we have excluded the standard HTTP tags, since they are not meant to provide any descriptive data regarding the content of HTML pages.

16An additional aspect is addressed in the experiment—the data model or namespaces of the structured data encoded in the landing pages. In particular, we are interested in gathering statistics regarding the use of two data models: Dublin Core Metadata Elements (Lagoze et al.) and Schema.org8 (used by Google and several other companies). These data models are the most likely to be nowadays in use by cultural heritage institutions to represent the metadata of their resources.

Results

17The totals responses obtained from the requests issued to the sample of 52,866 URLs are shown in table 1. None of the responses for linked data resulted in valid RDF. The most frequent response was the HTML page, instead of RDF, therefore hinting that HTTP content negotiation was not even supported. In some cases, an error “Unsupported content-type” was received, and for some sporadic cases a JSON response was received, but it was not in a JSON-LD form, therefore, no RDF triples could be obtained from them. Our visual inspection of some of these cases detected that the JSON data was under a specific format, probably defined by a particular JSON API of a digital library system.

18In the responses to the HTML requests, we detected a total of 25,276 HTML pages containing some form of structured data: 14,407 pages with HTML5 meta tags and 10,869 with Schema.org data, encoded in RDFa, RDFa Lite or JSON-LD (table 1).

Table 1. Structured data obtained from the requests issued to the sample of 52,866 URLs from Europeana providers

Linked data requests
(content negotiation)
HTML requests
RDF HTML with HTML5 meta tags HTML with Schema.org (in RDFa, RDFa Lite or JSON-LD)
0 (no valid RDF responses) 14,407 out of 52,866 27% (from 17 Europeana collections) 10,869 out of 52,866 20% (from 6 Europeana collections)

19Table 2 summarizes the usage of the HTML5 meta tags. Whenever meta tags were present on the HTML pages, at least one of the standard HTML5 meta tags was in use. In some cases, meta tags with properties using prefixes were also present. Although none of the HTML pages specified the namespace of the prefixes in use (it can be done by using RDFa), some of the prefixes are well-known, and typically they refer to the following namespaces:

  • “dc”—Dublin Core Metadata Element Set;9
  • “dcterms”—DCMI Metadata Terms;10
  • “og”—The Open Graph Protocol.11

20The prefixes “eprints” and “egms” prefixes where found as well, but we cannot be certain to which namespaces they refer.

Table 2. The rdf:type of Schema.org RDF resources present in the HTML pages

HTML5 meta tags
Meta tag property prefix Number of HTML pages Number of distinct Europeana providers
HTML5 standard tags 14,407 17
Dc 3,783 7
Dcterms 1,377 2
Og 791 3
egms 701 2
eprints 100 1

21Regarding the use of Schema.org metadata, in table 3 it is shown the URIs of classes in use, which gives an impression of what is being described there. Schema.org can be used to describe many aspects related to the HTML page and its content. Therefore, although Schema.org data may be present in the HTML, it may not be describing the cultural heritage object. And, in fact, we observed the usage of instances of ListItem, BreadcrumbList, SearchAction, Website and ViewAction, in several cases, which indicates that the cultural heritage object metadata was not part of the existing Schema.org data.

Table 3. The rdf:type of Schema.org RDF resources present in the HTML pages

Schema.org Classes used
Class URI Number of instances
http://schema.org/​Thing 9,770
http://schema.org/​ListItem 9,88
http://schema.org/​Person 555
http://schema.org/​BreadcrumbList 509
http://schema.org/​SearchAction 282
http://schema.org/​WebSite 282
http://schema.org/​Organization 282
http://schema.org/​VideoObject 229
http://schema.org/​ImageObject 227
http://schema.org/​Book 199
http://schema.org/​ViewAction 197
http://schema.org/​Article 127
http://schema.org/​VisualArtwork 100

Conclusion and Future Work

22The results of this experiment make it evident that in spite of the numerous activities in cultural heritage for making available linked data, reaching it through automated means based on the WWW (i.e. the Web of Documents) is no yet feasible. The digital object entry pages, whose links are sent to Europeana, could not be automatically linked to their respective linked data representations, since they did not support linked data through content negotiation, and the structured metadata we found encoded within the HTML pages was very limited, or even non-existent in the majority of cases.

23In order to make use of cultural heritage linked data for metadata aggregations, less automated approaches need to be employed to discover, link and adapt the aggregation systems to each dataset of the participating CHI data sources (SPARQL end points, data dumps, etc.). Alternatively, aggregators may start to define the technical mechanisms for making linked data automatically discoverable, accessible and usable for aggregation.

24Another aspect we also conclude from the experiment, is that it supports the beneficial value of cultural heritage aggregation initiatives, such as Europeana and DPLA, for promoting the discoverability of the cultural heritage objects through both the WWW and linked data. The activities of aggregators in the publication of open linked data are likely to be the most interoperable source of cultural heritage linked data currently available (Charles et al.). The results of the experiment provide further motivation for the development of Europeana’s activities towards Schema.org publication of its dataset and cultural heritage metadata in general (Wallis et al.).

25Cultural heritage institutions are typically very dedicated to their digital libraries and the quality of the metadata that describes their holdings. From this study we conclude that cultural heritage institutions have been neglecting the availability of their structured metadata according to Web standards when defining the functional requirements of their digital libraries systems. Or, in those cases that this requirement is being considered, cultural heritage institutions need to make sure that they have a testing process to ensure that the structured metadata is properly published in machine readable form, since this kind of functionality cannot be tested by humans.

26The next steps of our work will be to survey technologies of the Semantic Web, linked data and vocabularies for the description of datasets. We will analyze these technologies in search for a solution that will enable the aggregation of linked data in fully automatized ways or requiring very little human intervention. Table 4 shows a list of those technologies that we have identified at this stage of our work.

Table 4. Technologies of the Semantic Web, linked data, and vocabularies for the description of datasets

Technology Description
Linked Data Platform (Speicher et al.) Linked Data Platform (LDP) defines a set of rules for HTTP operations on web resources, some based on RDF, to provide an architecture for read-write Linked Data on the web.” (Speicher et al.)
VoID - Vocabulary of Interlinked Datasets (Alexander et al.) VoID is an RDF Schema vocabulary for expressing metadata about RDF datasets. It is intended as a bridge between the publishers and users of RDF data, with applications ranging from data discovery to cataloging and archiving of datasets.” (Alexander et al.)
DCAT – Data Catalogue Vocabulary (Maali and Reikson) DCAT is an RDF vocabulary designed to facilitate interoperability between data catalogs published on the Web. Publishers increase discoverability and enable applications easily to consume metadata from multiple catalogs. It further enables decentralized publishing of catalogs and facilitates federated dataset search across sites.” (Maali and Reikson)
Schema.orga The Schema.org vocabulary defines classes representing Datasetsb and their distribution.c
EDM Datasets Profile (“Europeana Dataset Profile”) This profile defines the elements used to represent datasets ingested by Europeana. The profile is mainly intended to be used to disseminate dataset level information via the Europeana API.
a. http://schema.org/​
b. http://schema.org/​Dataset
c. http://schema.org/​DataDownload

These technologies may enable the aggregation of linked data in fully automatized ways or with little human intervention.

Bibliographie

“Dublin Core Metadata Element Set, Version 1.1: Reference Description.” Dublin Core Metadata Initiative, 2012, http://www.dublincore.org/documents/dces/

“Europeana Data Model v5.2.8.” Europeana Foundation, 2017, http://pro.europeana.eu/edm-documentation

“Europeana Dataset Profile.” Europeana Foundation, April 2016, https://pro.europeana.eu/files/Europeana_Professional/Share_your_data/Technical_requirements/EDM_profiles/EDM_Dataset_Profile_042016.pdf

“High Level Functional Design.” Netwerk Digitaal Erfgoed’s Github, 2017, https://github.com/netwerk-digitaal-erfgoed/high-level-design

“Sitemaps XML format.” Sitemaps, https://www.sitemaps.org/protocol.html

Alexander, Keith, Richard Cyganiak, Michael Hausenblas, and Jun Zhao. “Describing Linked Datasets with the VoID Vocabulary: W3C Interest Group Note.” W3C, 3 March 2011, https://www.w3.org/TR/void/

Charles, Valentine, Nuno Freire and Antoine Isaac. “Links, Languages and Semantics: Linked Data Approaches in The European Library and Europeana.” Linked Data in Libraries: Let’s make it happen! IFLA 2014 Satellite Meeting, 14 August 2014, Bibliothèque nationale de France, Paris. Keynote Address, http://ifla2014-satdata.bnf.fr/pdf/iflalld2014_submission_Charles_Freire_Isaac.pdf

Fielding, Roy, James Gettys, Jeffrey C. Mogul, Henrik Frystyk, Larry Masinter, Paul J. Leach and Tim Berners-Lee. “Hypertext Transfer Protocol -- HTTP/1.1.” IETF, 1999, https://www.w3.org/Protocols/rfc2616/rfc2616.html

Freire, Nuno, Antoine Isaac, Glen Robson, John B. Howard and Hugo Manguinhas. “A Survey of Web Technology for Metadata Aggregation in Cultural Heritage.” Information Services & Use, vol. 37, no. 4, 2018, pp. 425-436, https://content.iospress.com/articles/information-services-and-use/isu859

Freire, Nuno, Glen Robson, John B. Howard, Hugo Manguinhas and Antoine Isaac. “Metadata Aggregation: Assessing the Application of IIIF and Sitemaps within Cultural Heritage.” Research and Advanced Technology for Digital Libraries: 21st International Conference on Theory and Practice of Digital Libraries, TPDL 2017, Thessaloniki, Greece, September 18-21, 2017, Proceedings, edited by Jaap Kamps, Giannis Tsakonas, Yannis Manolopoulos, Lazaros Iliadis and Ioannis Karydis, Springer, 2017, pp. 220-232.

Freire, Nuno, Valentine Charles and Antoine Isaac. “Evaluation of Schema.org for Aggregation of Cultural Heritage Metadata.” The Semantic Web: 15th International Conference, ESWC 2018, Heraklion, Crete, Greece, June 3–7, 2018, Proceedings, edited by Aldo Gangemi, Roberto Navigli, Maria-Esther Vidal, Pascal Hitzler, Raphaël Troncy, Laura Hollink, Anna Tordai and Mehwish Alam, Springer, 2018, pp. 225-239.

Hyvönen, Eero. “Publishing and Using Cultural Heritage Linked Data on the Semantic Web.” Synthesis Lectures on the Semantic Web: Theory and Technology, vol. 2, no. 1, 2012, pp. 1-159. doi:10.2200/S00452ED1V01Y201210WBE003

Jones, Ed and Michele Seikel, editors. Linked Data for Cultural Heritage. Facet Publishing, 2016.

Lagoze Carl, Herbert Van de Sompel, Michael L. Nelson and Simeon Warner. “The Open Archives Initiative Protocol for Metadata Harvesting.” Version 2.0, 2002, http://www.openarchives.org/OAI/2.0/openarchivesprotocol.htm

Maali, Fadi and John Reikson, editors. “Data Catalog Vocabulary (DCAT): W3C Recommendation.” W3C, 16 January 2014, https://www.w3.org/TR/vocab-dcat/

McRoberts, Mo, editor. “A Guide to the Research & Education Space for Contributors and Developers.” BBC Archive Development, 2016, https://bbcarchdev.github.io/inside-acropolis/

Meijers, Enno and Sjors de Valk. “White Paper: A Distributed Network of Heritage Information.” Netwerk Digitaal Erfgoed, 2017, https://github.com/netwerk-digitaal-erfgoed/general-documentation/blob/master/Whitepaper%20A%20distributed%20network%20of%20heritage%20information.md

Rietveld, Laurens, Ruben Verborgh, Wouter Beek, Miel Vander Sande and Stefan Schlobach. “Linked Data-as-a-Service: The Semantic Web Redeployed.” The Semantic Web. Latest Advances and New Domains: 12th European Semantic Web Conference, ESWC 2015, Portoroz, Slovenia, May 31 -- June 4, 2015. Proceedings, edited by Fabien Gandon, Marta Sabou, Harald Sack, Claudia d’Amato, Philippe Cudré-Mauroux and Antoine Zimmermann, Springer, 2015, pp. 471-487.

Simou, Nikolaos, Alexandros Chortaras, Girgos Stamou, and Stefanos Kollias. “Enriching and Publishing Cultural Heritage as Linked Open Data.” Mixed Reality and Gamification for Cultural Heritage, edited by Marinos Ioannides, Nadia Magnenat-Thalmann and George Papagiannakis, Springer, 2017, pp. 201-223. doi:10.1007/978-3-319-49607-8_7

Speicher, Steve, John Arwe and Ashok Malhotra, editors. “Linked Data Platform 1.0: W3C Recommendation”, W3C, 26 February 2015 , https://www.w3.org/TR/ldp/

Van de Sompel, Herbert and Michael L. Nelson. “Reminiscing About 15 Years of Interoperability Efforts.” D-Lib Magazine, vol. 21, n. 11/12, 2015. doi:10.1045/november2015-vandesompel

Verwayen, Harry. “Business Plan 2017: ‘Spreading the Word’.” Europeana Foundation, Version 1.0, 2017, https://pro.europeana.eu/files/Europeana_Professional/Publications/europeana-business-plan-2017.pdf

Wallis, Richard, Antoine Isaac, Valentine Charles and Hugo Manguinhas. “Recommendations for the Application of Schema.org to Aggregated Cultural Heritage Metadata to Increase Relevance and Visibility to Search Engines: The Case of Europeana.” Code4Lib Journal, vol. 36, 2017, http://journal.code4lib.org/articles/12330

Notes

1 https://bbcarchdev.github.io/res/

2 https://bbcarchdev.github.io/res/collections

3 The Europeana Network is a community of 1,700 experts with the shared mission to expand and improve access to Europe’s digital cultural heritage, in the organization they work for and/or by contributing to shape Europeana’s services.

4 https://pro.europeana.eu/resources/apis/search

5 https://pro.europeana.eu/resources/apis/record

6 ORE - Object Reuse and Exchange: Data Model.

7 http://www.openarchives.org/ore/1.0/vocabulary#aggr

8 http://schema.org/docs/about.html

9 http://dublincore.org/documents/dces/

10 http://www.dublincore.org/documents/dcmi-terms/

11 http://ogp.me/

Table des illustrations

Titre Figure 1. The experimental setup
URL http://books.openedition.org/oep/docannexe/image/9024/img-1.jpg
Fichier image/jpeg, 374k

Auteurs

INESC-ID, IST, University of Lisbon, Portugal (corresponding author)
INESC-ID, IST, University of Lisbon, Portugal
INESC-ID, IST, University of Lisbon, Portugal

Acheter

Volume papier

i6doc.com