{"title":"锁定并使用关键字:探索用笔记本打开网络档案的新方法","authors":"Leontien Talboom, Mark Bell","doi":"10.1007/s10502-022-09391-6","DOIUrl":null,"url":null,"abstract":"<div><p>The UK Government Web Archive (UKGWA) has been archiving government websites since 1996 and now holds regular snapshots of over 5000 sites. Currently, this material can be accessed through browsing or a simple keyword search interface on their website and has also been catalogued in The National Archives’ online catalogue, Discovery. However, the scale of the UKGWA exposes the limits of the current search interface, and there is no facility to understand the archive in aggregate. This article seeks to go beyond the simple keyword search by exploring the data sources available, from APIs to web crawling, for computational analysis of the UKGWA. The article is accompanied by two Python Notebooks which present examples of analysis using each data source. Notebooks lower the technical barriers for the reader to explore and interpret the UKGWA as data, while surfacing the challenges around making web material computationally accessible.</p></div>","PeriodicalId":46131,"journal":{"name":"ARCHIVAL SCIENCE","volume":"22 3","pages":"393 - 415"},"PeriodicalIF":1.4000,"publicationDate":"2022-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://link.springer.com/content/pdf/10.1007/s10502-022-09391-6.pdf","citationCount":"0","resultStr":"{\"title\":\"Keeping it under lock and keywords: exploring new ways to open up the web archives with notebooks\",\"authors\":\"Leontien Talboom, Mark Bell\",\"doi\":\"10.1007/s10502-022-09391-6\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>The UK Government Web Archive (UKGWA) has been archiving government websites since 1996 and now holds regular snapshots of over 5000 sites. Currently, this material can be accessed through browsing or a simple keyword search interface on their website and has also been catalogued in The National Archives’ online catalogue, Discovery. However, the scale of the UKGWA exposes the limits of the current search interface, and there is no facility to understand the archive in aggregate. This article seeks to go beyond the simple keyword search by exploring the data sources available, from APIs to web crawling, for computational analysis of the UKGWA. The article is accompanied by two Python Notebooks which present examples of analysis using each data source. Notebooks lower the technical barriers for the reader to explore and interpret the UKGWA as data, while surfacing the challenges around making web material computationally accessible.</p></div>\",\"PeriodicalId\":46131,\"journal\":{\"name\":\"ARCHIVAL SCIENCE\",\"volume\":\"22 3\",\"pages\":\"393 - 415\"},\"PeriodicalIF\":1.4000,\"publicationDate\":\"2022-07-04\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://link.springer.com/content/pdf/10.1007/s10502-022-09391-6.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"ARCHIVAL SCIENCE\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://link.springer.com/article/10.1007/s10502-022-09391-6\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"INFORMATION SCIENCE & LIBRARY SCIENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"ARCHIVAL SCIENCE","FirstCategoryId":"1085","ListUrlMain":"https://link.springer.com/article/10.1007/s10502-022-09391-6","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"INFORMATION SCIENCE & LIBRARY SCIENCE","Score":null,"Total":0}
Keeping it under lock and keywords: exploring new ways to open up the web archives with notebooks
The UK Government Web Archive (UKGWA) has been archiving government websites since 1996 and now holds regular snapshots of over 5000 sites. Currently, this material can be accessed through browsing or a simple keyword search interface on their website and has also been catalogued in The National Archives’ online catalogue, Discovery. However, the scale of the UKGWA exposes the limits of the current search interface, and there is no facility to understand the archive in aggregate. This article seeks to go beyond the simple keyword search by exploring the data sources available, from APIs to web crawling, for computational analysis of the UKGWA. The article is accompanied by two Python Notebooks which present examples of analysis using each data source. Notebooks lower the technical barriers for the reader to explore and interpret the UKGWA as data, while surfacing the challenges around making web material computationally accessible.
期刊介绍:
Archival Science promotes the development of archival science as an autonomous scientific discipline. The journal covers all aspects of archival science theory, methodology, and practice. Moreover, it investigates different cultural approaches to creation, management and provision of access to archives, records, and data. It also seeks to promote the exchange and comparison of concepts, views and attitudes related to recordkeeping issues around the world.Archival Science''s approach is integrated, interdisciplinary, and intercultural. Its scope encompasses the entire field of recorded process-related information, analyzed in terms of form, structure, and context. To meet its objectives, the journal draws from scientific disciplines that deal with the function of records and the way they are created, preserved, and retrieved; the context in which information is generated, managed, and used; and the social and cultural environment of records creation at different times and places.Covers all aspects of archival science theory, methodology, and practiceInvestigates different cultural approaches to creation, management and provision of access to archives, records, and dataPromotes the exchange and comparison of concepts, views, and attitudes related to recordkeeping issues around the worldAddresses the entire field of recorded process-related information, analyzed in terms of form, structure, and context