Explore, Analyse and Translate Multilingual Wikidata Properties

ContribuLing 2021, 4th June, 2021

John Samuel

CPE Lyon

Creative Commons License

Outline

Outline

  1. Introduction
  2. WDProp: Wikidata Property Analysis
  3. Towards a coarser analysis on property translation
    • Data Collection
    • Analysis Results
  4. Conclusion and Future Works

1. Introduction

1. Introduction

Wikidata Properties

Wikidata Properties

1. Introduction

Wikidata Property: Labels and descriptions

Example Wikidata Property: country (P17)

1. Introduction

Wikidata Property: Labels and descriptions

Example Wikidata Property: official website (P856)

1. Introduction

Properties: Labels, description and aliases

Labels, description and aliases of Property:P31 in English

1. Introduction

Wikidata Property: from Proposal to Usage

Property proposal and Creation

1. Introduction

Wikidata Property: from Proposal to Usage

Property proposal, creation and usage on Wikidata

1. Introduction

Wikidata Property: Translation

Property Creation on Wikidata

1. Introduction

Wikidata Property: Missing descriptions

Missing multilingual descriptions on Property P31

1. Introduction

Wikidata Properties: Missing descriptions

Missing multilingual descriptions on Property P31

1. Introduction

Wikidata Properties: English

Wikidata (English)

1. Introduction

Wikidata Properties: Afar

Wikidata (Afar)

1. Introduction

Wikidata Properties: Missing labels

Missing multilingual labels on Property P31

2. WDProp: Wikidata Property Analysis

WDProp

  1. WDProp:
    • Collaborative Multilingual Multi-domain Ontology development: is it possible to achieve a truly multilingual experience?
  2. Properties:
    • Not so much influenced by bots!
  3. Goals:
    • Understanding Wikidata property proposal, creation and translation
    • Available templates and their usage
    • Providing real-time statistics to (multilingual) contributors

2. WDProp: Wikidata Property Analysis

Towards 'Everything' about Wikidata properties

2. WDProp: Wikidata Property Analysis

Towards 'Everything' about Wikidata properties

Information on Wikidata Properties

2. WDProp: Wikidata Property Analysis

2. WDProp: Wikidata Property Analysis

Wikidata: Supported Languages

Wikidata languages

2. WDProp: Wikidata Property Analysis

Wikidata: Supported Languages

Wikidata language: Afar

2. WDProp: Wikidata Property Analysis

Wikidata: Supported Languages

Afar: Property labels needing translation

2. WDProp: Wikidata Property Analysis

Wikidata: Supported Languages

Afar: Property labels needing translation

2. WDProp: Wikidata Property Analysis

Wikidata: Supported Languages

Afar: Property descriptions needing translation

2. WDProp: Wikidata Property Analysis

Wikidata: Supported Languages

Afar: Properties missing aliases

2. WDProp: Wikidata Property Analysis

Wikidata: Supported Languages

English: Property labels needing translation

2. WDProp: Wikidata Property Analysis

Wikidata: Supported Languages

English: Property descriptions needing translation

2. WDProp: Wikidata Property Analysis

Wikidata: Supported Languages

English: Properties missing aliases

2. WDProp: Wikidata Property Analysis

Wikidata Properties

Wikidata properties

2. WDProp: Wikidata Property Analysis

Wikidata Properties

Wikidata properties: All included deleted ones

2. WDProp: Wikidata Property Analysis

Wikidata Properties

Wikidata properties: Top 100

2. WDProp: Wikidata Property: P856

Wikidata Properties

Wikidata Property: P856 (official website)

2. WDProp: Wikidata Property: P856

Wikidata Properties

Missing labels in languages: P856

2. WDProp: Wikidata Property: P856

Wikidata Properties

Missing descriptions in languages: P856

2. WDProp: Wikidata Property: P856

Wikidata Properties

Missing aliases in languages: P856

2. WDProp: Wikidata Property Analysis

Wikidata Datatypes

Wikidata Datatypes

2. WDProp: Wikidata Property Analysis

Wikidata Datatypes

Wikidata Datatypes: Lexemes

2. WDProp: Wikidata Property Analysis

Wikidata Property Classes

Wikidata Property Classes

2. WDProp: Wikidata Property Analysis

Wikidata Property Classes

Wikidata Property Classes: Lighthouse

2. WDProp: Wikidata Property Analysis

Wikidata Property Classes

Properties for Lighthouse

2. WDProp: Wikidata Property Analysis

Wikidata Property Classes

Properties for Lighthouse: Translation statistics

2. WDProp: Wikidata Property Analysis

Wikidata Property Classes

Properties for Lighthouse

2. WDProp: Wikidata Property Analysis

Wikidata Property Classes

Properties for Lighthouse

2. WDProp: Wikidata Property Analysis

Wikidata Properties with References

Properties for Lighthouse

2. WDProp: Wikidata Property Analysis

Wikidata Properties with References

P856: References

2. WDProp: Wikidata Property Analysis

Equivalent Wikidata Properties

Wikidata Properties with equivalent property value

2. WDProp: Wikidata Property Analysis

Wikidata Property Suggestion and Voting

Wikidata Property Voting: Support

2. WDProp: Wikidata Property Analysis

Wikidata Property Suggestion and Voting

Wikidata Property Discussion

2. WDProp: Wikidata Property Analysis

Wikidata Property Suggestion and Voting

Wikidata Property Discussion: Voting

2. WDProp: Wikidata Property Analysis

Wikidata Property Suggestion and Voting

Wikidata Property Discussion Template

2. WDProp: Wikidata Property Analysis

Wikidata Property Suggestion and Voting

Wikidata Property Voting: Oppose

2. WDProp: Wikidata Property Analysis

Wikidata Property Suggestion and Voting

Wikidata Property Voting: Neutral

2. WDProp: Wikidata Property Analysis

Wikidata Property Suggestion and Voting

Wikidata Property Voting: Comment

2. WDProp: Wikidata Property Analysis

Wikiprojects

WikiProjects: Programming Languages

2. WDProp: Wikidata Property Analysis

Wikiprojects

WikiProjects

2. WDProp: Wikidata Property Analysis

Wikiprojects

WikiProjects: Properties

2. WDProp: Wikidata Property Analysis

Wikiprojects

WikiProjects: Translation statistics for properties

2. WDProp: Wikidata Property Analysis

Wikiprojects

WikiProjects: Museums

2. WDProp: Wikidata Property Analysis

Wikidata Properties: Statistcs of Multilingual Labels

Real time information on number of multilingual labels

2. WDProp: Wikidata Property Analysis

Wikidata Properties: Multilingual Descriptions

Real time information on number of multilingual descriptions

2. WDProp: Wikidata Property Analysis

Wikidata Properties: Multilingual Descriptions

Real time information on number of multilingual aliases

2. WDProp: Wikidata Property Analysis

Wikidata Properties: Comparison of Translation

Comparison of translation statistics

3. Analysis of Translation of Properties

WDProp: Translation path

Wikidata properties: Translation path of three Wikidata Properties

3. Analysis of Translation of Properties

WDProp: Translation path

Wikidata properties: Possible vandalism (removal of labels)

3. Analysis of Translation of Properties

WDProp: Translation path

Wikidata properties: Possible vandalism (removal of labels, descriptions and aliases)

3. Analysis of Translation of Properties

WDProp: Translation path

Wikidata properties: Visualization of Translation

3. Analysis of Translation of Properties

Wikidata Properties: Revision History

Revision History on Wikidata: Property P17

3. Analysis of Translation of Properties

Wikidata Properties: Comments from revision history

Attribute Add Update Remove
label wbsetlabel-add wbsetlabel-set wbsetlabel-remove
description wbsetdescription-add wbsetdescription-set wbsetdescription-remove
alias wbsetaliases-add wbsetaliases-add-remove wbsetaliases-remove

3. Analysis of Translation of Properties

Wikidata Properties: Comments from revision history

3. Analysis of Translation of Properties

Wikidata Properties: Data Collection

3. Analysis of Translation of Properties

Wikidata Properties: Data Collection

timestamppropertylanguagetype
2013-10-26T16:45:20ZP999enlabel
2013-10-26T16:45:20ZP999endescription
2013-10-26T18:16:05ZP999delabel
2013-10-27T02:55:15ZP999ptlabel
2013-10-27T02:55:18ZP999frlabel
2013-10-28T12:42:28ZP999pllabel
2013-10-29T08:41:45ZP999frdescription

3. Analysis of Translation of Properties

Wikidata Properties: Analysis Results

Histogram on the distribution of number of languages for different properties

3. Analysis of Translation of Properties

Wikidata Properties: Analysis Results

Measure Value
count 6347
mean 21.444935
std 20.897675
min 1.000000
max 154.000000

3. Analysis of Translation of Properties

Analysis Results: Frequent itemsets

Count Language Combinations
6347 en
6338 ar
6306 nl
6263 uk
5928 fr
4823 ca
4019 de

3. Analysis of Translation of Properties

Analysis Results: Frequent itemsets

Count Language Combinations
6259 ar, uk
5923 fr, ar
5905 fr, uk
4819 ar, ca
4795 ca, uk
4530 fr, ca
4015 ar, de

3. Analysis of Translation of Properties

Analysis Results: Frequent itemsets

Count Language Combinations
6257 en, nl, ar, uk
5919 en, nl, fr, ar
5903 en, nl, fr, uk
5901 en, ar, fr, uk
5899 nl, fr, uk, ar
4818 en, nl, ar, ca
4794 en, nl, ca, uk

4. Conclusion and Future Works

Wikipedia Infobox Properties

Existing English Wikipedia Infobox Properties of Programming Languages

4. Conclusion and Future Works

Wikipedia to Wikdiata

Importing structured data from Wikipedia Infoboxes to Wikidata

4. Conclusion and Future Works

Wikdiata to Wikipedia

Exporting data from Wikidata to multiple multilingual Wikipedia articles

4. Conclusion and Future Works

Future Works

  1. Search:
    • Improving the search experience
  2. Visualize:
    • Export as SVG
  3. Download:
    • API
    • Download as JSON, CSV

4. Conclusion and Future Works

References

  1. Chamard, Thibaut, and John Samuel. Multilingual Wikidata Property Translation Flow Dataset. Zenodo, 8 July 2019. DOI.org (Datacite), doi:10.5281/ZENODO.3271357.
  2. Kaffee, L. A., Piscopo, A., Vougiouklis, P., Simperl, E., Carr, L., & Pintscher, L. (2017, August). A glimpse into Babel: an analysis of multilinguality in Wikidata. In Proceedings of the 13th International Symposium on Open Collaboration (p. 14). ACM.
  3. Müller-Birn, C., Karran, B., Lehmann, J., & Luczak-Rösch, M. (2015, August). Peer-production system or collaborative ontology engineering effort: What is Wikidata?. In Proceedings of the 11th International Symposium on Open Collaboration (p. 20). ACM.
  4. Pellissier Tanon, T., & Kaffee, L. A. (2018, April). Property label stability in Wikidata: evolution and convergence of schemas in collaborative knowledge bases. In Companion of the The Web Conference 2018 on The Web Conference 2018 (pp. 1801-1803). International World Wide Web Conferences Steering Committee.

References

  1. Samoilenko, A., Karimi, F., Kunegis, J., Edler, D., & Strohmaier, M. (2015, June). Linguistic influence patterns within the global network of Wikipedia language editions. In Proceedings of the ACM Web Science Conference (p. 54). ACM.
  2. Samuel, J. (2017) Collaborative Approach to Developing a Multilingual Ontology: A Case Study of Wikidata. In : Research Conference on Metadata and Semantics Research. Springer, Cham, 2017. p. 167-172.
  3. Samuel, J. (2018). Towards Understanding and Improving Multilingual Collaborative Ontology Development in Wikidata. In: WikiWorkshop 2018
  4. Samuel, John. Johnsamuelwrites/Wdprop: V0.12. v0.12, Zenodo, 2021. DOI.org (Datacite), doi:10.5281/ZENODO.1174371.
  5. Stefaner, M., Taraborelli, D., & Ciampaglia, G. L. (2011). Notabilia–Visualizing Deletion Discussions on Wikipedia.

Thank you

Questions?