named queries and queryResult Documentation

[WolfgangFahl]

pyLodStorage has support for the two concepts:

• named Query (class Query)
• query result (class QueryResultDocumentation)

in:
https://github.com/WolfgangFahl/pyLoDStorage/blob/master/lodstorage/query.py

These can be used e.g. in a style like:

    def testMostFrequentIdentifiers(self):
        '''
        test getting the most frequent identifiers for some Wikidata Items
        '''
        show=True
        for qid in ["Q2020153","Q47258130","Q1143604"]:
            tt=TrulyTabular(qid)
            query=tt.mostFrequentIdentifiersQuery()
            self.documentQuery(tt, query,formats=["mediawiki","github","latex"],show=show)

with the query being described in a yaml file:

# Named Queries for truly tabular analysis
# WF 2022-03-14
"mostFrequentIdentifiers":
    title: most frequently used identifier properties
    description: 
    sparql: |
        SELECT ?prop ?propLabel ?count WHERE {
        {
            SELECT ?prop (COUNT(DISTINCT ?item) AS ?count) WHERE {
               
               hint:Query hint:optimizer "None" .
               ?item wdt:P31 wd:%s .
               ?item ?p ?id .
               ?prop wikibase:directClaim ?p .
               {?prop wdt:P31 wd:Q19847637}  # Wikidata property representing a unique identifier
                    UNION
               {?prop wdt:P31 wd:Q19595382}  # Wikidata property for authority control for people
            }  GROUP BY ?prop
        }
               
        SERVICE wikibase:label {
            bd:serviceParam wikibase:language "en" .
        }
    
        } ORDER BY DESC (?count)

and being instrumented in the code:

 def mostFrequentIdentifiersQuery(self):
        '''
        get the most frequently used identifiers
        '''
        query=self.queryManager.queriesByName["mostFrequentIdentifiers"]
        query.title=f"most frequently used identifiers for {self.asText(long=True)}"
        query.query=query.query % self.itemQid
        return query

and then creating output e.g. in github markup that can be pasted directly here:

most frequently used identifiers for academic conference(Q2020153) https://www.wikidata.org/wiki/Q2020153

query

SELECT ?prop ?propLabel ?count WHERE {
{
    SELECT ?prop (COUNT(DISTINCT ?item) AS ?count) WHERE {
       
       hint:Query hint:optimizer "None" .
       ?item wdt:P31 wd:Q2020153 .
       ?item ?p ?id .
       ?prop wikibase:directClaim ?p .
       {?prop wdt:P31 wd:Q19847637}  # Wikidata property representing a unique identifier
            UNION
       {?prop wdt:P31 wd:Q19595382}  # Wikidata property for authority control for people
    }  GROUP BY ?prop
}
       
SERVICE wikibase:label {
    bd:serviceParam wikibase:language "en" .
}

} ORDER BY DESC (?count)

try it!

result

prop	propLabel	count
http://www.wikidata.org/entity/P227	GND ID	3064
http://www.wikidata.org/entity/P214	VIAF ID	2111
http://www.wikidata.org/entity/P244	Library of Congress authority ID	506
http://www.wikidata.org/entity/P5124	WikiCFP event ID	98
http://www.wikidata.org/entity/P2572	hashtag	58
http://www.wikidata.org/entity/P373	Commons category	25
http://www.wikidata.org/entity/P7859	WorldCat Identities ID	9
http://www.wikidata.org/entity/P268	Bibliothèque nationale de France ID	8
http://www.wikidata.org/entity/P1651	YouTube video ID	6
http://www.wikidata.org/entity/P3987	SHARE Catalogue author ID	4
http://www.wikidata.org/entity/P1207	NUKAT ID	4
http://www.wikidata.org/entity/P8965	OpenReview.net group ID	4
http://www.wikidata.org/entity/P4419	Videolectures ID	4
http://www.wikidata.org/entity/P7293	PLWABN ID	3
http://www.wikidata.org/entity/P648	Open Library ID	3
http://www.wikidata.org/entity/P1015	NORAF ID	3
http://www.wikidata.org/entity/P356	DOI	3
http://www.wikidata.org/entity/P3065	RERO ID	2
http://www.wikidata.org/entity/P271	CiNii author ID (books)	2
http://www.wikidata.org/entity/P9100	GitHub topic	2
http://www.wikidata.org/entity/P6366	Microsoft Academic ID	2
http://www.wikidata.org/entity/P409	Libraries Australia ID	1
http://www.wikidata.org/entity/P1280	CONOR.SI ID	1
http://www.wikidata.org/entity/P1960	Google Scholar author ID	1
http://www.wikidata.org/entity/P8189	National Library of Israel J9U ID	1
http://www.wikidata.org/entity/P8179	Canadiana Name Authority ID	1
http://www.wikidata.org/entity/P5739	Pontificia Università della Santa Croce ID	1
http://www.wikidata.org/entity/P1315	NLA Trove people ID	1
http://www.wikidata.org/entity/P7775	RationalWiki ID	1
http://www.wikidata.org/entity/P213	ISNI	1
http://www.wikidata.org/entity/P1296	Gran Enciclopèdia Catalana ID	1
http://www.wikidata.org/entity/P968	email address	1
http://www.wikidata.org/entity/P691	NKCR AUT ID	1
http://www.wikidata.org/entity/P3219	Encyclopædia Universalis ID	1

most frequently used identifiers for scientific conference series(Q47258130) https://www.wikidata.org/wiki/Q47258130

query

SELECT ?prop ?propLabel ?count WHERE {
{
    SELECT ?prop (COUNT(DISTINCT ?item) AS ?count) WHERE {
       
       hint:Query hint:optimizer "None" .
       ?item wdt:P31 wd:Q47258130 .
       ?item ?p ?id .
       ?prop wikibase:directClaim ?p .
       {?prop wdt:P31 wd:Q19847637}  # Wikidata property representing a unique identifier
            UNION
       {?prop wdt:P31 wd:Q19595382}  # Wikidata property for authority control for people
    }  GROUP BY ?prop
}
       
SERVICE wikibase:label {
    bd:serviceParam wikibase:language "en" .
}

} ORDER BY DESC (?count)

try it!

result

prop	propLabel	count
http://www.wikidata.org/entity/P214	VIAF ID	2592
http://www.wikidata.org/entity/P6366	Microsoft Academic ID	2018
http://www.wikidata.org/entity/P227	GND ID	1807
http://www.wikidata.org/entity/P244	Library of Congress authority ID	1122
http://www.wikidata.org/entity/P5127	WikiCFP conference series ID	1096
http://www.wikidata.org/entity/P268	Bibliothèque nationale de France ID	81
http://www.wikidata.org/entity/P3333	ACM Digital Library event ID	20
http://www.wikidata.org/entity/P7859	WorldCat Identities ID	14
http://www.wikidata.org/entity/P213	ISNI	8
http://www.wikidata.org/entity/P373	Commons category	7
http://www.wikidata.org/entity/P3987	SHARE Catalogue author ID	6
http://www.wikidata.org/entity/P1015	NORAF ID	6
http://www.wikidata.org/entity/P271	CiNii author ID (books)	5
http://www.wikidata.org/entity/P691	NKCR AUT ID	5
http://www.wikidata.org/entity/P2572	hashtag	2
http://www.wikidata.org/entity/P968	email address	2
http://www.wikidata.org/entity/P8965	OpenReview.net group ID	2
http://www.wikidata.org/entity/P9984	CANTIC ID	2
http://www.wikidata.org/entity/P1273	CANTIC ID (old)	2
http://www.wikidata.org/entity/P409	Libraries Australia ID	2
http://www.wikidata.org/entity/P8189	National Library of Israel J9U ID	1
http://www.wikidata.org/entity/P8179	Canadiana Name Authority ID	1
http://www.wikidata.org/entity/P8980	KANTO ID	1
http://www.wikidata.org/entity/P8608	Fatcat ID	1
http://www.wikidata.org/entity/P10	video	1
http://www.wikidata.org/entity/P1960	Google Scholar author ID	1
http://www.wikidata.org/entity/P5739	Pontificia Università della Santa Croce ID	1
http://www.wikidata.org/entity/P9100	GitHub topic	1
http://www.wikidata.org/entity/P7363	ISSN-L	1

most frequently used identifiers for proceedings(Q1143604) https://www.wikidata.org/wiki/Q1143604

query

SELECT ?prop ?propLabel ?count WHERE {
{
    SELECT ?prop (COUNT(DISTINCT ?item) AS ?count) WHERE {
       
       hint:Query hint:optimizer "None" .
       ?item wdt:P31 wd:Q1143604 .
       ?item ?p ?id .
       ?prop wikibase:directClaim ?p .
       {?prop wdt:P31 wd:Q19847637}  # Wikidata property representing a unique identifier
            UNION
       {?prop wdt:P31 wd:Q19595382}  # Wikidata property for authority control for people
    }  GROUP BY ?prop
}
       
SERVICE wikibase:label {
    bd:serviceParam wikibase:language "en" .
}

} ORDER BY DESC (?count)

try it!

result

prop	propLabel	count
http://www.wikidata.org/entity/P356	DOI	1293
http://www.wikidata.org/entity/P648	Open Library ID	116
http://www.wikidata.org/entity/P304	page(s)	73
http://www.wikidata.org/entity/P4109	URN-NBN	32
http://www.wikidata.org/entity/P7363	ISSN-L	24
http://www.wikidata.org/entity/P7505	ACL Anthology article ID	24
http://www.wikidata.org/entity/P5875	ResearchGate publication ID	19
http://www.wikidata.org/entity/P818	arXiv ID	18
http://www.wikidata.org/entity/P6179	Dimensions Publication ID	12
http://www.wikidata.org/entity/P5530	Altmetric DOI	10
http://www.wikidata.org/entity/P8608	Fatcat ID	8
http://www.wikidata.org/entity/P214	VIAF ID	6
http://www.wikidata.org/entity/P6366	Microsoft Academic ID	6
http://www.wikidata.org/entity/P373	Commons category	4
http://www.wikidata.org/entity/P6409	CORE ID	4
http://www.wikidata.org/entity/P5749	Amazon Standard Identification Number	3
http://www.wikidata.org/entity/P268	Bibliothèque nationale de France ID	3
http://www.wikidata.org/entity/P7859	WorldCat Identities ID	3
http://www.wikidata.org/entity/P5587	Libris-URI	3
http://www.wikidata.org/entity/P227	GND ID	2
http://www.wikidata.org/entity/P8965	OpenReview.net group ID	1
http://www.wikidata.org/entity/P409	Libraries Australia ID	1
http://www.wikidata.org/entity/P7870	Analysis & Policy Observatory term ID	1
http://www.wikidata.org/entity/P7791	NTIS accession number	1
http://www.wikidata.org/entity/P8179	Canadiana Name Authority ID	1
http://www.wikidata.org/entity/P10283	OpenAlex ID	1
http://www.wikidata.org/entity/P244	Library of Congress authority ID	1