Reports analysing the IPBES Libraries on Zotero.
This report assesses the IPCC Bibliography in regards to different measures and shows some information of the content. It does not assess the content of the sources but rather the bibliometric data.
In most cases, the bibliographic analysis is done on the OpenAlex library. In some cases, we can also do it using the Zenodo data. This is mentioned in the beginning of each subsection
Analysis: Zenodo and OpenAlex
OpenAlex and Zotero use different tyoes. These are not directly compable, which is whu=y both are shown.
bib_data$figure_types_data |>
dplyr::arrange(
from,
desc(count)
) |>
knitr::kable(
caption = "Types of documents from the Zotero bibliography as well as from OpenApex."
)| type | count | from |
|---|---|---|
| article | 862 | OpenAlex |
| review | 109 | OpenAlex |
| letter | 14 | OpenAlex |
| book-chapter | 3 | OpenAlex |
| editorial | 2 | OpenAlex |
| paratext | 1 | OpenAlex |
| preprint | 1 | OpenAlex |
| journalArticle | 1139 | Zotero |
| book | 66 | Zotero |
| bookSection | 47 | Zotero |
| report | 40 | Zotero |
| webpage | 6 | Zotero |
| conferencePaper | 2 | Zotero |
bib_data$figure_types
Analysis: Zenodo and OpenAlex
The types entered in the Zenodo library and the types as retrieved from OpenAlex are not linked, therefore they can differ. This can indicate faulty data entering in Zenodo but not necessarily has to. These cases need to be carefully evaluated and here only given as a starting point.
NA in OpenAlex is likely caused by the doi not found in OpenAlex (not in there, not valid, non-standard DOI in Zenodo). NA in Zotero is linked to non-standard DOI entries (i.e. with http) which can therefore not be linked to OpenAlex data. If all DOIs are in standard format, there should be no NAs in this Table in the column Ferom Zenodo.
TODO: Improvements should be done after feedback.
bib_data$metrics$types$comparison |>
knitr::kable(
col.names = c("Type from Zenodo", "Type from [OpenAlex](https://OpenAlex.org){target='_blank'}", "count"),
caption = "Table giving the combination of types from Zenodo as well as [OpenAlex](https://OpenAlex.org){target='_blank'} and their frequency"
)| Type from Zenodo | Type from OpenAlex | count |
|---|---|---|
| journalArticle | article | 810 |
| journalArticle | NA | 203 |
| journalArticle | review | 106 |
| book | NA | 66 |
| NA | article | 52 |
| bookSection | NA | 47 |
| report | NA | 40 |
| journalArticle | letter | 14 |
| webpage | NA | 6 |
| NA | review | 3 |
| journalArticle | editorial | 2 |
| journalArticle | book-chapter | 2 |
| conferencePaper | book-chapter | 1 |
| journalArticle | paratext | 1 |
| journalArticle | preprint | 1 |
| conferencePaper | NA | 1 |
Analysis: Zenodo and OpenAlex
The following ranges of publication years can be found in the data.
bib_data$figure_pub_year_data |>
dplyr::summarize(
min = min(publication_year, na.rm = TRUE),
max = max(publication_year, na.rm = TRUE),
.by = c(from)
) |>
knitr::kable()| from | min | max |
|---|---|---|
| Zenodo | 1978 | 2021 |
| OpenAlex | 1949 | 2023 |
bib_data$figure_pub_yearWarning: Removed 1 row containing missing values or values outside the scale range
(`geom_col()`).
Analysis: OpenAlex
bib_data$figure_oa_status
Analysis: Zenodo
TODO: OpenAlex should be added
bib_data$figure_top_journals
This table contains all Journals as specified in the Zotero database.
bib_data$figure_top_journals_data |>
IPBES.R::table_dt("cited_journals")Analysis: OpenAlex
In this section we will take a closer look at the countries from which ih the authors ot the publication come. THe data includes all authoirs without weighting.
#|
#| fig-height: 10
#| fig-width: 10
bib_data$figure_top_country_map
This plot only contains the countries with more than 10 references.
#|
#| fig-height: 10
#| fig-width: 10
bib_data$figure_top_country
This table contains all countries and the number of authorship.
bib_data$figure_top_country_data |>
IPBES.R::table_dt("top_countries")Cleanliness of a bibliography is defined here as the quality of the bibliografic data in the bibliography. It does not concern any topical measures, only measures related to the bibliografic data in the bibliography.
The analysis is at the moment only done for DOIs as corresponding measures are not available at the moment for ISBNs and ISSNs and duplicate ISBNs and ISSNs can be rcorrect as different chapters of a book might be in the bibliography.
To identify a reference, the most widely used identifier is the DOI. The following table shows the number of references with a DOI and the number of unique DOIs.
To consider duplicate ISBNs or ISSNs as duplicates entries in the library is not waranted as e.g. differenc chapters of a book can be separate entries in the library and therefore lead to duplicates.
The following sections provide some more detailed analysis of the bibliography in Zenodo. The tables all contain clickable links which, shwen clicked, show the respective article in the Zotero bibliograpohy.
The following DOIs are duplicates in the bibliography. This table should be empty.
if (length(bib_data$metrics$zotero_dois$duplicate) > 0) {
data.frame(
doi = bib_data$metrics$zotero_dois$duplicate,
link = paste0(bib_data$bibliography$url, "/items/", names(bib_data$metrics$zotero_dois$duplicate))
) |>
dplyr::mutate(
sort = doi,
doi = paste0('<a href="', link, '" target="_blank">', doi, "</a>"),
) |>
dplyr::arrange(
sort
) |>
dplyr::mutate(
sort = NULL
) |>
knitr::kable(
caption = "DOIs in Zenodo which are duplicated",
escape = FALSE
)
}All DOIs should be given as only the DOI without the resolver, i.e. not starting with http. The following table shows all entries which do have a non-conform DOI:
#|
http <- grep("http", bib_data$metrics$zotero_dois$id_raw)
data.frame(
doi = bib_data$metrics$zotero_dois$id_raw[http],
link = paste0(bib_data$bibliography$url, "/items/", names(bib_data$metrics$zotero_dois$id_raw)[http])
) |>
dplyr::mutate(
doi = paste0('<a href="', link, '" target="_blank">', doi, "</a>"),
link = NULL
) |>
knitr::kable(
caption = "DOIs in Zenodo which include a `http`",
escape = FALSE
)Here we do acheck for the structural validity of the dois. This check needs to be improved. Of these 135 are not valid. These are:
#|
if (length(bib_data$metrics$zotero_dois$not_valid) > 0) {
data.frame(
doi = bib_data$metrics$zotero_dois$not_valid,
link = paste0(bib_data$bibliography$url, "/items/", names(bib_data$metrics$zotero_dois$not_valid))
) |>
dplyr::mutate(
doi = paste0('<a href="', link, '" target="_blank">', doi, "</a>"),
link = NULL
) |>
knitr::kable(
caption = "DOIs in Zenodo which ar not valid",
escape = FALSE
)
} else {
print("All DOIs in Zenodo are valid.")
}| doi | |
|---|---|
| DI5GRWTW | 10.1890/1540-9295(2005)003[0259:RWPBPT]2.0.CO;2 |
| I94Q3YHL | 10.1038/nature16512 http://www.nature.com/nature/journal/v530/n7589/abs/nature16512.html#supplementary-information |
| NBPGHAAA | 10.1890/110205| |
| UBXH74FM | 10.1002/wcc.425| |
| 2XWRDXQ7 | 10.1002/eco.1822| |
| UAKDKVJX | 10.1579/0044-7447(2007)36[622:ITIMTT]2.0.CO;2 |
| CRD5HJKU | 074026 10.1088/1748-9326/11/7/074026 |
| EM5MY7Q4 | 10.1371/journal.pone.0158094 • |
| 7TY7XPTL | 20160329 10.1098/rstb.2016.0329 |
| B2WW3M4K | 10.1577/1548-8446(1999)024<0015:LME>2.0.CO;2 |
| P3IPI9CZ | doi.org/10.5282/rcc/8213 |
To validate the existence and validity of the DOIs, we check if the DOIs are in the OpenAlex database.
Of the 1072 unique DOIs in the library, 135 (12.59%) are in not in OpenAlex. This includes the non-valid DOIS, which are filtered out in the table below.
data.frame(
doi = bib_data$metrics$zotero_dois$not_in_oa,
link = paste0(bib_data$bibliography$url, "/items/", names(bib_data$metrics$zotero_dois$not_in_oa))
) |>
dplyr::mutate(
doi = paste0('<a href="', link, '" target="_blank">', doi, "</a>"),
link = NULL
) |>
knitr::kable(
caption = "DOIs in Zenodo which ar not in [OpenAlex](https://OpenAlex.org){target='_blank'}",
escape = FALSE
)TODO Finally we check, if these dois exist but are not ingested into OpenAlex. This is done using the doi.org resolver This is disabled at the moment and still needs to be implemented.
@report{krug,
author = {Krug, Rainer M.},
title = {Bibliography {Report}},
langid = {en},
abstract = {Reports analysing the IPBES Libraries on Zotero.}
}