Open Scholarly Data @ SUB Göttingen - Overview
We use Google Big Query to work with large open scholarly data. Our main data sources are Unpaywall, Crossref and OpenAlex.
An overview of our data warehouse including procedures to load the data into BigQuery can be found below.
Anyone can view and query our publicly available Open Scholarly Data warehouse on BigQuery with a Google Cloud Computing account. Note that Google will charge you for the number of bytes processed by each query (currently $ 6.25 per 1 TB).
Status Crossref
Current Snapshot (cr_instant)
| Snapshot | File | Table | Procedure | Last Changed | Coverage | Number of rows |
|---|---|---|---|---|---|---|
| 2025/09 | all.json.tar.gz | Repo | 13.10.2025 | All | 174.120.457 |
Historical Snapshots (cr_history)
Info: Only includes publications with type ‘journal-article’
| Snapshot | File | Table | Procedure | Last Changed | Coverage | Number of rows |
|---|---|---|---|---|---|---|
| 2018/04 | all.json.tar.gz | Repo | 20.02.2022 | 2013-2018 | 16.766.035 | |
| 2019/04 | all.json.tar.gz | Repo | 29.10.2021 | 2013-2019 | 20.715.644 | |
| 2020/04 | all.json.tar.gz | Repo | 29.10.2021 | 2013-2020 | 25.334.525 | |
| 2021/04 | all.json.tar.gz | Repo | 29.10.2021 | 2013-2021 | 30.579.119 | |
| 2022/04 | all.json.tar.gz | Repo | 14.05.2022 | 2013-2022 | 35.939.195 | |
| 2023/04 | all.json.tar.gz | Repo | 07.05.2023 | 2013-2023 | 41.767.461 | |
| 2024/04 | all.json.tar.gz | Repo | 07.05.2024 | 2013-2024 | 47.709.184 |
Status Unpaywall
Current Snapshot (upw_instant)
| Snapshot | File | Table | Procedure | Last Changed | Coverage | Number of rows |
|---|---|---|---|---|---|---|
| 2024/11 | unpaywall_snapshot_2024-11-27T031702.jsonl.gz | Repo | 23.06.2025 | 2008-2025 | 94.924.816 |
Historical Snapshots (upw_history)
| Snapshot | File | Table | Procedure | Last Changed | Coverage | Number of rows |
|---|---|---|---|---|---|---|
| 2018/03 | unpaywall_snapshot_2018-03-29T113154.jsonl.gz | Repo | 29.10.2021 | 2008-2018 | 36.557.043 | |
| 2019/02 | unpaywall_snapshot_2019-02-21T031509.jsonl.gz | Repo | 10.11.2021 | 2008-2019 | 42.143.979 | |
| 2020/02 | unpaywall_snapshot_2020-02-25T115244.jsonl.gz | Repo | 30.10.2021 | 2008-2020 | 49.717.710 | |
| 2021/02 | unpaywall_snapshot_2021-02-18T160139.jsonl.gz | Repo | 29.10.2021 | 2008-2021 | 58.437.927 | |
| 2022/03 | unpaywall_snapshot_2022-03-09T083001.jsonl.gz | Repo | 14.03.2022 | 2008-2022 | 67.424.819 |
Status Semantic Scholar
| Snapshot | Directory | Table | Procedure | Last Changed | Coverage | Number of rows |
|---|---|---|---|---|---|---|
| 2025-02-25 | papers/ | Repo | 04.03.2025 | All | 224.566.486 | |
| 2025-02-25 | venues/ | Repo | 04.03.2025 | All | 194.578 | |
| 2025-02-25 | abstracts/ | Repo | 04.03.2025 | All | 108.246.108 |
Status OpenAlex
| Snapshot | Directory | Table | Procedure | Last Changed | Coverage | Number of rows |
|---|---|---|---|---|---|---|
| 2025-09-30 | authors/ | Repo | 16.10.2025 | All | 104.942.999 | |
| 2025-10-01 | funders/ | Repo | 16.10.2025 | All | 32.437 | |
| 2025-10-01 | institutions/ | Repo | 16.10.2025 | All | 117.731 | |
| 2025-10-01 | publishers/ | Repo | 16.10.2025 | All | 10.741 | |
| 2025-10-01 | sources/ | Repo | 16.10.2025 | All | 260.787 | |
| 2025-09-29 | topics/ | Repo | 16.10.2025 | All | 4.516 | |
| 2025-09-30 | works/ | Repo | 16.10.2025 | All | 271.335.309 |
Status OpenAlex-Walden
| Snapshot | Directory | Table | Procedure | Last Changed | Coverage | Number of rows |
|---|---|---|---|---|---|---|
| 2025-11-05 | authors/ | Repo | 03.12.2025 | All | 115.794.829 | |
| 2023-02-13 | funders/ | Repo | 03.12.2025 | All | 32.437 | |
| 2025-11-11 | institutions/ | Repo | 03.12.2025 | All | 102.539 | |
| 2025-07-02 | publishers/ | Repo | 03.12.2025 | All | 16 | |
| 2025-11-02 | sources/ | Repo | 03.12.2025 | All | 255.250 | |
| 2024-12-04 | topics/ | Repo | 03.12.2025 | All | 4.516 | |
| 2025-11-11 | works/ | Repo | 03.12.2025 | All | 463.042.077 |
Status OPENBIB
| Snapshot | Table | Procedure | Last Changed | Coverage | Number of rows |
|---|---|---|---|---|---|
| 2025-05-01 | Repo | 11.04.2025 | 2014-2024 | 373 | |
| 2025-05-01 | Repo | 11.04.2025 | 2014-2024 | 212 | |
| 2025-05-01 | Repo | 14.04.2025 | 2020-2024 | 9.255 | |
| 2025-05-01 | Repo | 28.03.2025 | 2014-2024 | 56.063.628 | |
| 2025-05-01 | Repo | 14.04.2025 | All | 9.903.725 | |
| 2025-05-01 | Repo | 14.04.2025 | All | 9.900.278 | |
| 2025-05-01 | Repo | 14.04.2025 | All | 2.759 | |
| 2025-05-01 | Repo | 28.03.2025 | All | 91 | |
| 2025-05-01 | Repo | 28.03.2025 | All | 22 | |
| 2025-05-01 | Repo | 14.04.2025 | 2018-2025 | 1.996.190 | |
| 2025-05-01 | Repo | 14.04.2025 | 2018-2025 | 1.285 | |
| 2025-05-01 | Repo | 14.04.2025 | 2018-2025 | 28.007 | |
| 2025-05-01 | Repo | 14.04.2025 | 2018-2025 | 491.218 |
Status OpenAlex Document Type classification by SUB Göttingen
Info: Only includes publications with type ‘article’ or ‘review’ and primary source type ‘journal’
| Snapshot | Directory | Table | Procedure | Last Changed | Coverage | Number of rows |
|---|---|---|---|---|---|---|
| 2025-09-30 | works/ | Repo | 16.10.2025 | 2014-2025 | 62.841.950 |