arxiv_metadata_by_year
ArXiv paper metadata organized by publication year.
Open dataset Updated 2026-06-18
What is arxiv_metadata_by_year?
arxiv_metadata_by_year supplies arXiv paper metadata structured by publication year.
Researchers and developers use it for natural language processing and text analysis on scientific literature.
What you can build with arxiv_metadata_by_year
Research Trend Analysis
Analyze shifts in topics like machine learning or NLP by aggregating paper titles, abstracts, and categories across yearly splits.
Author Network Construction
Extract author lists and affiliations to build collaboration graphs filtered by publication year for network analysis.
Category Classification Benchmarking
Train and evaluate NLP models on paper metadata fields such as titles and primary categories using the year-based partitions.
Load arxiv_metadata_by_year
Python
from datasets import load_dataset
ds = load_dataset("bluuebunny/arxiv_metadata_by_year")- 1pip install datasets
- 2from datasets import load_dataset
- 3dataset = load_dataset('bluuebunny/arxiv_metadata_by_year')
- 4Select a year split with dataset['2023'] or similar
- 5Process records with pandas or export to JSON/CSV
arxiv_metadata_by_year: pros & cons
Pros
- +Year-grouped splits enable easy temporal filtering
- +Large scale supports statistical NLP experiments
- +Simple loading via Hugging Face datasets library
- +Focus on metadata keeps files manageable
Cons
- –Only metadata; no full-text PDFs or LaTeX
- –Quality depends on original arXiv submissions
- –Hosted by individual user, no guaranteed long-term maintenance
Did you find this helpful?
Frequently asked questions
A collection of arXiv paper metadata records grouped by year, containing between one and ten million entries in the NLP-text category.
User reviews
Verified reviews from the community shape this listing's rating.
Loading reviews…
Similar datasets
Other text & nlp options worth comparing.