#92 What is arXiv.org?

And how has a digital library made science more accessible?

Thanks for reading the Daily Concept. If you enjoyed this newsletter, forward it to a friend. If someone forwarded you this email, click here to subscribe.

Your faithful writer,
Dr. Daniel Smith

One of my favorite things about the Internet is the way that it enables the spread of knowledge and ideas.

Johannes Gutenberg, the German inventor who is credited with the development of the movable-type printing press in Europe during the 1400s.

In the 1990s, when people began to access the Internet for the first time, some clever folks decided to start what websites where ideas can be stored and accessed for free.

Think of them as digital libraries.

I’ve previously written about the Internet Archive, an amazing digital repository that contains millions of books, audio files, photos, and other fascinating materials.

Today’s newsletter is about arXiv.org (pronounced ‘archive’), a digital library that was created more than thirty years ago to host scientific papers.

It is dedicated to the idea of ‘open science’ and it is home to more than two million scientific papers.

A screenshot from the arXiv.org homepage

It’s been called “the greatest website in the history of websites” by physics professor Chris Orban.

Another physicist, Alex Kohls of CERN, aka the European Organization of Nuclear Research, said that arXiv is:

“The backbone of our field…

It’s not only a tool for physicists and computer scientists—it has had an impact on the overall scholarly communication process.”

While arXiv began in physics, its model has proven so successful that it has expanded to cover a wide range of fields, including mathematics, computer science, quantitative biology, quantitative finance, statistics, electrical engineering, and economics.

This expansion reflects a broader trend towards open science across disciplines, with similar repositories emerging in other fields, such as bioRxiv for biology and chemRxiv for chemistry.

History: arXiv was founded in 1991 by physicist Paul Ginsparg at Los Alamos National Laboratory.

arXiv started as an email chain among a few dozen physicists working on string theory.

This is what the arXiv website looked liked in 1994.

It was designed to address a pressing need in the scientific community: rapid dissemination of research findings.

In the pre-internet era, scientists relied heavily on printed journals and conference proceedings to share their work.

This process was often slow, with months or even years passing between a discovery and its publication.

For fast-moving fields like physics, this delay was particularly problematic.

In the pre-arXiv era, scientists would eagerly await the publication of scientific journals like these to find out what their colleagues have been working on.

Ginsparg's solution was elegantly simple: create an electronic repository where researchers could freely upload their preprints—early versions of scientific papers before formal peer review.

This allowed for near-instantaneous sharing of results with colleagues worldwide.

How it works: Scientists submit their papers to arXiv, where they undergo a basic screening process to ensure they meet minimal scholarly standards.

Once approved, papers become publicly available within 24 hours.

A chart showing arXiv’s yearly submission rate across different scientific disciplines.

For physicists, arXiv is everything.

People in the field commonly say:

“If it's not on arXiv, it doesn't exist.”

Although it’s loved by physicists, arXiv isn’t perfect.

It is not a peer-reviewed journal, and some of the papers published on the website may not survive the scrutiny of peer review.

Other folks point out that the vast majority of the website’s moderators — who choose whether a paper can be published on arXiv or not — are from American and European universities, potentially making it harder for scholars from outside of the West to get their work on arXiv.

Despite these criticisms, arXiv has played a huge part in the development of physics and other scientific fields over the past thirty years.

It makes knowledge more widely available and has been a huge asset to a young generation of digitally-savvy scientists.

It’s so popular that it even sells t-shirts and coffee mugs with the arXiv logo. I love anything that makes learning cool, so I may order one myself.

ART OF THE DAY

A Philosopher Giving That Lecture on the Orrery in Which a Lamp Is Put in Place of the Sun by Joseph Wright (1734-1797).

Thank you for reading. Please reply to this email if you have any thoughts or feedback.

Yours,
Dan