"One site, scholar.archive.org, has PDFs going back to the 18th century. Itโ€™s empowering to look for this stuff instead of waiting for it to be socially discovered and jammed into my brain."
๐Ÿ’• @ftrain
(h/t @jstogdill for the reference)

For reasons I can't fathom, Internet Archive Scholar got attention today, a mass of it, painting it as a "new" service. Actually, it has been out there for about a year. BUT....

If beautifully structured access to academic citations by the millions is your bag or desperately needed tool, especially ones that are ONLY left in the Wayback Machine, you are in LUCK. And this will be your favorite day. Try it.


๐‘ด ๐‘ข๐‘ฌ, ๐‘ฅ๐‘ฒ ๐‘๐‘ฑ๐‘ก ๐‘ฏ ๐‘š๐‘ป๐‘›๐‘•๐‘ฒ๐‘‘ ๐‘ฉ๐‘’๐‘ฌ๐‘ฏ๐‘‘ ๐‘œ๐‘ง๐‘‘ ๐‘ฉ ๐‘–๐‘ฌ๐‘‘๐‘ฌ๐‘‘ ๐‘ฆ๐‘ฏ ๐‘ฉ ๐‘ฎ๐‘ฐ๐‘•๐‘ฉ๐‘ฏ๐‘‘ ๐‘จ๐‘’๐‘ฉ๐‘›๐‘ง๐‘ฅ๐‘ฆ๐‘’ ๐‘ธ๐‘‘๐‘ฆ๐‘’๐‘ฉ๐‘ค ๐‘ช๐‘ฏ ๐‘ฆ๐‘™๐‘œ๐‘ค๐‘ฆ๐‘— ๐‘•๐‘๐‘ง๐‘ค๐‘ฆ๐‘™ ๐‘ฎ๐‘ฆ๐‘“๐‘น๐‘ฅ. ยท๐‘ฆ๐‘ฏ๐‘‘๐‘ผ๐‘ฏ๐‘ง๐‘‘ ๐‘ธ๐‘’๐‘ฒ๐‘ ๐‘•๐‘’๐‘ช๐‘ค๐‘ผ ๐‘ฆ๐‘Ÿ ๐‘ฉ ๐‘œ๐‘ฎ๐‘ฑ๐‘‘ ๐‘ฎ๐‘ฆ๐‘Ÿ๐‘น๐‘• ๐‘‘ ๐‘ฅ๐‘ฑ๐‘’ ๐‘ฉ๐‘๐‘ฑ๐‘ค๐‘ฉ๐‘š๐‘ฉ๐‘ค ๐‘ž ๐‘“๐‘ฎ๐‘ต๐‘‘๐‘• ๐‘ ๐‘จ๐‘’๐‘ฉ๐‘›๐‘ง๐‘ฅ๐‘ฆ๐‘’ ๐‘ฎ๐‘ฆ๐‘•๐‘ป๐‘—.

โ†’ Oh wow, my page and birdsite account get a shoutout in a recent academic article on English spelling reform. Internet Archive Scholar is a great resource to make available the fruits of academic research.



Pushed a fresh snapshot of fatcat metadata last week:

Hundreds of millions of paper, file, and journal records. More info about these dumps, and schema, at guide.fatcat.wiki/bulk_exports

Scholar is built on an open, editable bibliographic catalog: fatcat.wiki

Most of the records are automatically imported from our wonderful upstream sources, but any human can directly submit corrections and additions through the web interface or API. These submissions are then reviewed in the open before merging. The entire catalog is versioned and can be downloaded in bulk or synchronized using a "changelog" feed.

You can learn more about editing at:

python library 

trafilatura (github.com/adbar/trafilatura) is a nice python library that we use to extract article full text from HTML documents for indexing in scholar. It has good accuracy and recall, works with "old" HTML (eg from web archives), and pulls out metadata like title, author, and date. There are lots of similar tools, mostly focused on news articles, and trafilatura is an improvement.

Thanks to Adrien Barbaresi for maintaining it!

A less-known feature of IA Scholar is that every search result page has an RSS feed, via the link under the search bar.

Quick and easy way to keep up with a specific topic, venue, or author in your feed reader!

Scholars continue to publish papers in Latin, well in to the twenty first century! Here is a snippets of Dennis Toscano's Masters thesis from the University of Kentucky (2016), contextualizing an anonymous poem, itself in Latin, from 1741:

Opus cui titulus est "Carthago Indiarum obsessa sed non expugnata" est carmen divulgatum sine nomine auctoris saeculo duodevicesimo ad celebrandam victoriam quam Hispani a Britannis Carthagenae Indiarum anno...


Quadratic Equation, in Braille. Via Visual impairment in MSOR by Emma Jane Rowlett and Peter James Rowlett (2010)

Internet Archive

A Mastodon Server for Internet Archive employees and Role Accounts (Announcements)