Shadow library

File:Growth of Library Genesis, 2009-2022.png, 2009–2022]]{{Globalize section|date=February 2025|Russia}}

Early predecessors to shadow libraries were informal collections of unauthorized digital copies of books, scholarly literature, and other textual media, often shared with small groups via mailing lists, forums, or social media websites.{{r|Karaganis2018|p=1}} Online communities of scientists also collaborated to share paywalled literature among themselves.{{Cite web |last=Belluz |first=Julia |date=February 18, 2016 |title=Meet the woman who's breaking the law to make science free for all |url=https://www.vox.com/2016/2/18/11047052/alexandra-elbakyan-interview |access-date=February 15, 2025 |website=Vox |language=en-US |archive-date=February 19, 2016 |archive-url=https://web.archive.org/web/20160219100239/http://www.vox.com/2016/2/18/11047052/alexandra-elbakyan-interview |url-status=live }}

File:Russian samizdat and photo negatives of unofficial literature in the USSR.jpg and photo negatives of unofficial literature]]

Many shadow libraries originate in Russia, which has a rich history of samizdat stemming from the Soviet era. There was strict state censorship and control of print materials, which gave rise to the dissident activity of copying and disseminating censored or underground works. Even after the dissolution of the Soviet Union and the end of the official censorship program, these sharing practices continued as a result of widespread economic hardship.{{r|Karaganis2018|pp=31–33}} Texts were widely digitized and shared on Russian FidoNet systems as computer and internet access became more widespread in Russia. One early collection of digitized texts was Maksim Moshkow's 1994 Lib.ru.{{r|Karaganis2018|p=|pages=34–35}} The Russian Kolkhoz collection, named for the kolkhoz collective farms, was created by a community that worked in the early 2000s to download or digitize scientific texts, which they stored on FTP servers and DVDs. This collection eventually grew to around 50,000 documents.{{r|Karaganis2018|p=37|pages=}}

Some of these early collections later became shadow libraries as they attracted volunteer librarians who catalogued the archives' contents. Early academic shadow libraries in the 2000s included Textz.org, Monoskop, and Gigapedia (later Library.nu). Gigapedia focused more on academic texts than other shadow libraries, which mainly contained literature.{{r|Karaganis2018|pp=26–27}} Around 2006 or 2007, it incorporated the files amassed by the Kolkhoz collectors,{{r|Karaganis2018|p=37|pages=}} and had become the largest shadow library by 2010.{{r|Karaganis2018|pp=26–27}} Gigapedia, by then renamed to Library.nu, was shut down in 2012 through a lawsuit from a coalition of seventeen publishing companies including HarperCollins, Oxford University Press, and MacMillan.{{r|Karaganis2018|pp=26–27}}{{Cite web |last=Losowsky |first=Andrew |date=February 15, 2012 |title=Book Downloading Site Targeted By Publishers |url=https://www.huffpost.com/entry/librarynu-book-downloading-injunction_n_1280383 |access-date=February 15, 2025 |website=HuffPost |language=en |archive-date=April 26, 2019 |archive-url=https://web.archive.org/web/20190426135254/https://www.huffpost.com/entry/librarynu-book-downloading-injunction_n_1280383 |url-status=live }}

Library Genesis (also known as LibGen) was founded in approximately 2007 or 2008 by a group of Russian scientists, who began by organizing a collection of Russian science and technology texts made available on a torrent site, aggregated from sources including the Kolkhoz collection and lib.ru.{{r|Karaganis2018|pp=27–28, 38}} In 2011, LibGen absorbed the Library.nu collection, keeping it accessible even as Library.nu was forced to shut down. At the time, LibGen was unique in its focus on its open library infrastructure, prioritizing the free sharing of its collection, catalog, and source code to encourage many others to increase shadow libraries' collective resiliency by mirroring and forking the project.{{r|Karaganis2018|pp=27–28}}

{{See also|Open access|Serials crisis}}

Shadow libraries are part of the open access and open knowledge movements.{{r|Karaganis2018|p=6}}{{Cite web |last=Kodali |first=Srinivas |date=January 16, 2023 |title=Aaron Swartz and His Legacy of Internet Activism |url=https://thewire.in/tech/aaron-swartz-and-his-legacy-of-internet-activism |access-date=February 16, 2025 |website=The Wire |language=en}} They seek to more freely disseminate academic scholarship and other media, often citing a moral imperative to make knowledge freely available.{{cite news |last=Woodcock |first=Claire |date=November 30, 2022 |title='Shadow Libraries' Are Moving Their Pirated Books to The Dark Web After Fed Crackdowns |url=https://www.vice.com/en/article/shadow-libraries-are-moving-their-pirated-books-to-the-dark-web-after-fed-crackdowns/ |url-status=live |archive-url=https://web.archive.org/web/20221130181558/https://www.vice.com/en/article/v7vnn4/shadow-libraries-are-moving-their-pirated-books-to-the-dark-web-after-fed-crackdowns |archive-date=November 30, 2022 |access-date=November 30, 2022 |work=Vice}}

LibGen's operators have described the site's mission as enabling access to information for poor people and opposing the gating of knowledge by elite academic institutions, with one administrator writing "the target groups for LibGen are poors: Africa, India, Pakistan, Iran, Iraq, China, Russia and post-USSR etc., and on a separate note, people who do not belong to academia. If you are not at a university, you can't access anything or at least your access will be so much troubled that you won't be able to progress at all."{{r|Karaganis2018|p=28}} Alexandra Elbakyan, the creator of Sci-Hub, has justified the site by arguing that the lack of open access to scholarship violates the human right to science and culture, captured in Article 27 of the United Nations Universal Declaration of Human Rights, which states: "Everyone has the right freely to participate in the cultural life of the community, to enjoy the arts and to share in scientific advancement and its benefits."{{Cite web |last=Carlton |first=Amy |date=May 31, 2016 |title=Sci-Hub: What It Is and Why It Matters |url=https://americanlibrariesmagazine.org/2016/05/31/why-sci-hub-matters/ |access-date=February 15, 2025 |website=American Libraries |language=en-US |archive-date=September 18, 2016 |archive-url=https://web.archive.org/web/20160918042400/https://americanlibrariesmagazine.org/2016/05/31/why-sci-hub-matters/ |url-status=live }} Elbakyan has also argued that "Any law against knowledge is fundamentally unjust". American activist Aaron Swartz captured the motivations of many shadow libraries in his 2008 Guerilla Open Access Manifesto,{{r|Karaganis2018|pp=28–29}} writing:

{{Blockquote|text=The world's entire scientific and cultural heritage, published over centuries in books and journals, is increasingly being digitized and locked up by a handful of private corporations. ... Those with access to these resources—students, librarians, scientists—you have been given a privilege. You get to feed at this banquet of knowledge while the rest of the world is locked out. But you need not—indeed, morally, you cannot—keep this privilege for yourselves.|author=Aaron Swartz|source=Guerilla Open Access Manifesto{{Cite book|last=Aaron Swartz|author-link=Aaron Swartz|url=http://archive.org/details/GuerillaOpenAccessManifesto|title=Guerilla Open Access Manifesto|year=2008}}}}

Shadow libraries have also cited the increasing cost of academic literature and books, also termed the "serials crisis".{{Cite web |title=Trends in the Price of Academic Titles in the Humanities and Other Fields |url=https://www.amacad.org/humanities-indicators/funding-and-research/trends-price-academic-titles-humanities-and-other-fields |url-status=live |archive-url=https://web.archive.org/web/20210420234525/https://www.amacad.org/humanities-indicators/funding-and-research/trends-price-academic-titles-humanities-and-other-fields |archive-date=April 20, 2021 |access-date=February 15, 2021 |website=American Academy of Arts & Sciences |language=en}}

{{File sharing sidebar}}

Some shadow libraries (or their content databases) make use of BitTorrent (mainly for database dumps), dark web, and InterPlanetary File System (IPFS) technologies to increase their resilience or distribute loads.{{cite news |last=Maxwell |first=Andy |date=December 5, 2019 |title=Meet the Guy Behind the Libgen Torrent Seeding Movement |url=https://torrentfreak.com/meet-the-guy-behind-the-libgen-torrent-seeding-movement-191205/ |url-status=live |archive-url=https://web.archive.org/web/20210513162733/https://torrentfreak.com/meet-the-guy-behind-the-libgen-torrent-seeding-movement-191205/ |archive-date=May 13, 2021 |access-date=October 23, 2020 |work=TorrentFreak |language=en}}{{cite news |last=Wodinsky |first=Shoshana |date=May 14, 2021 |title=Archivists Want to Make Sci-Hub 'Un-Censorable' |url=https://gizmodo.com/archivists-want-to-make-sci-hub-un-censorable-1846898276 |url-status=live |archive-url=https://web.archive.org/web/20221225002941/https://gizmodo.com/archivists-want-to-make-sci-hub-un-censorable-1846898276 |archive-date=December 25, 2022 |access-date=June 13, 2021 |work=Gizmodo}}{{cite news |last=Haldane |first=Matt |date=April 16, 2022 |title=A piece of Web3 tech helps banned books through the Great Firewall's cracks |url=https://www.scmp.com/tech/tech-trends/article/3172431/web3-tech-helps-banned-books-piracy-site-library-genesis-slip |url-status=live |archive-url=https://web.archive.org/web/20221129233050/https://www.scmp.com/tech/tech-trends/article/3172431/web3-tech-helps-banned-books-piracy-site-library-genesis-slip |archive-date=November 29, 2022 |access-date=January 8, 2023 |work=South China Morning Post |language=en}} Shadow libraries including LibGen and Anna's Archive develop and make their software accessible as open source software, enabling code development by any volunteer and encouraging mirrors or forks.{{r|Karaganis2018|pp=27–28}} Anna's Archive claims that "if we get taken down we'll just pop right up elsewhere, since all our code and data is fully open source".{{cite web |title=Frequently Asked Questions (FAQ) |url=https://annas-archive.org/about |access-date=February 15, 2025 |work=Anna's Archive}}

Shadow libraries often host or link to copyrighted material without the consent of copyright holders, making them illegal or dubiously legal in many countries. Such libraries are also described as pirate libraries.{{Cite web |last=Brown |first=Elizabeth Nolan |date=July 24, 2022 |title=You Can't Stop Pirate Libraries |url=https://reason.com/2022/07/24/you-cant-stop-pirate-libraries/ |access-date=February 15, 2025 |website=Reason |language=en-US |archive-date=October 9, 2022 |archive-url=https://web.archive.org/web/20221009180954/https://reason.com/2022/07/24/you-cant-stop-pirate-libraries/ |url-status=live }}{{r|Karaganis2018|pp=|location=4}} Many shadow libraries maintain bibliographic catalogs separate from the hosting of files themselves. This is both an organizational convenience and a protection against legal challenges, since the law is often ambiguous on the distinction between hosting and indexing copyrighted content. However, several shadow library catalogs have been the target of injunctions and takedown threats.{{r|Karaganis2018|pp=|location=25–26}}

The aggressive legal strategies pursued by Western music and film industries against online filesharing websites during the 2000s were not widely mirrored by academic or literary publishers against shadow libraries. However, as shadow libraries have grown larger and more visible, they have attracted more legal challenges. Library.nu (previously Gigapedia) was shut down in 2012 by a lawsuit from a coalition of seventeen publishing companies including HarperCollins, Oxford University Press, and MacMillan.{{r|Karaganis2018|pp=26–27}} In 2015, the academic publisher Elsevier sued LibGen and Sci-Hub in American courts, accusing them of "operat[ing] an international network of piracy and copyright infringement".{{Cite web |last=Waddell |first=Kaveh |date=February 9, 2016 |title=The Research Pirates of the Dark Web |url=https://www.theatlantic.com/technology/archive/2016/02/the-research-pirates-of-the-dark-web/461829/ |access-date=February 15, 2025 |website=The Atlantic |language=en |archive-date=February 15, 2016 |archive-url=https://web.archive.org/web/20160215070845/http://www.theatlantic.com/technology/archive/2016/02/the-research-pirates-of-the-dark-web/461829/ |url-status=live }} Elsevier won a default judgment against the two groups, and was awarded $15{{Nbsp}}million in damages, but has not collected the money as LibGen's operators are unknown and Sci-Hub's are outside the reach of the US legal system.{{Cite web |last=Trager |first=Rebecca |date=November 8, 2017 |title=Latest legal defeat unlikely to scuttle Sci-Hub |url=https://www.chemistryworld.com/news/latest-legal-defeat-unlikely-to-scuttle-sci-hub/3008248.article |access-date=February 15, 2025 |website=Chemistry World |language=en}} Although the judge in the Elsevier case granted an injunction against several domains used by the shadow libraries, briefly taking them offline, the libraries quickly moved to new domains and onion sites.{{Cite web |last=Van der Sar |first=Ernesto |date=November 2, 2015 |title=Court Orders Shutdown of Libgen, Bookfi and Sci-Hub |url=https://torrentfreak.com/court-orders-shutdown-of-libgen-bookfi-and-sci-hub-151102/ |access-date=February 15, 2025 |website=TorrentFreak |language=en |archive-date=May 4, 2020 |archive-url=https://web.archive.org/web/20200504210607/https://torrentfreak.com/court-orders-shutdown-of-libgen-bookfi-and-sci-hub-151102/ |url-status=live }} A lawsuit by the American Chemical Society in 2017 against Sci-Hub also resulted in a judgment order for $4.8{{Nbsp}}million in damages. In November 2022, the FBI seized domains associated with Z-Library and charged two of its operators with criminal copyright infringement, wire fraud, and money laundering.{{Cite web |last=Maiberg |first=Emanuel |date=November 17, 2022 |title=Feds Arrest Two Russians Behind 'World's Largest Library' of Pirated Books |url=https://www.vice.com/en/article/feds-arrest-two-russians-behind-worlds-largest-library-of-pirated-books/ |access-date=February 15, 2025 |website=Vice |language=en-US}} Courts have ordered Internet service providers in countries including Denmark, France, Germany, Russia and the United Kingdom to block access to pirate libraries,{{Cite web |last=Maxwell |first=Andy |date=September 26, 2019 |title=Denmark Blocks Sci-Hub Plus Streaming, Torrent & YouTube-Ripping Sites |url=https://torrentfreak.com/denmark-blocks-sci-hub-plus-streaming-torrent-youtube-ripping-sites-190926/ |access-date=February 15, 2025 |website=TorrentFreak |language=en |archive-date=May 13, 2021 |archive-url=https://web.archive.org/web/20210513124856/https://torrentfreak.com/denmark-blocks-sci-hub-plus-streaming-torrent-youtube-ripping-sites-190926/ |url-status=live }}{{Cite web |last=Maxwell |first=Andy |date=February 18, 2021 |title=Sci-Hub: Elsevier and Springer Nature Obtain UK ISP Blocking Order |url=https://torrentfreak.com/sci-hub-elsevier-and-springer-nature-obtain-uk-isp-blocking-order-210218/ |access-date=February 15, 2025 |website=TorrentFreak |language=en |archive-date=September 27, 2021 |archive-url=https://web.archive.org/web/20210927205216/https://torrentfreak.com/sci-hub-elsevier-and-springer-nature-obtain-uk-isp-blocking-order-210218/ |url-status=live }} although these blocks are of limited effectiveness.{{Cite web |last=Glance |first=David |date=June 15, 2015 |title=Elsevier acts against research article pirate sites and claims irreparable harm |url=https://theconversation.com/elsevier-acts-against-research-article-pirate-sites-and-claims-irreparable-harm-43293 |url-status=live |archive-url=https://web.archive.org/web/20151006181704/https://theconversation.com/elsevier-acts-against-research-article-pirate-sites-and-claims-irreparable-harm-43293 |archive-date=October 6, 2015 |access-date=February 15, 2025 |website=The Conversation |language=en-US}}

The legality of directing individuals to shadow libraries is undetermined. While there are legal theories that linking to copyright infringing material hosted by shadow libraries could constitute vicarious or contributory copyright infringement, there have been no cases brought with these theories. In 2019, Elsevier threatened legal action against Citationsy, the developer of a bibliography management tool, for publishing a blog post directing readers to Sci-Hub and Citationsy removed the link.{{Cite web |last=McKenzie |first=Lindsay |date=August 15, 2019 |title=Linking Liability |url=https://www.insidehighered.com/news/2019/08/16/legal-questions-raised-over-links-sci-hub |url-status=live |archive-url=https://web.archive.org/web/20230110160751/https://www.insidehighered.com/news/2019/08/16/legal-questions-raised-over-links-sci-hub |archive-date=January 10, 2023 |access-date=February 15, 2025 |website=Inside Higher Ed}}

Although most academics are not penalized for distributing their own published works for free, academic publishers have threatened scientists for sharing or republishing their work.{{Cite news |last=Flaherty |first=Colleen |date=October 22, 2019 |title=Where Research Meets Profits |url=https://www.insidehighered.com/news/2019/10/23/what-happened-when-professor-was-accused-sharing-his-own-work-his-website |url-status=live |archive-url=https://web.archive.org/web/20220514192302/https://www.insidehighered.com/news/2019/10/23/what-happened-when-professor-was-accused-sharing-his-own-work-his-website |archive-date=May 14, 2022 |access-date=February 15, 2025 |work=Inside Higher Ed}}

Some publishers have accused shadow libraries including Sci-Hub of illegally obtaining login credentials to academic databases, though Sci-Hub says the credentials are voluntarily donated.{{Cite journal |last=Bohannon |first=John |date=April 28, 2016 |title=Who's downloading pirated papers? Everyone |url=https://www.science.org/content/article/whos-downloading-pirated-papers-everyone |access-date=February 15, 2025 |website=Science |pmid=27126020 |language=en}}

A class action lawsuit filed in June 2023 against ChatGPT developer OpenAI, led by authors Paul Tremblay and Mona Awad, alleged that the company used shadow libraries to source training data for their large language model.{{Cite web |last=Cheng |first=Michelle |date=July 10, 2023 |title="Shadow libraries" are at the heart of the mounting copyright lawsuits against OpenAI |url=https://qz.com/shadow-libraries-are-at-the-heart-of-the-mounting-cop-1850621671 |access-date=February 15, 2025 |website=Quartz}}{{Cite news |last=Creamer |first=Ella |date=July 5, 2023 |title=Authors file a lawsuit against OpenAI for unlawfully 'ingesting' their books |url=https://www.theguardian.com/books/2023/jul/05/authors-file-a-lawsuit-against-openai-for-unlawfully-ingesting-their-books |access-date=February 4, 2025 |work=The Guardian |issn=0261-3077}}{{Cite web |last=Van der Sar |first=Ernesto |date=June 30, 2023 |title=Authors Accuse OpenAI of Using Pirate Sites to Train ChatGPT |url=https://torrentfreak.com/authors-accuse-openai-of-using-pirate-sites-to-train-chatgpt-230630/ |access-date=February 15, 2025 |website=TorrentFreak}} Meta has also been alleged to have used data from shadow libraries to train its AI model.{{Cite magazine |last=Knibbs |first=Kate |date=January 9, 2025 |title=Meta Secretly Trained Its AI on a Notorious Piracy Database, Newly Unredacted Court Docs Reveal |url=https://www.wired.com/story/new-documents-unredacted-meta-copyright-ai-lawsuit/ |access-date=February 16, 2025 |magazine=Wired |issn=1059-1028}}{{Cite web |title=Meta Torrented over 81 TB of Data Through Anna's Archive, Despite Few Seeders |url=https://torrentfreak.com/meta-torrented-over-81-tb-of-data-through-annas-archive-despite-few-seeders-250206/ |website=TorrentFreak}} DeepSeek's Vision-Language (VL) model was trained with data from the shadow library Anna's Archive.{{Cite web |title=Pirate Libraries Are Forbidden Fruit for AI Companies. But at What Cost? * TorrentFreak |url=https://torrentfreak.com/pirate-libraries-are-forbidden-fruit-for-ai-companies-but-at-what-cost-250131/ |access-date=2025-02-16 |language=en}}

Some academics have tacitly or explicitly endorsed shadow library efforts, with many viewing them as morally acceptable acts of civil disobedience against the abusive business models of academic publishers.{{Cite journal |last1=Bodó |first1=Balázs |last2=Antal |first2=Dániel |last3=Puha |first3=Zoltán |date=December 3, 2020 |editor-last=Lozano |editor-first=Sergi |title=Can scholarly pirate libraries bridge the knowledge access gap? An empirical study on the structural conditions of book piracy in global and European academia |journal=PLOS ONE |language=en |volume=15 |issue=12 |pages=e0242509 |doi=10.1371/journal.pone.0242509 |doi-access=free |issn=1932-6203 |pmc=7714232 |pmid=33270680|bibcode=2020PLoSO..1542509B }} Furthermore, shadow libraries may increase the impact of academics whose work is made available. According to one study from Cornell University, articles that are available on Sci-Hub receive 1.72 times as many citations as articles from journals of similar quality that are not available on Sci-Hub.{{cite journal |last1=Correa |first1=Juan C. |last2=Laverde-Rojas |first2=Henry |last3=Tejada |first3=Julian |last4=Marmolejo-Ramos |first4=Fernando |date=January 2022 |title=The Sci-Hub effect on papers' citations |url=https://link.springer.com/article/10.1007/s11192-020-03806-w |url-status=live |journal=Scientometrics |volume=127 |issue=1 |pages=99–126 |doi=10.1007/s11192-020-03806-w |s2cid=234003081 |archive-url=https://web.archive.org/web/20230726191553/https://link.springer.com/article/10.1007/s11192-020-03806-w |archive-date=July 26, 2023 |access-date=July 26, 2023|url-access=subscription }}

Non-academic writers have been more vocally opposed to shadow libraries.

In February 2022, after joining a lawsuit with Amazon Publishing and Penguin Random House against a Ukrainian website selling pirated e-books, American bestselling fiction authors John Grisham and Scott Turow published an op-ed in The Hill calling on US lawmakers to pass a law prohibiting search engines from linking to piracy websites.{{Cite news |last1=Grisham |first1=John |author-link1=John Grisham |last2=Turow |first2=Scott |author-link2=Scott Turow |date=February 14, 2022 |title=Online piracy is a scourge on American authors — Congress must intervene |url=https://thehill.com/opinion/technology/593909-online-piracy-is-a-scourge-on-american-authors-congress-must-intervene/ |archive-url=https://web.archive.org/web/20240917105057/https://thehill.com/opinion/technology/593909-online-piracy-is-a-scourge-on-american-authors-congress-must-intervene/ |archive-date=September 17, 2024 |access-date=February 16, 2025 |work=The Hill |language=en-US |url-status=live }}

In October 2022, the US-based Authors Guild submitted a complaint to the United States Trade Representative about LibGen and Z-Library, describing digital book piracy as "one of the biggest threats facing authors’ livelihoods today".{{Cite report |url=https://www.regulations.gov/comment/USTR-2022-0010-0024 |title=Re: Docket Number USTR-2022-0010 - 2022 Review of Notorious Markets for Counterfeiting and Piracy, 87 FR 52609 |last1=Rasenberger |first1=Mary E. |last2=Kazi |first2=Umair |date=October 7, 2022 |access-date=February 16, 2025}} The Authors Guild and the UK-based Publishers Association both worked with the FBI in efforts against Z-Library, which culminated with November 2022 the arrest of two of its operators.

However, some authors and writers' organizations have opposed such efforts. British novelist Alison Rumfitt wrote in Dazed that she was not celebrating the site's takedown, and that "the hunger to read is something to be encouraged, something which, in my opinion, is a societal good; even as publishing grows ever more overtly capitalist and monopolised, reading still thrives, and piracy allows it to take place despite borders and Digital Rights Management. Not everyone has access to a library, and not every library in the world is well-stocked."{{cite news |last=Rumfitt |first=Alison |author-link=Alison Rumfitt |date=November 25, 2022 |title=In defence of Z-Library and book piracy |url=https://www.dazeddigital.com/life-culture/article/57545/1/in-defence-of-piracy-and-z-library-shut-down-alison-rumfitt-writer-author |url-status=live |archive-url=https://web.archive.org/web/20221125181522/https://www.dazeddigital.com/life-culture/article/57545/1/in-defence-of-piracy-and-z-library-shut-down-alison-rumfitt-writer-author |archive-date=November 25, 2022 |access-date=November 25, 2022 |work=Dazed}} Dave Hansen, executive director of the Authors Alliance nonprofit, expressed that students and researchers would be negatively impacted by attempts to shut down shadow libraries, and expressed that such projects were "a kind of symptom of how broken the system is, particularly when you’re looking at access to scientific articles".

{{reflist}}

• [https://open-slum.org/ SLUM: The Shadow Library Uptime Monitor]

{{Libraries and library science}}

{{Intellectual property activism}}{{Free culture and open content}}

Category:Intellectual property activism

Category:Online databases

Category:Open access (publishing)

Category:Types of library