NovelAI
{{Short description|Online service for AI media creation}}
{{Use mdy dates|date=October 2023}}
{{Infobox software
| title =
| name = NovelAI
| logo = NovelAI Logo.svg
| logo size =
| screenshot = NovelAI-TextGeneration-MainPage.png
| collapsible = yes
| collapsetext = Screenshot
| caption = A screenshot of the main text generation page in May 2025
| released = 2021
| genre = Text-generation model, text-to-image model
| license = Proprietary
| website = {{URL|https://novelai.net/}}
}}
NovelAI is an online cloud-based, SaaS model, and a paid subscription service for AI-assisted storywriting{{cite web|url=https://techcrunch.com/2022/08/24/deepfakes-for-all-uncensored-ai-art-model-prompts-ethics-questions/|author=Kyle Wiggers|date=August 24, 2022|title=Deepfakes for all: Uncensored AI art model prompts ethics questions|website=TechCrunch|quote=For example, NovelAI has been experimenting with Stable Diffusion to produce art that can accompany the AI-generated stories created by users on its platform.}}{{Cite web |title=NVIDIA Hopper GPUs Expand Reach as Demand for AI Grows |url=http://nvidianews.nvidia.com/news/nvidia-hopper-gpus-expand-reach-as-demand-for-ai-grows |access-date=2023-06-09 |website=NVIDIA Newsroom |language=en-us}} and text-to-image synthesis, originally launched in beta on June 15, 2021,{{cite web |author=Max Hjelm |date=October 20, 2021 |title=How CoreWeave Helped NovelAI Grow from 0 to 40K Users in 3 Months |url=https://www.coreweave.com/blog/how-coreweave-helped-novelai-grow-from-0-to-40k-users-in-3-months |website=coreweave |language=en}} with the image generation feature being implemented later on October 3, 2022.{{cite web|url=https://www.itmedia.co.jp/news/articles/2210/03/news146.html|author=Daiki Yoshikawa|date=October 3, 2022|title=「とんでもなくハイクオリティー」 話題の画像AI「Novel AI」でひたすら二次元美少女と美少年を生成してみた|website=ITmedia News|language=ja}} NovelAI is owned and operated by Anlatan, which is headquartered in Wilmington, Delaware.{{cite web|date=October 5, 2022|url=https://news.yahoo.co.jp/articles/28342a1760191ecb3caeab04b99555d67b09892d|title=画像生成AIサービス「NovelAI Diffusion」が無断転載サイトからの学習で物議 法的観点からも複雑な事態に|website=Yahoo! Japan News|language=ja|access-date=October 6, 2022|archive-date=October 19, 2022|archive-url=https://web.archive.org/web/20221019042628/https://news.yahoo.co.jp/articles/28342a1760191ecb3caeab04b99555d67b09892d|url-status=dead}}
Features
File:NovelAI-ImageGeneration-MainPage.png
NovelAI uses GPT-based large language models (LLMs){{cite web|url=https://www.prnewswire.com/news-releases/coreweave-partners-with-eleutherai--novelai-to-make-open-source-ai-more-accessible-301474123.html|date=February 2, 2022|title=CoreWeave partners with EleutherAI & NovelAI to make open-source AI more accessible|website=PR Newswire}}{{cite web|url=https://www.infoq.com/news/2021/08/openai-codex/|author=Anthony Alford|date=August 31, 2021|title=OpenAI Announces 12 Billion Parameter Code-Generation AI Codex|website=InfoQ}} to generate storywriting and prose.{{cite web|url=https://dataconomy.com/2022/10/novelai-novelaidiffusion|date=October 3, 2022|title=NovelAI Features|website=Dataconomy}} It has several models, such as Calliope, Sigurd, Euterpe, Krake, and Genji, with Genji being a Japanese-language model.{{Cite web |last=NovelAI |date=2022-05-30 |title=The faces of NovelAI's AI Models: Part 1 |url=https://blog.novelai.net/the-faces-of-novelais-ai-models-part-1-6c93576fa48b |access-date=2023-08-21 |website=Medium |language=en}}{{Cite web |last=NovelAI |date=2022-05-30 |title=The Faces of NovelAI's AI Models: Part 2 |url=https://blog.novelai.net/the-faces-of-novelais-ai-models-part-2-f5774100e77a |access-date=2023-08-21 |website=Medium |language=en}} The service also offers encrypted servers and customizable editors.{{Cite web |last=Murch |first=Peter |date=2023-05-31 |title=Best AI Story Generators in 2023 |url=https://www.pcguide.com/apps/best-ai-story-generators/ |access-date=2023-06-09 |website=PC Guide |language=en-US}}
For AI art generation, which generates images from text prompts, NovelAI uses a custom version of the source-available Stable Diffusion text-to-image diffusion model called NovelAI Diffusion, which is trained on a Danbooru-based{{cite web |date=October 4, 2022 |title=插畫AI又陷爭議!Novel AI官方自爆以非法搬運網站當訓練來源 生成圖片竟自帶簽名? |url=https://udn.com/news/story/122589/6660894 |website=United Daily News |language=zh-tw |quote=Novel AI 近期在官方推特留言區回覆網友留言時, 提及自家人工智慧有透過名叫「Danbooru」的 ACG 圖片網站進行訓練... 許多圖片多來自 pixiv 跟推特的繪師二創、原創作畫... 隨著爭議引爆, 消息也傳到日本, 引起創作者的關切. |trans-quote=NovelAI recently responded to an online commentator's message on its official Twitter, stating that the AI was trained through the ACG image website "Danbooru"... Many pictures are reposts of fanarts and original artworks from Pixiv and Twitter... As the controversy unfurled, the news also reached Japan, causing concern among content creators.}} dataset.
NovelAI is also capable of generating a new image based on an existing image. The NovelAI terms of service states that all generated content belongs to the user, regardless if the user is an individual or a corporation. Anlatan states that generated images are not stored locally on their servers.
History
On April 28, 2021, Anlatan officially launched NovelAI.{{Cite web |last=NovelAI |date=2022-03-06 |title=The 1st NovelAI Stream & Q&A Summary |url=https://blog.novelai.net/first-off-thank-you-all-for-making-the-first-novelai-twitch-stream-a-blast-e32806be7ae1 |access-date=2023-06-09 |website=Medium |language=en}}
On June 15, 2021, Anlatan released their finetuned GPT-Neo-2.7B model from EleutherAI named Calliope, after the Greek Muses. A day later, they released their Opus-exclusive GPT-J-6B finetuned model named Sigurd, after the Norse/Germanic hero.
On March 21, 2023, Nvidia and CoreWeave announced Anlatan being one of the first CoreWeave customers to deploy NVIDIA's H100 Tensor Core GPUs{{Cite web |title=NVIDIA H100 Tensor Core GPU |url=https://www.nvidia.com/en-us/data-center/h100/ |access-date=2023-06-09 |website=NVIDIA |language=en-us}} for new LLM model inferencing and training.{{Cite web |title=CoreWeave Announces NovelAI as Among the First to Have NVIDIA HGX H100 GPUs Online — CoreWeave |url=https://www.coreweave.com/blog/coreweave-announces-novelai-as-among-the-first-to-have-nvidia-hgx-h100-gpus-online |access-date=2023-06-09 |website=www.coreweave.com |language=en |quote="Anlatan, developers of NovelAI, will be among the first to deploy the latest NVIDIA H100 Tensor Core GPUs on CoreWeave, which began offering the new instances to select customers in February."}}{{Cite web |date=2023-03-21 |title=CoreWeave Announces NovelAI as Among the First to Have NVIDIA HGX H100 GPUs Online |url=https://www.businesswire.com/news/home/20230321005245/en/CoreWeave-Announces-NovelAI-as-Among-the-First-to-Have-NVIDIA-HGX-H100-GPUs-Online |access-date=2023-06-09 |website=www.businesswire.com |language=en |quote="NovelAI, a generative AI company that creates literature and imagery with users' personal perspective and voice, will be one of the first customers to use CoreWeave's NVIDIA HGX H100 instances;"}}
On April 1, 2023, Anlatan added ControlNet features to their text-to-image NovelAI Diffusion model.{{Cite web |date=2023-04-02 |title=NovelAIのControlNet(ControlTools/コントロールツール)の使い方を解説!{{!}} あきとのぶろぐ |trans-title=ControlNet appears in Novel AI! (How to use control tools) |url=https://henmi-hiro.com/novelai-control-tools |access-date=2023-06-09 |website=Blog with Aki |language=ja |quote=今回は、2023/4/1のNovelAIアップデートで追加された「ControlTools(コントロールツール)」についての記事になります!This time, it will be an article about " ControlTools" added in the NovelAI update on April 1, 2023!}}{{Cite web |date=2023-04-02 |title=Novel AIにControlNetが登場!(コントロールツールの使い方) |url=https://blogcake.net/novelai-controlnet/ |access-date=2023-06-09 |website=BLOG CAKE |language=ja |quote="Novel AIが、2023年4月1日に大型アップデートを発表したので、チェックしたいと思います.Novel AI has announced a major update on April 1, 2023, so I would like to check it out."}}
On May 16, 2023, Anlatan announced that they named their H100 cluster Shoggy, a reference to H.P. Lovecraft's Shoggoths, which was used to pre-train an undisclosed 8192 token context LLM in-house model.{{Cite news |last=Roose |first=Kevin |date=2023-05-30 |title=Why an Octopus-like Creature Has Come to Symbolize the State of A.I. |language=en-US |work=The New York Times |url=https://www.nytimes.com/2023/05/30/technology/shoggoth-meme-ai.html |access-date=2023-06-09 |issn=0362-4331}}
Reception and controversy
File:Furry art of a dragon generated by NovelAI, 67578668.png diffusion model, depicting a dragon in a forest]]
Following the implementation of image generation, NovelAI became a widely-discussed topic in Japan, with some online commentators noting that its image synthesis features are very adept at producing close impressions of anime characters, including lolicon and shotacon imagery,{{cite web|date=October 4, 2022|url=https://www.4gamers.com.tw/news/detail/55380/novalai-twitter-trend|title=推特熱議「NovelAI」大量產出高水準動漫圖, 繪師圈憂著作權爭議難解|trans-quote=Of course, widely discussed is the large number of lolicon drawings produced by NovelAI... The subject matter of these images are quite broad, and contain elements such as shōjo, angels, swimsuits, queens, and even lesbians and shotacon|website=4Gamers|language=zh-tw|quote=當然, 引起話題討論最多的是 NovelAI 所產出的大量蘿莉繪圖...這些圖片的題材非常廣泛, 也包含許多令人熟悉的要素, 如少女、天使、泳裝、女王、甚至百合或正太等領域}} while others have expressed concern that it is a paid service reliant on a diffusion model, while the original machine learning training data consists of images used without the consent of the original artists.{{cite web|date=October 4, 2022|url=https://www.gamespark.jp/article/2022/10/04/123099.html|title=様々な懸念や問題を抱えつつも「お絵かきAI」の進化は止まらず―AI技術の将来は如何に|website=Gamespark|language=ja|quote=AIの学習元がイラスト無断転載サイト「danbooru」である点が指摘されています... NovelAIは有料プランが前提となっているため、「金を取るのは流石におかしいのでは」といった声も上がっています.|trans-quote=It has been pointed out that the training material for the AI is Danbooru, an unauthorised illustration reuploading website... Since NovelAI works off a paid subscription, there has also been commentary saying that "it's definitely fucked up to be taking money".}} Attorney Kosuke Terauchi notes that, since a revision of the law in 2018, it is no longer illegal in Japan for machine learning models to scrape copyrighted content from the internet to use as training data; meanwhile, in the United States where NovelAI is based, there is no specific legal framework which regulates machine learning, and thus the fair use doctrine of US copyright law applies instead. Danbooru has posted an official statement in regards to NovelAI's use of the site's content for AI training, expressing that Danbooru is not affiliated with NovelAI, and does not endorse nor condone NovelAI's use of artists' artworks for machine learning.{{cite web|date=October 5, 2022|url=https://news.nicovideo.jp/watch/nw11522341|title=「われわれはNovelAIと関係ない」──海外のイラストサイト「Danbooru」が日本語で声明|website=NicoNico News|language=ja|quote=海外のイラストサイト「Danbooru」は10月5日までに、画像生成AI「NovelAI Diffusion」(NovelAI)と無関係であると主張する声明を発表した... その中で、NovelAIの公式Twitterアカウント(@novelaiofficial)は、データ学習元にDanbooruを使っていると投稿.Twitter上ではNovelAIの違法性を問う声も上がっており... 声明では「われわれがNovelAIに関係していないことと、彼らがしてることを、支持はおろか容認もしていない」と公表.|trans-quote=On October 5, the overseas illustration website "Danbooru" released a statement stating that it had nothing to do with the image generation AI "NovelAI Diffusion" (NovelAI)... Among them, NovelAI's official Twitter account (@novelaiofficial) posted that it uses Danbooru as its training data. On Twitter, there are also voices questioning whether or not NovelAI is operating illegally... "We are not affiliated with NovelAI, and we do not endorse nor condone what they are doing," the statement said.|access-date=October 6, 2022|archive-date=October 19, 2022|archive-url=https://web.archive.org/web/20221019041318/https://news.nicovideo.jp/watch/nw11522341|url-status=dead}}{{cite web|date=October 5, 2022|url=https://gigazine.net/news/20221005-novelai-danbooru/|title=イラスト自動生成AI「NovelAI」について学習元となったDanbooru公式が声明を発表|website=Gigazine|language=ja|quote=学習したデータセットに海外の二次元画像サイト・Danbooruの画像を多く含んでいるといわれています.そんなDanbooruの公式運営チームが、NovelAIについて声明を発表しました... しかし、Danbooruにアップロードされている二次元イラストの多くがPixivやTwitterなどのSNSに投稿された作品の転載であることが問題となっています... 画像生成部分についてはStable Diffusionにならっていながら、独自のアルゴリズムを実装しているとのこと.|trans-quote=The training dataset contains many images from the overseas 2D image site Danbooru. Danbooru's official management team issued a statement about NovelAI... However, many of the 2D illustrations uploaded to Danbooru are reuploads of works posted on social media such as Pixiv and Twitter... In regards to the site's image generation feature, it implements its own algorithm based on Stable Diffusion.}}
FayerWayer described NovelAI as a service capable of generating hentai.{{cite web|last=Perry|first=York|date=October 11, 2022|url=https://www.fayerwayer.com/ciencia/2022/10/11/lanzan-nueva-inteligencia-artificial-que-crea-ilustraciones-de-anime-un-tanto-candentes/|title=Lanzan nueva Inteligencia Artificial que crea ilustraciones de animé un tanto candentes|website=FayerWayer|language=es}} Manga artist Izumi Ū commented that while the manga style art generated by NovelAI is highly accurate, there are still imperfections in the output, although he views these as human-like in a favourable light nonetheless.{{cite web|author=Kouta Mukaihara|date=October 13, 2022|url=https://realsound.jp/book/2022/10/post-1152173.html|title=プロ漫画家が話題の"お絵描きAI"を使うと? 元週刊少年誌連載作家が示した"違和感"と可能性|website=Real Sound|language=ja}}
In response to the topic of NovelAI, Narugami, founder of the Japanese freelance artist commissioning website Skeb, stated on October 5, 2022 that the use of AI image generation is prohibited on the platform since 2018.{{cite web|date=October 5, 2022|url=https://news.yahoo.co.jp/articles/a893d3a0ed53458249d0eb1215fb3850ce488831|title=「SkebはツールとしてのAI利用を認めていない」 創業者が明言 規約には4年前から記載|website=Yahoo! News Japan|language=ja|quote=「Skebでは現在、ツールとしてのAIの利用を一律して認めていない」──イラスト発注サイト「Skeb」を運営するスケブ(東京都港区)の創業者のなるがみ... 画像生成AI「NovelAI Diffusion」(NovelAI)が話題になっていることを受け、AIについて自身の意見を述べている.|trans-quote="Skeb currently rules out permitting the use of AI as a tool", states the founder of illustration commissioning site Skeb (based in Minato Ward, Tokyo), Narugami... In response to the issue relating to image generation AI "NovelAI Diffusion" (NovelAI), he expressed his view on AI.|access-date=October 6, 2022|archive-date=October 7, 2022|archive-url=https://web.archive.org/web/20221007205950/https://news.yahoo.co.jp/articles/a893d3a0ed53458249d0eb1215fb3850ce488831|url-status=dead}} Illustrations using NovelAI have been posted on social media and illustration posting sites, and by October 13, 2,111 works tagged with #NovelAI were posted on Pixiv. Pixiv has stated that it is not considering a complete elimination of creations that use AI,{{cite web|url=https://www.itmedia.co.jp/news/articles/2210/13/news123.html|author=Tatsuki Matsuura|date=October 13, 2022|title=ピクシブ、AIイラストの「完全な排斥は考えていない」 創作コミュニティーとの"共存"模索中 |website=ITmedia News|language=ja}} though it requires AI-generated posts to be marked as such and allows users to filter them out.{{cite web |title=pixiv's policy on AI-generated work |url=https://www.pixiv.net/info.php?id=8710 |website=pixiv |access-date=29 November 2022 |language=en}}
Incidents
On October 6, 2022, NovelAI experienced a data breach where its software's source code was leaked.{{cite web|date=2022-10-11|url=https://gigazine.net/news/20221011-novelai-model-improvements-stable-diffusion/|title=超高精度なイラストを生成できると話題の「NovelAI」は本家Stable Diffusionにどんな改善を加えたのか?|website=Gigazine|language=ja|quote=そして2022年10月6日、NovelAIの公式Twitterアカウントは、AnlatanのGitHubリポジトリがハッキングに遭い、NovelAIのソースコードが流出したと発表しました.|trans-quote=On October 6, 2022, NovelAI's official Twitter account announced that Anlatan's GitHub repository was breached, and that NovelAI's source code was leaked.}}{{cite web|date=December 2, 2022|url=https://ascii.jp/elem/000/004/115/4115793/|title=画像生成AIの激変は序の口に過ぎない|website=ASCII.jp|archive-url=https://web.archive.org/web/20221202200810/https://ascii.jp/elem/000/004/115/4115793/|archive-date=December 2, 2022|url-status=live|quote=最も影響が大きかったのは10月8日に起きたとされる「Novel AI」のソースコード流出事件です.どういった形でハッキングされたのかは明らかにされていませんが、流出したとされるコードはおそらく本物だという結論になっています.|trans-quote=The biggest impact was the leak of NovelAI's source code, which reportedly occurred on October 8. It is not clear how the breach occurred, but it is very likely that the leaked code is genuine.}}
See also
References
{{reflist|refs=
- {{cite web|date=October 10, 2022|url=https://www.sohu.com/a/591569563_104421|title=二次元 AI 作画、续写精彩故事, 网友: 这个网站画师要失业了 |website=Sohu|language=zh|quote=今天我们将要介绍一款最近比较热门的网站 NovelAI, 它既能自动续写小说, 还能进行绘画.|trans-quote=Today we will be looking at NovelAI, a website making the rounds recently, which can automatically continue writing novels, and also can perform paintings.}}
- {{cite news|date=October 9, 2022|url=https://elcomercio.pe/tecnologia/actualidad/joven-japones-uso-inteligencia-artificial-para-recrearse-a-si-mismo-al-lado-de-una-chica-de-anime-ia-espana-mexico-usa-noticia/|title=Joven japonés usó inteligencia artificial para recrearse a sí mismo al lado de una chica de anime|website=El Comercio|language=es}}
- {{cite web|date=October 14, 2022|url=https://www.playground.ru/misc/news/igroki_sozdayut_zabavnye_fan_arty_s_pomoschyu_iskusstvennogo_intellekta_novelai-1239947|title=Игроки создают забавные фан-арты с помощью искусственного интеллекта NovelAI©|website=PlayGround.ru|language=ru}}
- {{cite web|last=Jiang|first=Sisi|date=October 13, 2022|url=https://kotaku.com/genshin-impact-fanart-ai-generated-stolen-twitch-1849655704|title=Thief Steals Genshin Impact Fan Art Using AI, Demands Credit From Creator|website=Kotaku}}
- {{cite web|last=Ярсанаев|first=Руслан|date=October 12, 2022|url=https://kanobu.ru/news/s-pomoschyu-nejroseti-zloumyishlennik-ukral-fan-art-po-genshin-impact-457863/|title=С помощью нейросети злоумышленник «украл» фан-арт по Genshin Impact|website=Kanobu.ru|language=ru}}
- {{cite web|date=October 16, 2022|url=https://www.cnbeta.com/articles/tech/1327643.htm|title=人人都能用的"AI 作画", 要成为英伟达的杀手锏?|website=cnBeta.COM|language=zh}}
- {{cite web|last=Small|first=Zachary|date=October 24, 2022|url=https://news.artnet.com/art-world/artificial-intelligence-illustration-spawning-2195919|title=A.I. Is Exploding the Illustration World. Here's How Artists Are Racing to Catch Up|website=Artnet}}
- {{cite web|date=October 10, 2022|url=https://36kr.com/p/1950585159289217|title=AI作画的人机战争走向何方?|website=36Kr|language=zh}}
- {{cite web|url=https://thethaiger.com/th/news/677593/|date=October 5, 2022|title=NovelAI บริการวาดภาพด้วย AI รูปแบบอนิเมะสุดเจ๋ง|website=Thaiger|language=th}}
- {{cite web|url=https://myjitsu.jp/enta/archives/113202|date=October 16, 2022|title=AIイラスト問題がVTuberにも波及!「ホロライブ」夏色まつりや白上フブキが注意喚起|website=Myjitsu|language=ja}}
}}
External links
- {{commons category-inline|NovelAI}}
- {{official website|https://novelai.net/}}
Category:Anime and manga fandom
Category:Deep learning software applications
Category:Text-to-image generation
Category:Unsupervised learning