Skip to main content
archive
Search Submit Donate Log in
Press Enter to search · Advanced search

arXiv
Trackbacks

Trackbacks indicate external web sites that link to articles in arXiv.org. Trackbacks do not reflect the opinion of arXiv.org and may not reflect the opinions of that article's authors.

Trackback guide

By sending a trackback, you can notify arXiv.org that you have created a web page that references a paper. Popular blogging software supports trackback: you can send us a trackback about this paper by giving your software the following trackback URL:

https://arxiv.org/trackback/{arXiv_id}

Some blogging software supports trackback autodiscovery -- in this case, your software will automatically send a trackback as soon as your create a link to our abstract page. See our trackback help page for more information.

Trackbacks for 2101.00027

Specialized LLMs: ChatGPT, LaMDA, Galactica, Codex, Sparrow, and More

[ Towards Data Science - Medium@ INVALID-URL ] trackback posted Fri, 13 Jan 2023 20:24:09 UTC

Modern LLMs: MT-NLG, Chinchilla, Gopher and More

[ Towards Data Science - Medium@ INVALID-URL ] trackback posted Fri, 23 Dec 2022 19:34:45 UTC

I once trained an AI to rhyme, and it took GPT-J a long time

[ Towards Data Science - Medium@ INVALID-URL ] trackback posted Tue, 4 Oct 2022 15:42:16 UTC

When an AI Writes Wikipedia

[ Towards Data Science - Medium@ INVALID-URL ] trackback posted Thu, 13 Jan 2022 14:36:57 UTC

Click to view metadata for 2101.00027

[Submitted on 31 Dec 2020]

Title:The Pile: An 800GB Dataset of Diverse Text for Language Modeling

Authors:Leo Gao, Stella Biderman, Sid Black, Laurence Golding, Travis Hoppe, Charles Foster, Jason Phang, Horace He, Anish Thite, Noa Nabeshima
, Shawn Presser, Connor Leahy
et al. (2 additional authors not shown)
Abstract:
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2101.00027 [cs.CL]
  (or arXiv:2101.00027v1 [cs.CL] for this version)
We gratefully acknowledge support from our major funders, member institutions, , and all contributors.
About · Help · Contact · Subscribe · Copyright · Privacy · Accessibility · Operational Status (opens in new tab)
Major funding support from
Simons Foundation Simons Foundation International Schmidt Sciences