Hacker News new | past | comments | ask | show | jobs | submit login
Show HN: Tensorpedia – Using GPT-2 to synthesize Wikipedia articles (jonahsussman.net)
18 points by JonahSussman 6 days ago | hide | past | favorite | 11 comments

Hey HN! I've been lurking for a while now and I've finally created something that I feel is worth sharing.

I've called this project "Tensorpedia." At its core, Tensorpedia takes in a title and utilizes it as a prompt for GPT-2 to synthesize the introductory part of a Wikipedia article. The machine learning stuff is written using a wonderful library called aitextgen [0], using Wikipedia's "Vital Articles" as a data set [1]. The server is written in Node, and it uses Redis as an article cache. If you want to read my article about it (for some reason), you can check it out here [2].

I created this project to get more experience with server technologies. While I wouldn't say it's a complicated application, I learned quite a lot from it.

Additionally, as I was inspired by all of those this-x-doesn't-exist projects from a while back, this project is mostly for fun. As such, I don't know how much practical use it has, but I've generated some pretty hilarious articles from it.

[0] https://github.com/minimaxir/aitextgen

[1] https://en.wikipedia.org/wiki/Wikipedia:Vital_articles/Level...

[2] https://jonahsussman.net/posts/2022-01-this-wiki-dne/

Evil! :-)

Have you thought of feeding it facts from https://www.wikidata.org/ and let it construct articles that way?

I thought about using wikidata, but I'm not quite sure how I would feed it into the neural network. It's definitely a possibility though!

Great idea, although it's a bit annoying that none of the article links works as an actual link, so I can't easily open pages in a new tab like I often do when reading a Wikipedia article.

That's actually a fantastic idea! I'll add it in my next update

I see it's already live, thanks very much.

This is my favorite new thing of the day. Thanks!

Thank you so much! Glad it brought you some enjoyment!

I had some good fun reading some of these articles. Absolutely absurd

I had a good chuckle putting my colleague's names in it - everyone was a superstar, famous poet, or swimmer of some sort. Any good ones you wouldn't mind sharing?

I tried Josh and quite liked "She married Abraham Van Helsing in 1849 and was the only woman to win a Henry VI throne that year."

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact