So I decided to build it overnight and open source it.
The majority of the functionality is handled by Algolia and Saasify which is the only reason this was possible to build so quickly.
Would love to hear people's thoughts - thanks!
The core functionality when logged in is written in React using Chakra UI.
What a bummer. I like a lot of very funny or informative stuff on twitter and the tweets often pop into my head even years later. Sometimes I wanna find that tweet (eg to share) and I can’t.
I started using pinboard.in, which archives all my likes, but the search suuuucks.
So, I started building my own archive tool, but the search part is still hard.
I have looked into annoy, perkeep, tf-idf, Doc2Vec, and various other tools, but nothing really works as well as I had hoped.
Your project definitely gave me some ideas! Thanks.
Documentation for doing that here: https://github.com/dogsheep/twitter-to-sqlite#importing-data...
I suspect they probably keep all likes, but do not expose them.
Another premium service that searches your Twitter like is https://www.favourites.io/, but it's too costly for me. I might pay $10 for a yearly subscription, but not 29 GBP/year, which is ~10% of my monthly rent.
In the case of Twitter's API, third-party apps can access all of your history if you upgrade to a paid partnership plan.
You can use Twitter Archive Eraser to browse the whole archive, search by keywords, regular expressions, mentions, tweet type, media etc.
Twitter Archive Eraser allows you to bulk delete thousands of tweets at once also.
What's also annoying is that I don't think there's a way to exclude from_twitter bookmarks in Pinboard when you search. So now that I enabled this feature a while ago everything is cluttered with tweets and Pinboard become useless for me.
Something like a -from_twitter search would be helpful but there's only a "+" search right now.
I'm interested for sure
Back around 2010 there was a company called Topsy who was supposed to be the "Google of Social Media". It would index Twitter tweets and Google+ posts. The idea was you could read discussions over the years and find trends that could be used for research, analytics or marketing.
Sadly, it was bought up by Apple who shut it down a year or so later. There is still a giant hole left around search for Social Media, with each of them being their own walled garden.
Thanks for the heads up!
If it's someone else's account the API limits you to around 3,200 tweets.
I built https://github.com/dogsheep/twitter-to-sqlite tool for archiving my own tweets. I've used it to pull tweets from other interesting accounts too.
Get started here: https://developer.twitter.com/en/docs/tweets/curate-a-collec...
That being said, I am really impressed by this new service. Creating such a solution in just a couple of hours/days is astonishing.
You can read more about how I built Twitter Instant Search here: https://www.indiehackers.com/post/launched-a-solid-saas-in-8...
Given that the initial version was built in 8 hours, I'm sure there are a lot of features that I'll be adding over the next few weeks :)
I'm thinking this would make sense as a paid feature?
This is basically a frontend to Twitter’s own datastore via the API.
Twitter dot com slash search