1. Responsiveness
2. Excellent voice recognition for dictation of questions and device control
3. Web reading/browsing capability
4. Instant webpage to PDF conversion
5. Instant storage of those PDFs for use as custom LLM training data
5. Functionality to copy quotes from web pages or PDFs along with auto-generation of citations
6. Functionality to export of PDFs, quotes, and citations together into PKM app, say, Obsidian or other similar PKMs
BONUS: I know Kindle isn't set up for this, but if the same could be done audio and visual media, using voice control, beginning with podcasts (auto transcript save with cite, clipping with transcripts and cite, export of clips with transcripts and cit) and then YouTube (auto transcript save with site, auto clip with transcript and cite, export with transcript and cite)
IF I could get 1-6, I would strongly consider having this as part of my PKM kit. If I could get 7 too, I would have to buy it. This may be something I have to build, unless someone knows where these integrations can be found today.
Cool! This brings to my mind that it would be cool to have a local LLM chat that is able to point to certain places in a book I'm reading offline and have it recommend portions of the book I should focus on.
I have the same problem, namely a constant urge to look up things while reading paper books. My personal solution to that is to copy whatever sentence that triggers my urge to look up anything and then set aside time to do the look up later. I think the value it brings is that I won't be distracted into deep rabbit holes while finishing my book.
I'm not sure what's the end goal here though. It seems like you would like to look up things as soon as you encounter them, but on the same device (Kindle)? Then the benefit is not switching devices?
You can replace Wikipedia on your Kindle without modifying any firmware or software on the device. Here's how it works:
1. Host an API which conforms to the Wikipedia search and document conventions (this can be LLM-powered)
2. Modify your router's DNS settings specifically for your Kindle so that it resolves wikipedia.org to your API's CNAME or IP address
3. You can now use "Wikipedia" to perform arbitrary operations on highlighted text. As a bonus, you can manage your API from your Kindle's built-in browser (assuming you've built out a management UI)
Yeah I find my phone and laptop quite distracting, so I don't like keeping them around when reading, especially at night.
Another use case I didn't plan for originally but is pretty fun is doing all your Kindle reading in Kindllm by having it write essays on random topics for you.
Very cool. I've no idea if this is possible without rooting the Kindle, but I wonder would it be possible to highlight sections of text in a book and send it to something like this with a request to summarise/explain?
It's a good idea! Amazon doesn't offer an API for fetching highlights but services like Readwise seem to get around this by using a Chrome extension to do it. Not sure how that could be done on a Kindle though...
Really cool idea. Unfortunately, the proportions are somewhat broken on the Oasis (the text bar stretches a bit less than half way across the screen). Was the page designed to be pixel perfect for the Paperwhite?
I used percentages so the text bar and Send button should fill up the full width on any device. I saw the same thing happen before updating the Kindle version. I wonder if they haven't rolled out the upgrade for Oasis yet.
The demo video is great, I would consider putting it higher up on the page and possibly on autoplay. I wonder when Amazon will integrate LLM into the native reader. Nice work!
Thanks! Yeah the landing page might need some work
re: Native LLM: The fact that Amazon just upgraded the web browser shows that they at least have some engineers working on Kindles, so one can always hope
Off topic, but why is the demo video so much brighter than the surrounding background? The page has a white background, but the video is substantially brighter.
Most likely the video was recorded with an iPhone. Playing it on an Apple device then automatically turns on some sort of an HDR mode and unlocks higher brightness - commonly seen while scrolling through reddit videos and other social media.
I love this, but I wish there was a better way to enter questions. Using the kindle keyboard is not a great experience on my device, and no matter how good the suggested questions get, it wouldn't be able to handle my initial question
27% on a Kindle with a healthy battery is a lot. Especially if this is a latest model paperwhite on the image which I think it is. It's probably their most impressive feature as a product
Thanks! I'm not experienced enough in this domain to have an idea of what that means for the bottom line. I assume that at the scale of a niche app, the cost is close to negligible and you can pay it out of pocket, but I imagine that if Amazon would pre-install something like this on every Kindle, the costs would go through the roof. Speaking in broad terms, how much scale do you think an app like this could handle, while still being something an individual might consider worthwhile to pay for out of pocket?
It's a bit unclear how to use it. It's not obvious that you need to visit the same webpage. Maybe make the URL more visible? Autoplay would be nice too.
BONUS: I know Kindle isn't set up for this, but if the same could be done audio and visual media, using voice control, beginning with podcasts (auto transcript save with cite, clipping with transcripts and cite, export of clips with transcripts and cit) and then YouTube (auto transcript save with site, auto clip with transcript and cite, export with transcript and cite)
IF I could get 1-6, I would strongly consider having this as part of my PKM kit. If I could get 7 too, I would have to buy it. This may be something I have to build, unless someone knows where these integrations can be found today.