Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

There's no replacement for ScrapBook, a plugin where I have a decade of stored annotated documents (no hyperbole, my oldest files date from 2007). Ever since I discovered that FF57 was going to kill ScrapBook I had to disable Firefox updates so I don't lose access to ~6GB of stored data. It's a mix of past, present, and future writing research.

I know I have access to clumsy workarounds such as copying FF56 to a VM with updates disabled, or to have parallel Firefox installs, but Scrapbook is a daily-use tool for me, and clunky workarounds won't last long.

I'm thinking about reverse-engineering the way ScrapBook stores data so I can write my own migration to something else, but...oof.

Anybody have any suggestions for another plugin/product that offers the same features? Or, dare I dream, one that can import everything from ScrapBook? My searches for the latter have come up dry, but perhaps something obscure exists.




If you're on Windows, grab a copy of Firefox Portable ESR 52: https://portableapps.com/apps/internet/firefox-portable-esr

You can 'install' it anywhere you want (Documents folder, other drive, cloud folder, etc). You can copy your profile in using the steps outlined here: https://portableapps.com/support/firefox_portable#local_prof...

It will remain updated through April 2018 and your profile will stay separate from your installed copy of Firefox. In April, ESR is switching to a newer Quantum version of Firefox, so old extensions will be disabled. If, at that point, there isn't a suitable replacement for ScrapBook, disable updates in your copy of Firefox Portable (if you're using the PortableApps.com Platform to automatically update it, rename your FirefoxPortableESR folder to FirefoxPortableESROld or similar) and only use it for ScrapBook not to go online.


Scrapbook, that takes me back. Haven't used it in a dog's age. But I would be enormously surprised if it did no longer store saved content under your Firefox profile directory, and back when I used it, it just saved the files there and maybe did some link rewriting. Not really a lot of importing necessary to view the content outside the extension - you'd just need to point a browser at its file:// URL.

Not sure how much that helps in terms of retaining the actual functionality, which unless I'm badly mistaken would only be feasible in the WebExtensions API via the external application messaging interface - and you'd need a separate program that would receive those messages and do the mirroring for you, and maybe expose a local HTTP server or some other such horrible hack to let you fetch the content tree for rendering in the browser as a table of contents/tree of bookmark-style links. But at least you might not have to lose what you've got.


Today I spent some time looking at how ScrapBook stores information. It's a bit of a mixed bag, with some plain text files, some XML, some HTML (besides the saved pages themselves). I managed to figure out how it stores folder structure, bookmarks, saved pages, and annotations. Fortunately there's no database, and no encryption, so I can write a tool to extract the information if needed.

The remaining question becomes: how to replace it? What other tool supports all this?:

* Local saving (as opposed to cloud)

* Storing source URL with support for re-fetching

* Bookmarks (for pages that won't save locally in a useful way, such as YouTube)

* "Deep saving," saving the main page AND linked pages, and keeping them bundled together

* Full text search

* Probably other features I do not recall offhand

Even if I can get the data out, it's hard to know where to put it. Most solutions these days are cloud-oriented, which is unappealing to me. I could build my own stand-alone replacement, but what a headache. I could fork ScrapBook and try to make it work with the latest Firefox, but I have no experience in the plugin domain, nor the time to prioritize learning it.

Sorry for the rant, I'm just trying to figure out how to proceed without severe productivity loss.


I'd look at the Zotero standalone, but that's just an offhand guess. Other than that, I got nothin' - except 52 ESR, which is good for security updates until some time next year, and won't get the breaking changes from 57.


> I'm thinking about reverse-engineering the way ScrapBook stores data so I can write my own migration to something else, but...oof.

Looking around on the ScrapBook website[0] reveals that "gomita", the author of the plugin, has a GitHub profile[1]. Sadly without a repository of ScrapBook source code. Still, you could try contacting gomita and ask if they want to put it there to help with reverse engineering it? Or maybe even document how it works.

[0] http://www.xuldev.org/scrapbook/

[1] https://github.com/gomita/


Firefox extensions contain the source code anyways, find the "xpi" file, which is actually a zip file, unzip it, and explore.

Not to discourage asking for help, just that the source not being on github isn't super relevant.


Is the Web Scrapbook extension compatible with the files it generates? It seems to have a lineage (via Scrapbook X) that descends from ScrapBook.

https://github.com/danny0838/webscrapbook


Unfortunately, the answer is no.

https://www.reddit.com/r/firefox/comments/7btuln/so_long_and...

The Firefox team has specifically said they won't add support for the foreseeable future.

https://bugzilla.mozilla.org/show_bug.cgi?id=1246236#c113

More here: https://github.com/danny0838/firefox-scrapbook/issues/209#is...

Losing several hundred thousand users¹ probably isn't in the team's best interest; so hopefully they will make it a priority to revisit this, but I have a feeling there are resource limitations that will make this by design won't fix.

¹ https://docs.google.com/spreadsheets/d/1TFcEXMcKrwoIAECIVyBU...


I can relate to this, tho for me it was TiddlyWiki(-legacy), and UnMHT

you can use the ESR[0] release with the extension AND disabling auto-update, and use -no-remote paramater to run multiple instance FF...

So in your case, you can have two instance, one FF running ScrapBook, the other is new-and-shiny FF... I used this setup daily with multiple FF running at my whim, didn't feel clunky

p/s: ScrapBook sounds awesome, I myself did saves PDF version of website, where it still can be indexed/searched properly

[0] https://ftp.mozilla.org/pub/firefox/releases/


Not to my knowledge, but you can use the LTS version of Firefox. Which if I remember is still compatible with older plugins. It will be a year before Mozilla refreshes with the newer branch.


It won't last that long. The current ESR version of Firefox is 52. It will be switched to 59 at the start of March 2018, and 52 will be completely discontinued in June 2018. That's a little over 3 months until it becomes annoying to get a copy of, and a little over 6 months until it's dead.

https://www.mozilla.org/en-US/firefox/organizations/faq/


All prior Firefox builds are easily accessible via Mozilla's web interface to their FTP server at http://ftp.mozilla.org/pub/firefox/releases/ . For example, the latest FF52 ESR update for English Windows x64 is at http://ftp.mozilla.org/pub/firefox/releases/52.5.0esr/win64/... .


"Or, dare I dream, one that can import everything from ScrapBook?". Let's hope dreams are answered. You can add me to that probably long list of hopefuls who have huge records of online life in scrapbook for pre-57 Firefox.


It’s been a long time since I used ScrapBook. I don’t know about anything that can import from it either.

I wanted to suggest Zotero as a tool to capture information of different kinds. It’s a multi-platform tool that also has “connectors” (extensions) for different browsers. [1] It may probably not be a complete replacement for ScrapBook.

[1]: https://www.zotero.org/download/


The original Zotero also died with the demise of XUL extensions. It, too, used to be a Firefox extension.


Zotero can also be installed as a stand-alone application, independent of the Firefox version


At this point it would be best to start exploring other notetaking extensions and programs, like OneNote, Evernote, Zotero, etc. Now is the time to jump ship because from here on in it will get more and more unlikely that any viable bridges will remain compatible.

I did find this add on to convert Scrapbook files with a quick googlin' (no experience with it). Hopefully it helps. https://addons.mozilla.org/en-US/firefox/addon/scrapbookx-co...

The other option is to look at some of the PDF printing add ons because I remember a few supporting batch operations on scrapbook data. At least they did in 2010-ish.




Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: