I have been somewhat impressed by Mojeek, but it does have two obvious flaws:
1) It not really good for localized search, it might be if you're local to the US or UK.
2) No !bangs. Coming from Ecosia I frequently just do !w !maps !yt because I know where I want the answer to come from
For English language searches, it completely usable, but not quite as good as Bing or Google. I really wanted to try to use Mojeek as my default for an extended period of time, but the lack of good local search makes it a bit annoying.
Local search and location-aware search is probably Google's biggest moat against smaller search engines. Bing does it passably, but it's aguably still pretty bad.
What's worse is that it's probably hard to ever get working well without the internet-scale profiling Google has access to.
They might be doing it differently, but Ecosia uses Bing and have really good localized search, at least for Denmark. There is very little difference between Google and Bing these days, if anything I'd say Bing is the better search engine.
Looking at all top 3 is helpful.
I have done a lot of part sourcing for engineering work and begun using searx because of the aggregation. There are some other tools to use also when searching for obscure out of stock supply chain induced woes.
I’m not saying having deep per-page indexing of Reddit, for example, isn’t useful. But is there any value in a breadth-focused index that is far cheaper to maintain?
Almost certainly. Internet search is above all a problem of improving the signal to noise ratio.
There's an inordinate amount of documents that will never be a good search result for any query. Both in trivial cases that have barely anything to index in them, but also sign-up forms, cookie policies, redundant information (e.g. any given man page exists in dozens if not hundreds of identical copies on the web).
Unless you're specifically searching for other websites' cookie policies (e.g. to understand how they work, or to do research on them, or just to plainly copy them...)
Not sure what they are doing but embeddings and hallucination are completely separable imo (you can have hallucination even without embedding-based retrieval). Likely you have an embedding for the query which is close to the embedding of the doc for some measure of similarity. That could be semantic similarity or even user behavior.
A little tangential but does anyone know if there are any modern web directories?
I'm wondering because it seems like due to the amount of spam on the web there needs to be more human curation as opposed to algrothims deciding what websites are valuable or not.
1) It not really good for localized search, it might be if you're local to the US or UK.
2) No !bangs. Coming from Ecosia I frequently just do !w !maps !yt because I know where I want the answer to come from
For English language searches, it completely usable, but not quite as good as Bing or Google. I really wanted to try to use Mojeek as my default for an extended period of time, but the lack of good local search makes it a bit annoying.