Hacker News new | past | comments | ask | show | jobs | submit login
The End of the Redis Adventure (antirez.com)
2282 points by kristoff_it on June 30, 2020 | hide | past | favorite | 294 comments



So they're moving to a new "community based", "light governance" model. [1]

There are plenty of problems with BDFL-style projects, but I think there are a lot of advantages too. Redis is unique in my experience in that it works the way you'd expect - it doesn't cause outages, it is fast, and it has a vanishingly small number of gotchas. The feature set is well curated and for the most part fits together cohesively.

The most important thing Antirez did, in my opinion, was to say "No" to things. No to new features that didn't make sense. No to PRs that didn't fit the vision. Saying no is one of the most important jobs of a project maintainer. It's a thankless task that upsets a lot of people. But it's critical for a project to stay successful and achieve the leader's vision.

Maybe I'm a pessimist, but I predict after a few years of this new model we'll see weird features, more stability issues, and performance regressions as more cooks enter the kitchen. Time will tell.

[1] https://redislabs.com/blog/new-governance-for-redis/


> The most important thing Antirez did, in my opinion, was to say "No" to things. No to new features that didn't make sense.

Redis has had tremendous mission creep over the years. It started of course mostly as a volatile cache but I've now seen it also used as a message bus (in three different ways: BLPOP, PUB/SUB and Streams), for service discovery and as a general purpose database - something that Redis Labs (in my opinion: wrongly) encourages.

Memcache existed in 2009 when Redis was first released, also as a volatile cache...and still is just a volatile cache. Memcache is what "saying no" looks like. Redis is what "saying yes" looks like - and there are a lot of gotchas.


Memcache is what saying no to changing the use-case looks like. Redis is what saying no to changing the architecture in order to implement features looks like.

Redis has stayed the same, architecturally, from the beginning: it’s a keyspace where the values are arbitrary in-memory objects owned by their keys, and where commands resolve to synchronous function-calls against the objects (or ref-cells) at those keys.

Anything that can be done without changing that architecture, is in-scope for Redis. (Though if a data structure doesn’t have wide use outside of a domain, it’s best left to a module.) Anything that cannot be done without changing the architecture, won’t be done.

Much of the “fun” I’ve personally had in watching Redis evolve, has been seeing how Antirez has managed to solve the puzzles of getting features that intuitively wouldn’t be a good fit for this architecture, to fit into it anyway: changing technologies that are implemented one way everywhere else, into something else for Redis, that still work, are still performant, and still solve isomorphic use-cases—if not with the same steps you’d use to solve them in other systems. (E.g. using Streams vs. using a regular MQ; using Redis Cluster vs. using regular RDBMS replication; etc.)


Memcache also is about saying no to changing the architecture. That chosen architecture is similar to Redis Cluster -which is a change of architecture Redis did undertake.

I personally have not enjoyed all the strange and wonderful ways people have found to use Redis. Most of them are pretty fragile and (most dangerously) they often put all Redis uses in the same instance...with eviction turned on.


Wow you totally got it. This is exactly the idea I was using, I even saw an opportunity when the Redis model was potentially able to solve a new use case.


Would you mind elaborating on some of those 'fun' items - part of the problem of being aware of certain technologies without really 'following' them is understanding why they change.


It didn't really start as a volatile cache, it started as an in memory data structures server. It's useful for all kinds of stuff memcached isn't (and has been since day 1).


This. To me, Redis was always about the rich set of operations you can atomically perform on data without going full ACID. It's very different from a pure cache (although it's probably a good choice if all you need is a cache).


Yeah. I do think that Redis has suffered from some mission creep, including a deprecated misadventure in to a mode where values could be stored on disk and only temporarily cached in memory.

Maybe that's what Cal and his colleagues were using it for at the time, but the claim that it started as a volatile cache is just not true. Interesting datastructures and the fork based persistence model were there from the start.


It started as a memcached with persistence to disk for fast startup.


No, it was always about data structures.

Lists, hashes, sets and such that you have available in your programming language, but available as a networked server so any language/app/process can access the same data using the same useful structures.


Well, kinda. Feature list does look like basically random assortment of vaguely related things (or "toolbox" if you want to be nice).

But... things that are also just useful often and for what you'd need to spin off a separate service for, or make suboptimally in whatever (No)SQL you use to store your data.

So it is perfect if you just want to prototype whether given approach is viable, and "good enough" for many apps.


> but I've now seen it also used as a message bus

It works excellent as a message bus, though. And you can add HSET/HDEL to your list as the fourth way.


Strongly, strongly, disagree that Redis works well as a message bus.

Lots of reasons why but here is just one because I'm short on time: all of these (four) ways of doing a message bus with Redis offer either a work queue mode or publish/subscribe - but not both (perhaps excepting streams which I've forgotten some of the details of). I have yet to see many real world messaging scenarios where you don't end up using both.

A "proper" message bus needs to have topics, exchanges and queues - like Rabbit. 50% of that functionality is usually not 50% of the value but 10% or less (especially when you consider all the other things about Redis you need to think about - like how eviction is configured).

This is a bit typical of Redis: for any X, you can normally do X in Redis, but is it really a good idea to do X in Redis? IMO, usually no.


There's a wide field of messaging from distributed logs to queuing systems to event sourcing to complex service buses. Kafka, Pulsar, NATS, RabbitMQ, Tibco, NServiceBus, ActiveMQ, Solace, AMPS, and dozens more. What's "proper" depends on your needs.

Redis Streams actually does exactly what you describe and is basically a single-node fast Kafka replacement with multiple independent consumer groups, per-message acknowledgements, and queue semantics. We use it successfully in many high-load scenarios.


Name of the hash is a topic. Keys are nanosecond timestamps, values are the packets. You put in the data, you send a pub notify to the listener, listener goes and drains the queue. It acts as a direct exchange queue, recovers fine from a restart and it works wonderfully. For fanout, you can simply use pub sub. For topical, you can keep a list of direct exchange queue hashes. I haven't needed it.


Redis Streams is built-in and does all that for you. https://redis.io/topics/streams-intro


You're probably right. I did this before streams were a thing.


> There are plenty of problems with BDFL-style projects, but I think there are a lot of advantages too.

BDFL governance is extremely underrated in the opensource world. People attribute the success of the Linux kernel to its open contribution style, but I will argue that Linux is successful because there's a dictator at the top that enforces a direction, a long term goal, and most importantly, says NO.

Community based governance is a direct cause of that jwz's Cascade of Attention-Deficit problem one can find all over the open source world, especially Linux desktop related.


Does FreeBSD have a BDFL?

We don't have enough data points to determine if what you are saying is correct. I have also seen lots of BDFL projects smoke out.

Is the lesson that actual dictatorships only survive long term if 1) the dictator is a nice person and 2) they eventually get managed by an open democratic process?

I think you are actually describing the two clocks problem. Lots of BDFL projects have their own Cascade of Attention-Deficit issues, the project only goes in the direction the BDFL actually cares about.


A (software) dictator is not necessarily good. But let me double down and say that a community cannot create a product as good as a single head at the top can do, for the single reason that people care only about their own garden, and integration needs someone to oversee and be responsible for all parts.

There is no Steve Jobs in a democratic committee.


As usual, Fred Brook's Mythical Man-Month had some valuable insights on this back in 1975:

> To make a user-friendly system, the system must have conceptual integrity, which can only be achieved by separating architecture from implementation. A single chief architect (or a small number of architects), acting on the user's behalf, decides what goes in the system and what stays out. The architect or team of architects should develop an idea of what the system should do and make sure that this vision is understood by the rest of the team. A novel idea by someone may not be included if it does not fit seamlessly with the overall system design. In fact, to ensure a user-friendly system, a system may deliberately provide fewer features than it is capable of. The point being, if a system is too complicated to use, many features will go unused because no one has time to learn them.

* (This is quoted from the Wikipedia page as I don't have an online copy of MMM to hand).


Cannot seems rather strong. I haven't been paying very much attention, but I was under the impression that Postgres doesn't have a dictator?


It's evolved. There was a point that Tom Lane was the last line of defense against anything that strayed too far.

Heck at one of Postgres conferences there was a shirt that said something like "Tom Lane reviewed my patch and all I got was this stupid shirt."

While he was not a BDFL style person, in the past, if he didn't like a change, it didn't make it in.


Or Rust, which - whatever you might think of it - does not feel very designed-by-committee.


Rust governance is more amazing than Rust the language and that is saying something.


Here’s the thing: you need both. You need breadth AND focus. Breadth tends to come from the community and focus from a small number of individuals. But both are important.

Keeping both of those balls in the air at once is why being a software coordinator like this is such an exhausting job.


The main differentiation (and risk) with BDFL projects is having (or not) a very competent (like one percenter) BDFL.

The structure of a committee project doesn't make it better or worse than BDFL. It just makes it more average. Any greatness present is toned down. And substandardness is brought up.

This also main reason the "led by greatness" BDFL projects are better than the committee run ones and the "led by less than great" BDFL projects "smoke out". The committee's tend towards the middle of the bell curve, BDFL's are all over the place.


>Does FreeBSD have a BDFL?

No, but it doesn't have as much success as Linux either


this is IMHO no different the real world - a 'good' despot/monarch/etc can be a good leader, but this is highly dependent on the situation (read: leader), and leadership transition process is always a risky one. Democracies/Republics work well so long as the community has a generally shared vision, but can be hampered when there is too much dissent, but generally avoid the succession problem


OT: Indeed, a good dictatorship is better than any democracy, but it doesn't work in practice because for every Augustus there's 10 Caligula.

Democracy is just the least worse political system.


Democracy is more of a principle (is just means that legitimacy of government comes from some aggregate choice of the governed), than a political system. Radically different political systems can be classified as democracies, all the way from direct vote (self-organized communes, also Switzerland) to complex federations with layers of indirect representation, such as the USA or the EU -- with a lot of other interesting alternatives such as sortition.


In a FOSS it is very easy to fork, so if the BDFL get's mad you can just say thanks and fork the project and continue. So that keeps BDFL in check.

IRL you own a plot of land, or a home. Or you have a small factory, and there are a lot of network dependencies, who does you sell the supplies, where you sell your products. It the local BDFL get's mad it is very difficult to move. (Specially if there are some cash flow controls were you can't get out with the money that you get selling your home or that you have saved.)


You can fork Linux if the dictator doesn’t suit you, but you can’t fork a nation. You also can’t switch to another nation that is more appealing, generally. Finally, Linux can’t imprison and torture you if you criticize it


If you're comparing FreeBSD to Linux then I think that says a lot about the merits of BDFLs, really.


Did FreeBSD not have the discussion about this years ago? Though they did not have a single person, but a 20 person core team, which were cut down to a 9 person core team that is voted for every 2 years.

http://freebsd.dk/sagas/freebsd/#id1


The core team doesn’t really make technical decisions. It’s more for administrative/social/governance type stuff.


Who would then make the technical decisions? The owners of the different sub systems?


There's no hard rule. The committers are expected to behave like a civilised human beings, ie talk to each other to reach consensus.

Let's say you have a fix for some driver used on ARM. You'll submit it via Phabricator to get ARM maintainers to review it. If they don't, because eg they don't have time, then you'll probably commit it anyway, but if someone points out you did something wrong, you'll be expected to fix it.


Sounds similar to debian, which is also a very successful and stable project.


Underrated in the open source world — whilst at the same time, feels obvious in the writing world?

Imagine an author has gotten started writing volumes 1 and 2, and those volumes became popular — maybe the Harry Potter books as an example. Now, adding more authors with equal "story-line decision making power", or a committee, for volumes 3, 4, 5, is a weird idea, right.


Look at what happened with Game Of Thrones! Total disaster at the end that ruined the whole thing for everybody.


> I will argue that Linux is successful because there's a dictator at the top that enforces a direction, a long term goal, and most importantly, says NO.

Linux is made because of many people all over the world, but it is successful because of the BDFL at the top. A consistent sense of mission absolutely benefits a project in the long term. There just isn't anyone that's going to get your idea better than you, when you're doing something that you know enough about to seriously get started on.


I think it's _just_ underrated; I think it's underrated in the business and government worlds too. A good leader should take different points of view into account, but should also be able to make a decision when needed.


I feel like Antirez has already done everything needed to ensure this doesn’t happen, by 1. building the module system into Redis, and then 2. working with companies like Redis Labs to establish that Redis is enhanced through these modules, and to ensure that modules offer everything required to enhance Redis in all the ways that matter.

In essence, Antirez has protected the core of Redis from needing to bloat, by making it possible for anyone who wants to build on top of Redis to literally do so—build on top, rather than inside. As such, I expect future PRs to Redis Core to look much like current PRs to Redis Core: just fixing bugs, adding stability, and resolving infrastructure-level interoperability concerns.


I 100% agree with you and I think it explains why most OSS UI projects are, well, terrible. Questionable features, inconsistent UX, millions of "options"... these are the hallmarks of a community model lacking strong leadership and a coherent vision.

As for the future of Redis I choose to be more optimistic. I think the Redis philosophy (thanks to Antirez) has become ingrained. The benefits of a minimal feature set are hopefully well-established.

In the very least I suspect this will last much longer than many expect before the bureaucrats take over.


BDFL: Benevolent dictator for life https://en.wikipedia.org/wiki/Benevolent_dictator_for_life

(This is also referenced and linked in the article.)


> The most important thing Antirez did, in my opinion, was to say "No" to things.

This is hard. It makes you feel bad inside to tell people "No", especially when they open PR and clearly did a lot of work adding some feature.


Thats something a have regarding PR and code reviews: much frustration can be avoided by discussing what to do and how to do it before showing the work done (avoiding also infinite bikeshedding). Often code review talk about the strategy to do X and not the way to do X


And some people take the 'No' badly. It's frustrating having to explain that the code in a PR needs to be maintained forever, and it's the repo maintainer that will have to do it, not the contributor. A simple proposal upfront makes all the difference, and saves human effort and feelings.


>Saying no is one of the most important jobs of a project maintainer. It's a thankless task that upsets a lot of people. But it's critical for a project to stay successful and achieve the leader's vision.

Reminds me of Brian Goetz: "We have to say no to almost anything. If we didn't, things would pretty quickly degenerate to the point where the system collapses on its own weight (...) if we did this, which of these eighteen possible features might we foreclose on, and might we want to leave those possibilities open, at the cost of saying no to this thing here." (https://www.infoq.com/presentations/java-history-present-fut..., 24m+)


The one drawback of the BDFL model is that you need a person, and a very specific kind of person at that, which tends to be irreplaceable - to sustain it.

Redis has succeeded because of antirez. I really wish it can continue doing so for the long run without him. More than anything it reminds me of Steve Jobs' death (although gladly this is in much happier circumstances and I wish antirez many more decades of hacking). It's true that a decade later Apple is still doing great, but you just know things would have been different if he was still around.


Instead of a single BDFL, you could also have a board of e.g. 3 BDFLs. Those 3 people would have the final word, but they rank equal, and have to come to a common conclusion, e.g. by discussing internally. That only works if the board is not too big, and the people are somewhat compatible to each other. But in that case, I think it works much better, because there is less pressure on a single person, also less work (they can distribute it somewhat), and probably more reasonable and consistent conclusions.

It seems that this model is not so common? At least the list on Wikipedia (https://en.wikipedia.org/wiki/Benevolent_dictator_for_life) only lists Django as an example with 2 BDFLs.

I was active in a smaller open source project (http://www.openlierox.net) where it mostly was like that, i.e. we were 3 main developers, and all major design questions were discussed among us. But this example is probably not so representative, as there rarely were further contributions by other people. But anyway, I was very happy with this model, that there is not a single leader, but 3 people.


I think the mixed historical record of consul republics might be relevant to why a single leader is often a better idea than 2-3.


I'm thinking that a project that starts out with 3 BDFLs (like yours, @albertzeyer) and works fine & builds sth people "love" — it'll continue working fine with those 3 BDFLs.

And a project that starts with just 1 BDFL, and works fine & builds sth people "love", it'll continue working fine with that 1 BDFL.

If, however, replacing one of those 3, or adding another BDLF to a one person project — I'd think that by default, that won't work.

... Unless the new person has worked next to the earlier BDFLs for years, so the previous BDFLs can be ok certain s/he is "the right one"?

Whatever works fine, works fine — the risky thing, is introducing a change (a new person)?


Thing is, with a consul or triumvirate system (you can’t have more than one “dictator”; all of these terms are from Ancient Rome anyway so let’s use them properly), if any disagreement arises between the 2 or 3 leaders, it will develop a new instability where there wasn’t one before. Or else, one of the 2-3 leaders will start to dominate the others. Even without turnover the dictator system is more stable. In fact the only benefit of a consul or triumvirate system might be the stability and continuity under turnover.


Do you have any tips for explaining to stakeholders that things in a Redis cache expire on async schedules?


[flagged]


> I'm sure many would love to see some change there and finally overrule Torvalds' decisions.

Is forking no longer a solution to this problem? Or are you just wanting to wrestle control away from Linus?


You already see this happening, on the IoT world there are plenty of competing FOSS OS clones, some of them POSIX based, common to all of them is the use of non-copyleft licenses.


How does copyleft relate to BDFL-style governance? Python, for example, had a BDFL until recently but isn't copyleft licensed.


Taking projects into new directions , possibly closed source, due to political disputes.

Without the legal obligation to upstream, the majority wins what happens afterwards.


> Or maybe you see an old white guy in charge of Linux and that can be considered a problem in itself

Why is that a problem?


>> "old white guy in charge of Linux"

Erhmmm, why does his age or colour matter in this context? Debate can happen about people and their leadership style, (I'm not a fan of Torvalds) but when the first criteria someone sees for criticizing another person is their age, colour, or race, that seems a bit shallow and biased.


I agree. Isn't this overt racism, sexism, ageism, etc?

> Racism: prejudice, discrimination, or antagonism directed against a person or people on the basis of their membership of a particular racial or ethnic group


Of course it is, but it's the kind of bigotry nowadays some people evangelize as good (by redefining racism), and what the twitter mob encourages.


Chain of events: I was tempted to try a respectful reply with substance, but then realized I wouldn't be allowed to discuss this here, due to moderator preference for "not talking politics".

I was then [regrettably] tempted to write something with a "mic drop" feel, just to express my disagreement in an acceptably pithy way.

And then it occurred to me that this whole sub-thread is Twitter-length comments. And I was about to add one more. And I realized that maybe the moderation of HN actually prevents us from going as deeply on this topic as we do on everything else, and so that moderator preference has essentially reproduced a pithy and unproductive Twitter dynamic for topics like this.

Pithy and shallow self-censored comments in reply to pithy self-censored comments.

EDIT: But also, moderation is really hard <3 Just wanted to try to put words to a small dynamic that's perhaps playing out here.


There was a huge thread yesterday on HN about this topic with many comments much longer than tweets. It is certainly a topic that can be discussed at length on HN. People were voted down and up, but no one was cancelled; we're all still here.

I'm not aware of any moderator preference against talking about this subject. Again: huge thread on it yesterday that persisted on the front page all day.

However, I don't think every single off-hand mention of race or gender needs to devolve into a subthread of 50 multi-paragraph comments. So I appreciate your decision to avoid it in this instance.


FWIW, I probably disagree with you, but I wish we could talk about these things in a civil way. I think the PC/cancel-culture prohibition about discussing this stuff is a real impediment toward progress. Further, I don't envy the moderators since it's hard to keep things civil--bad actors on both sides come out of the woodwork. Anyway, have an upvote as a small gesture of peace and kindness in a world where disagreements are supposed to make us bitter enemies.


Aw thanks!

Yeah, I was a moderator on one of the first university-run online forums, and it was so stressful and difficult...! All the first-year students just spoke off-the-cuff, but "monitoring" all that speech was SO challenging...!


> due to moderator preference for "not talking politics".

There's no such preference. What made you think there was?

The question of political topics on HN is a hard one because some political stories are on topic, some are off topic, and even the on-topic ones tend to turn into flamewars. I've written a lot about how we approach this: https://hn.algolia.com/?dateRange=all&page=0&prefix=false&qu.... Some good threads to start with might be https://news.ycombinator.com/item?id=21607844 and https://news.ycombinator.com/item?id=22902490. Also https://news.ycombinator.com/item?id=17014869, which shows how far back political discussion goes on HN, as well as the argument about politics on HN.

If anyone reads those explanations and still has a question that isn't answered there, I'd like to know what it is.


thanks dang. Was thinking about y'all when I added that "<3" edit. I appreciate you.

> What made you think there was?

I recalled a post way back when trump was voted in, asking the community not to speak about politics. (I'm sure I'm misrecalling the specifics, but that's the fuzzy take-home that's nestled in my mind after all these years.)

---

Ah yes, found it. Apparently it was just one week, but I remembered it as a standing request :) https://news.ycombinator.com/item?id=13108404


"Racism" against white people in the US is completely devoid of systemic material consequence. Understanding definitions isn't about "mobs" or even ideology, it's about identifying what happens in incidents of racial bias and why those things happen.


What? We are not ants. Even if being racist to a person doesn't affect the "colony" still is being racist to that person.

And redefining a word so is "bad for everyone but X" doesn't make X innocent of doing it, it makes X guilty and a bully.

Also, the world is much bigger than the US.


Fair enough, but does that make it "good" or simply "less bad"? And if it's just "less bad", then why should we tolerate it when there's no dichotomy between "racism against whites" and "racism against minorities" (i.e., we can and should aim for a world with no racism at all)? Further still, once you've established a racial worldview with a racial hierarchy that puts whites on the bottom, you've established a framework that facilitates white supremacist arguments (both by making it easier to frame whites as victims of racism and by validating racial worldviews in general--a worldview that puts whites on the bottom is a lot closer to a worldview that puts whites on the top than an egalitarian worldview is to either). Liberalism (i.e., treating people as individuals instead of identical constituents of their race) has been the driving force behind the massive reduction of white supremacy and anti-minority racism; it's an enormous success and an important bulwark that protects minorities. Why should we erode this important bulwark by replacing it with a system that (1) perpetuates injustice against whites and (2) paves the way for white supremacy? Racism is lose-lose.


I agree with you but that’s not how a lot of people see it these days.


Precisely no one wants to replace Linus Torvalds with a woman or person of color just to have a woman or person of color maintaining the Linux kernel.


You’re begging me to go nutpicking with the phrase “precisely no one” but let’s grant that point. Many people have been outspoken about, in general, replacing white males in positions of power and importance with non-whites or non-males. The degree to which none of these people want to replace Linus probably has more to do with the degree to which Linus Torvalds is perceived to be in a position of power or importance.


Ok, so many thank you here, thanks! It's very nice to read the comments here. But I hope to interact more on HN, since basically the idea is to write more blog posts, write more OSS software too. Just totally random :D I'll just do whatever every morning I want to do for a long time. Then maybe I'll find a new long term interest.


I want you to know that your code is a real inspiration to me. Redis is a beautiful C artifact and an excellent reminder of how joyful it can be to create and read code.

Also, congratulations to moving off of Redis. In open source, there is a thing where people look at retiring from a project as some sort of failure of either the project or the maintainer, but I think the opposite is true.

We all have a finite amount of time on Earth, and everything has its natural beginning and end. Moving on to something else means creating the opportunity for yourself to find the next big project for you. And for the project itself, it means bringing in new eyes and perspectives.

Change is scary, but healthy.


Hello Salvatore,

I normally don't write about what I come across during my work, but in aggregate I can tell you that Redis, Linux and MySQL are the most common recurring elements across 150+ jobs looking at different companies, and using it rarely if ever leads to trouble.

So even if I don't use it myself directly quite a few of the companies we have invested in do, and an indirect 'thank you so much' is well deserved. I am very curious what it is that you will do next besides blogging. Linus had 'git' as his second major project, arguably it has had just as much effect on the world of free software as Linux did, you've definitely raised the bar for yourself :)

Much good luck!


As someone who was in ops, I really disagree with MySQL in that category.

Saw it multiple times at multiple jobs just break on its own.

Most memorable one was a bug where certain pattern of data caused mysql think data is encrypted, crash and refused to start until data was restored from backup. It took quite time to fix it because it happened randomly and initially we assumed it was broken hardware.


MySQL used to be pretty bad in that respect but lately has come of age and I was mostly commenting on how frequently it was used.


Was it really recently? Last time I used MySQL was 2018.


Thank you antirez!

I started using Redis around 2010 and I learned to appreciate so many things from you along the way:

* Data structures are fun.

* In-memory is fast and can be safe!

* Append-only logs are awesome.

* Databases can be more than MySQL.

* Complexity analysis is worth making clear in the documentation.

* Hybrid L1 cache-friendly data structures beat complexity analysis for small data.

* There are only so many hours you can work in a day.

* It's cool to sit by the pool.

* It's cool to have a screen name.

* Above all, code is poetry, not dependencies.


@antirez Thanks man! Maximum respect for everything so far, and for your honesty over the years. I rarely login or post on HN but I have just for this post.

I've been using redis since I think 2.2 and have learned so much from your posts over the years! More than just about redis. Are you able to post links on your site to the videos you're making? I don't speak Italian but I'd love to learn from subtitles.

I'm really excited for you and look forward to whatever fun things you decide to do next! Greets from NZ


> I write code in order to express myself, and I consider what I code an artifact, rather than just something useful to get things done. I would say that what I write is useful just as a side effect, but my first goal is to make something that is, in some way, beautiful. In essence, I would rather be remembered as a bad artist than a good programmer.

This entered my list of favorite quotes! For this, if not for your huge contribution to OSS, grazie!


Thank you! As people have commented, your ability to stick to your convictions, even under fire, is admirable. I look forward to your blog posts.


Thank you Salvatore! You have been an inspiration to me as a young programmer and have opened my eyes to the wonders of OSS. Excited to see whatever you do next!


Thank you for your dedication. You will not be forgotten


Thanks for everything you have given the community. And I look forward to more blog posts, they are always fun to read.

I also want to thank you for making this decision while you were still active, Redis didn't skip a beat. Right up to announcing this you made sure that the community made progress. As we at GitLab detail in https://about.gitlab.com/blog/2020/06/24/scaling-our-use-of-... in April you personally responded to an issue https://github.com/antirez/redis/issues/7071 within an hour.

I glad you are choosing for what makes you happy, you more than earned it.


Hey man, like a lot of people here, I wanna say "Thanks fort Redis, it's solved a bunch for problems for me at work", but also "Thanks for dump1090, I've had heaps of fun with that, and learned a lot from digging into your code there."

Best wishes for whatever it is you choose to do next.


You are a hero sir and thanks for all the effort that you have contributed for redis. Someday, I too hope to create a project that would touch at least a fraction of as many people as redis did. You are a big inspiration. All the best for whatever you want to do next.


Congratulations on completing such a very successful project!

Also, good decision, and happy to see that you now can finally take a real vacation if you want.

Also, it is good news for everyone, because it means you will be able to concentrate your energy on new creative pursuits if you want. Which, for example, leads to beneficial things like video tutorials, etc.

It feels like people may still kind of be on your back a little bit but this time they may be asking you what the next big project is. I hope you can shake them off and just follow your passion without needing to make a commitment to something new (especially not anytime soon). This will be best for everyone in my opinion.


I became a sponsor of yours on Github today just to say, "thanks." I know it's not much, but I really do appreciate your work. Hopefully, my small donation will add up some worthwhile coffee overtime!


Hey antirez,

Your work that’s had the most impact on me isn’t Redis but kilo! It taught me how to have fun hacking on C back in university. Me and a couple friends cloned the repo and started adding fun features.

Here’s to more 1000 line whatevers! <3


Massive hat tip for all your work over the years. Redis is a lovely bit of work.

I first used it as the datastore for a flash sale about 8 years ago now. Even though close to 130k people were trying to book rooms at the same time, it performed just as I hoped it would.

I was going to say that I haven’t used it in a few years, but really I’ve just forgotten that it’s running a critical part of our system day in day out because it never causes me any trouble.

Good luck with your next adventure, here’s hoping it’s as fruitful for the community as your last one.


Thank you so much for all that you have done. Redis is a fantastic piece of work. It is everything software is supposed to be: it's simple and it just works :)

Good luck exploring your other options


I haven't used Redis before, but I have been considering it for a project I'm working on so I've been having a look.

Just wanted to offer you my thanks. I've seen the project a bit from the sidelines over the years out of interest, and I think you should be proud of it.

Hope you will do something that excites you next. My only tip is : don't worry about what other people think is exciting - follow your gut.


Thanks for putting so much effort into Redis! The software itself is awesome (I've been using it one way or another over the span of nearly a decade now), and in my opinion anyway you've handled the project and yourself in an exemplary way. You're the only programmer I can really say I think of as a personal hero. Best of luck in the future!


I really hope you take time to do some non-software projects. Just like we rest and rotate crop fields, we must rest and rotate our minds!


Your initial post about Redis is one of the first things I remember seeing when I started reading Hacker News. The great thing about Redis to me was that it was extremely clear what it did and what the use cases were, and I always appreciated how you talked about it in such a simple, practical way.

Thank you for Redis, and I hope you can relax and have some fun with whatever is next!


You are a unique kind of hero of a unique age.


Thanks so much!

I did have a post that basically said "I relate," but it wasn't popular (I guess it came across as self-promoting. My apologies).

In any case, I can relate, and completely support you in your future endeavors. I am not a redis user, but I have seen nothing but good said about it.


Thank you! And this is a very good idea:

> I'll just do whatever every morning I want to do for a long time.


Thank you for all your work these years. Your blog was/is inspirational and I especially learnt a lot from your "writing an editor in 1000 lines" article, when every other example on the net used to use a library.


Thank you antirez! I've used your remote dictionary server from the earliest days and it has been a staple of my tool chest ever since. Three cheers and enjoy your time doing whatever it is you want to do!


Thank you for Redis and some of the other stuff too! I had great fun reading through the small string compression code and learned a lot! Hope you have many decades of happy hacking ahead of you.


Ciao Salvatore!! Hope to see you again soon in San Francisco! Onward and upward.

I am glad to read that you made a choice, as difficult as it might have been, and I hope it will make you happy (or happier).


Huge thanks!

Redis is simple and straightforward and a joy to use. Best of luck :)


Thank You so much for Redis. Looking forward to your next project or hacking around existing OSS project. May be CRuby or Lua given you like both languages?


I really enjoyed your Youtube "Writing System Software" episodes. Would be awesome to see some more of that in the future too ... !


+1s are frowned upon at HN, but I can't think of a more warranted post than this one for offering up an underlined "thank you"


I've always admired your work, and read your source code to learn how to structure a great project.

Looking forward to reading whatever you do next!


Thank you very much for creating Redis! It's an outstanding piece of software that I've enjoyed using over the past decade.


@antirez Thank you for all your amazing work! Redis and your overall approach has changed the way I approach _my_ work daily.


Thank you so much for your contributions!!!!! I might have not used Redis, but I learned a lot from your text editor tutorial.


Thanks so much for everything, Salvatore. Working with Redis, working on Redis and working with you have all been a blast.


Thank you for all your work on Redis. As you already know, it powers so much of the internet.

Wishing you the best in whatever you do next.


Basically you changed the world, in your own way. Redis is here to stay now. Nothing short of sheer brilliance.


Thank you so much antirez for all your work! Looking forward to those blog posts!


Thank you! Redis is what brought back the spark of fun in developing in me.


Beautifully written end to a personal journey. I wish you the best!


Thank you for creating Redis :) Best wishes with whatever comes next.


Thank you for your work!


You've got at least one eagerly awaiting reader right here!

Staying tuned :)


Thank you, and kudos for keeping at it for so long!


Grande


Wow I guess I don't have nearly the knowledge of redis as many others here, but either way redis has been one of my favorite coding experiences! It works well, it's reliable, and it's very easy. Thanks so much for your efforts man!


@antirez - Thank you for Redis! It's been a joy to use across so many projects.

> However I never wanted to be a software maintainer.

And nothing say that you have to be. There's this perverted view that anytime someone creates a popular FOSS project, they need to dedicate every waking minute to maintaining it. That's neither economically feasible nor psychologically reasonable.

> Redis was the most stressful thing I did in my career, and probably also the most important. I don’t like much what the underground programming world became in recent years, but even if it was not an easy journey, I had the privilege to work and interact with many great individuals.

What is "underground programming world"?


> What is "underground programming world"?

The programming world that nobody else sees.

Everybody uses shiny FOSS tools, and some even make big $ using them, but nobody wonders where they come from and how much pain went into building them.


I was also intrigued by that sentence. I expect it means (open source) programming that happens outside of of big corps.

But I'm unsure.


Yep it's the open source, and in general the "spontaneous" development world, that happens without big money, just for hacking. This "place" once was kinda free and not observed much. Now you can't say anything, if you don't respect a good practice (LOL) people yell at you on Twitter. Even saying that commenting is a good idea is a problem. Not cool.


> people yell at you on Twitter.

Dude, the problem is just Twitter. Everybody shouts on Twitter, it's a system that encourages mob reactions. "Back in the day" people had to subscribe to a ML to yell at you, so fewer people did; and we all knew which lists were cesspools of trolls and flamers, making it easier to avoid the bulk of it. Twitter instead gives you the whole firehose, unfiltered and amplified. It's not a problem restricted to opensource or programmers, we see it everywhere at the moment.


> Even saying that commenting is a good idea is a problem.

I'm glad I'm not alone experiencing this.

One of the core open source projects I use has taken a no comments stance because "the code speaks for itself". It does if you're a core contributor, but if you dive in less frequently it takes a while to grok what's going on and re-build the mental model. Comments would reduce that.

Thanks for all you've done Salvatore, and for your blogging. Your enthusiasm puts the fun back into my programming!


> Yep it's the open source, and in general the "spontaneous" development world, that happens without big money, just for hacking. This "place" once was kinda free and not observed much.

Thanks for explaining.

> Now you can't say anything, if you don't respect a good practice (LOL) people yell at you on Twitter. Even saying that commenting is a good idea is a problem. Not cool.

Just because they're loud does not mean they're correct or that they're the majority. I can understand not wanting to deal with any of it though.

The larger than life you become in your space, they more your words, actions, and non-actions get parsed and twisted for political intent. It's either step away entirely or hide behind the mask of a pseudonymous alt.


> Just because they're loud does not mean they're correct or that they're majority.

They're not. They're the mediocre developers with nothing substantive to contribute. Think of your developer heroes. Almost none of them will ever engage in such nonsense. They're too busy building wonderful things to bother with petty nonsense that gets nothing done.


I think some of these agile thought leaders have a bit to answer for here (but of course it's mainly up to the individual to be responsible for their own judgement - just because somebody else makes their money on marketing doesn't mean you are forced to buy the product)


Lowering the barriers to open-source contribution has allowed in people who have absolutely no business being there. If you have standards, you get accused of gate-keeping.

Thanks for mentioning the T- website specifically, it takes a lot of courage to call it out directly these days, because all it takes is one of them with a lot of followers and then you get swamped with hate. It's fucking unreal man.

There's a ton of us down here programming and having fun, free of politics and bullshit. Look forward to seeing you (again).


There are times that discrimination is exactly what you want...


Where is "down here"?


outside of social media, inside our IDEs


There's absolutely nothing wrong with him not wanting to be a software maintainer. I don't want to be either, and I'm not even a programmer.

But there is DEFINITELY something wrong with the fact that, seemingly, NOBODY wants to be a software maintainer.


The problem is that people don't recognize the efforts of the ones who do it. Antirez did it for years. Do people expect someone to have the same very high-profile job with constant overtime and the same project for their entire lives? His efforts to stay on that project were heroic.

There are lots of other people who want to maintain it. Let them, and if they screw it up that is not his fault. He finished his project. Give him a break.


> NOBODY wants to be a software maintainer.

I think everybody wants it on their resume, but the practical day to day work tends to be more filtering poorly written GitHub issues than writing any interesting code. For a job that doesn't pay much (often at all), that's not something I would want to spend my time doing.


> What is "underground programming world"?

If you have to ask... ;)


We're all violating the first and second rules of "underground programming world"


I'd expect the underground programming world to index from zero.


The first rule would have index 0...


I expect the third to be 10


This is underground programming. Perhaps it's 1?


I'd make it -1, that way regular programmers wouldn't know about it.


"Should array indices start at 0 or 1? My compromise of 0.5 was rejected without, I thought, proper consideration." — Stan Kelly-Bootle.


I'd say that's the zeroth rule.


Sorry to be that guy but, why are you posting comments that lead to topic derailing that add nothing to the discussion?


Agree. I’d like to thank conjectures, brodouevencode, Bjartr, kungtotte, m0xte, fidelramos, chii and pokot0 for their contributions, but gently suggest none of the jokes were really that funny. Said well: https://news.ycombinator.com/item?id=7609289


Since we have a norm that those who post unfunny jokes shouldn't complain they are downvoted, we should also have a norm that those who don't like jokes should just downvote without comment. Of course, I'm violating the obvious meta-norm...


We actually have the opposite norm.

HN commenters are encouraged to post feedback in the threads about what's good and bad for HN comments.

See: https://news.ycombinator.com/item?id=7605973


That's fine, and there are probably some would-be HN comedians who haven't heard the news about this yet, but meta-discussion is really boring. This is the last thing I'll post in this thread, and I won't be surprised if it gets downvoted to oblivion.


> "underground programming world"

it's where you program in a basement.


Dang.

I say this frequently both online and when discussing system design with newer devs, but will repeat here: of all the production issues I've debugged, the culprit has has never been redis. In fact, redis has been a critical piece of achieving cost-effective scaling. It is one of only two pieces of software (along with postgres) that I blindly recommend without any caveats. From following along here and on your blog about how you approach things and think about the software, I think its clear that you and your vision for the project are a large factor of why it has been so reliable.

Thank you antirez!


Redis is simple. Good. Has a nice api. Has good libraries. Single threadsed. Extremely hard to scale. Impossibly difficult to cluster in containers because it uses hard coded ips to address nodes. Performs poorly with large payloads. Doesn't run on windows properly. Is extremely expensive as a hosted service (orders of magnitude in some cases, eg. azure).

You'll love it until you don't.

The scaling and clustering story is not nearly as nice as the quick start.

It's definitely worth recommending... with caveats.


Redis works well until the point it doesn't - like a lot of other tools.

A half-ton pickup truck works well until you need to haul bigger loads. At some point, you either need to haul smaller loads or change to a different, bigger truck.


> Is extremely expensive as a hosted service (orders of magnitude in some cases, eg. azure).

That seems to me an argument that should be pointed at cloud providers rather than Redis itself ;)


The point being that clustering redis is actually very difficult to do at all, never mind in a way that scales.

This would be a significant down side to using redis at all, except you can get away with not caring if you out source the problem with your credit card.


Redis is extremely simple to scale. Treat each instance in a cluster as wholly independent from other instances, and build a thin layer on top to implement whatever sharding and availability requirements your use case requires. I've done it many times and it's always been simple and worked brilliantly. Redis's predictability makes it a joy to operate.


We've done just that. Some folks at work wanted sentinel in front as a cluster management layer, but our particular use case did not work well there. Instead, we have some "logical clusters" of 3 nodes that we replicate reads and writes to, sharded to (currently) six clusters. Some logic around quorum for ensuring writes make it to at least 2/3 nodes in a given cluster, with some optimizations for reads sometimes only needing 1 node to respond. We had to do a bunch of tweaking around state and memory management, and all the details were in the docs, which was great. It does exactly what we need it to do, but it is more expensive to run, and we've not figured out a way to do this right in k8s. We don't care for the cost model going forward for when we want this model serving 10x traffic (which is not pie in the sky, it is known actual volume this solution would need to support). For 10x traffic, we'd be looking at 10x node count. At nearly 200 redis nodes, that can get expensive, esp. if we want to move to a managed solution. Anyway, not sure where I was going with this. Yes, redis can scale. Yes it can stay performant. At some point, it just becomes a lot to manage though and costs can add up. We are going to be designing a new solution to keep costs low and performance high.


@sagichmal "... scale ... implement ... sharding ..."

@sethammons "... sharded to (currently) six clusters ..."

I wonder, when did you start sharding? How many GB memory did your previously single-machine-Redis-instance use, before it was time to shard? How much memory does each "sharded node" have?

(It wasn't the CPU (Redis single threaded) that forced you to shard? But because you needed more memory? (Or sth else?))

> "nearly 200 redis nodes"

How much memory in each node, if I may ask?


> When did you start sharding? How many GB memory did your previously single-machine-Redis-instance use . . .

Sharding is always something you do on day 1 for every project, because a single-machine-Redis-instance is a SPOF and won't pass even the most basic operational readiness checklist.

> (capacity planning questions)

The answers to these questions don't generalize, they depend on your workload. You should figure out some approximation of your data types and request profiles, and use those to get a rough understanding of what one Redis server on a given machine class is capable of delivering. This usually means applying a few different classes of read/write loads against a small cluster at steadily increasing RPS, and documenting how CPU, memory, and latency characteristics change. From these numbers it's possible to derive a capacity plan.

The last time I did this, for my workload and machine class, one Redis instance (one core) delivered 250-500k RPS, invariant to memory used. We'd use the conservative end of that range, combined with the RPS and data set growth rates we predicted, to provision for ~12 months of growth. Operationally, we would deploy (cores-1) or (cores-2) instances per host (I forget exactly) on 32- and 64-core machines. I think they had like 64-128G of RAM, and we made sure to leave enough memory overhead so the AOF or whatever persistence option wouldn't lock up the box. But even the choices of what class of machines to use is a function of your use case, if you have really large dataset with relatively non-costly (CPU) operations, you want a totally different machine profile than a relatively small dataset with complex operations. Availability SLOs also factor in.

All of this is basic operational stuff, and with Redis the answers are pretty well-understood and highly predictable. Completely opposite to systems like Elasticsearch, which was a total nightmare to predict, provision for, and operate.


> "Sharding is always something you do on day 1 for every project ... SPOF ..."

Cannot agree with that. If one does that or not, would depend on things like Service Level Agreements (SLA) — and one can have a pretty high SLA uptime %, without sharding, e.g. if there's an underlying pretty stable hosting provider that live migrates if there's a hardware failure.

Thanks for writing about the last time you used Redis. Interesting to hear that, in that case, the machines had sth like 64 – 128 RAM, and 250k – 500k RPS. Yes I agree that I'd need to benchmark and think about what type of machine(s) to use (some time later — a bit too early for that now). Sounds as if you are / were a pretty large company / project, needing that much memory and machines :- )


Nope.

If you have one instance you better be damn sure that downtime doesn’t cause an an outage. IE. no redis means services still run.

The “it’s fine, the SLA covers outages” is just a) laziness and b) negligence.

You don’t do that with web servers, you don’t do it with databases. You don’t do it with your redis instance either.

...well, I suppose some people will do the it anyway; but you get what you get if you do.

If a major outage gets you fired, you have no o w to blame but yourself.


> Cannot agree with that. If one does that or not, would depend on things like Service Level Agreements (SLA) — and one can have a pretty high SLA uptime %, without sharding, e.g. if there's an underlying pretty stable hosting provider that live migrates if there's a hardware failure.

Sorry, no. A single instance is never acceptable from any risk perspective, no matter what guarantees the hosting provider claims.


Extremely hard to scale in what sense? A single redis server running on fairly commodity hardware can serve some pretty intense loads (10s of thousands of ops/sec). Once "scale" bigger than that is an issue, companies should already have in place the development staff that will ensure scaling up is done in a sane way, i.e., that have enough sense and/or experience to choose the correct tools for the job.

Redis is one such tool--its clustering "story" may not be ideal but even a small, minimal cluster will be more than sufficient for any use-case that a distributed memory cache is fit for at a scale that will cover 99% of business' needs.


> Extremely hard to scale in what sense? A single redis server running on fairly commodity hardware can serve some pretty intense loads (10s of thousands of ops/sec).

~90k/sec on a single core of L5520. Scaling Redis is a premature optimization for 99.99% of the use cases. While it may be sexy to talk about millions of ops per second that one's project does in reality the number of projects that have that as a requirement is probably barely in triple digits globally.


I think you are using it wrong. It is not meant to be run in a K8S cluster woth dynamic IPs in multiple instances. You are supposed to deploy VM mesh of fixed IPs as database store. Moreover, it is design-dependent. You can live with just multiple master-slave pairs and have your data implicitly sharded by something, e.g. by user country or continent. It's sad that some people still think "perfect db" exists: partition-tolerant, high-available, durable, horizontal-scalable, low-latency, acid-compiant, open-source database dosn't exist and never will (see the CAP theorem, see the broken guarantees found by Jepsen[1]). Live with it and design your architecture appropriately.

[1] https://jepsen.io/


I don’t think most people need a fully partition tolerant solution; even at very high scale and with high SLAs quorum based solutions are used successfully. If you remove strict partition tolerance from your above list there do exist such databases. And I’d argue it’s much easier to develop against such a database and you’re more likely to actually preserve its guarantees in your application than running an ad-hoc cluster of Redis instances with a home-spun clustering scheme where your application logic is heavily implicated in maintaining consistency.


I only used it once, but it's clustering story was bad, and I never really understood the niche it filled between Memcache and databases.


better memory model over Memcache. If one of our memcached servers dies, that data is gone. Redis can write to disk, optionally. We mostly use redis and memcache as a cache to save load from the db. Even with dozens and dozens of dedicated read hosts, we can knock over our dbs if we are not caching data.


There are also memcached-protocol implementations with persistence (MemcacheDB, couchdb server).


I read it twice trying to figure out why you were invoking @dang.

In any case, I've had the same experience with only two programs - CouchDB and Redis.



It's been a word for a long time ... we used that when we were kids (at least in earshot of our parents). Searching for "dang" in Algolia results in (by a quick count) more than 80% of the results being for @dang (the person/handle) rather than the perjorative use.


I would rather be remembered as a bad artist than a good programmer

Takes a rare person to say this, made me smile :)


Sounds like a bit of Italian culture leaking into that phrase

But don't worry Antirez, Redis is far from a bad work of art, quite the contrary.


Personally I think it's mainly the result of having people constantly being hypercritical of your code.

And I think he's proven himself to be a superior programmer. In that in almost every category of engineering skill and knowledge, he is better than 90% of the people criticizing him. If he didn't start out that way, over the years his knowledge and skills grew to make it so.

But also maybe it reflects a bit that there is always some new "best practice" or something that some months ago no one heard about, but now many people are unfortunately using the adoption of as a proxy for programming skill because they are unwilling or unable to actually judge something or someone on actual merit.


When I read that line my heart broke a little.

I think he's done a great job with Redis. It goes to show sometimes that you need to let go of the thing you created for the good of the community. If I were in his position, I would have made the same move


My thought here. I'm not exactly a disinterested party because I built my own key value store company (possibly the wrong way but that's a different story).

I have a huge respect for Redis, and Antirez, but I have to say my respect doesn't include RedisLabs. They're the ones who started a commercial endevour to capitalize on Redis initially without Antirez, and then later offered him a position. They're the ones that Kyle@Jepsen says is making claims about ACID, not Antirez. I always heard that Clustering was a feature Antirez was very reluctant about.

I hope Redis is, fundamentally, taken away from RedisLabs.

Antirez, you say you want to express through code and open source, and I can't square that with your association with RedisLabs. You've been taking their money for quite a few years now to allow them to put up a billboard saying "the home of redis".

I'm going to stop right there. I've cut my own path through the wild jungle that's Open Source, and it's not yours, and I respect the years you put in to make the product with your vision. I'm sure there are some other first coders of foundational databases on this list, but it's a small club.

As an employee of RedisLabs, I don't think you are free to say what you'd like to say, I hope you follow whatever path does allow you to freely express in the future.

Good luck always.


I just want to say thank you to antirez for Redis, for how simple, fast, and rock solid it remains to this day. Redis is one of those things that allows you to tilt your head a little on a problem--thinking of solutions in terms of set operations and lookups. A lot of people use it understandably for a cache but it is so much more than that...for me it's introduced an entirely new way of composing solutions to problems. Cheers for all you've done--you've shown at least one programmer that there is still a place for small, elegant design that will stand the test of time.


HN hugged to death. Here's the snapshot on archive: https://web.archive.org/web/20200630130517/http://antirez.co...


I think its website need a fast cache.


Actually the web site uses Redis as the only store. And Redis is using 0.1% of CPU. The problem is that Ruby sucks at doing anything scalable. It's just a Ruby/Sinatra app. If you do that in PHP, it will work out of the box with many concurrent accesses. With Ruby not the case. There are ways to deploy it better, but it should be fast as default, which is not the case.


As a lover of Tcl (https://web.archive.org/web/20200615130120/http://antirez.co...), I'm surprised you're using ruby and not something Tcl-based with its built-in concurrency


I guess it would be interesting if you re-wrote your website in PHP and wrote a blog post about it with the title 'Why I Moved From Ruby to PHP?'


Or just build a proper Ruby implementation


That sounds like a good area on which you might work! :D


NGINX supports Lua scripting. Many years ago I worked on a system which ran a full website on NGINX + Lua + Redis.


I actually wonder how many request/s one gets from being on the top of HN.


not very high

a previous post of mine got 500 points and stay #1 for a few hours.

https://news.ycombinator.com/item?id=22410448

traffic from it looks like this

https://tuananh.net/2020/03/02/traffic-from-top-post-on-hack...


> Traffic stats on Cloudflare seems a bit inflated with the unique visitors at 36k. Maybe they do count bots as well there.

First screenshot looks like Google Analytics to me; I'd say it's more likely a lot of us have blocked it and Cloudflare's number is more accurate.


My "Show HN" post was in the bottom half of the HN home page for less than an hour. Traffic to the site was roughly 100 times greater than its current levels (by bandwidth):

https://www.linkedin.com/posts/rik-roots-50349611_in-case-an...


"antirez 2 hours ago. 52347 views. "


Those are the ones that got through all the way, or at least the ones that got picked up by the view counter. Not the people that got error or timed-out responses.



While a very different circumstance, the pull between "I write code in order to express myself" and being an "artist" vs. "useful" and the drudgery of maintenance reminds me of famous rubyist _why and why he stopped doing stuff in the community.

https://www.smashingmagazine.com/2010/05/why-a-tale-of-a-pos...

https://kev.town/2013/04/30/why-did-why-the-lucky-stiff-quit...


I would love a story on

"I don’t like much what the underground programming world became in recent years"

What could he mean? What underground programming world is he talking about?


Underground as in programming for fun or as art, because you enjoy it as a hobby/subculture. Opposed to the "above ground" programming world of programming for other people (possibly also for money, but OSS is often just for recognition) where people have demands about unimportant features, terminology, coding styles, codes of conduct, etc. Sometimes they get quite aggressive about their demands, too.


Probably the roving mobs on Twitter who occasionally brigade project issue trackers and mailing lists. Check out the master/slave post he wrote a while back.

Or just the toxic nature of some open source communities, especially on Reddīt for whatever reason.


This.

The underground in underground programming refers to maintaining low visibility, as to present low target silhouette. Additional benefit is not attracting too many participants that are in it for the clout, rather than for solving problems & good engineering.

Open Source is no longer sufficient for software freedom; the current 'battlefield' is maintaining security from activist pressure or gradual take-over.


I created the Occupy Wall Street website nine years ago. Believe me when I say the lengths people will go, to try and control community projects, is downright traumatizing. I never could have imagined that same kind of nastiness would impact open source.

If you don't feel comfortable engaging with the new toxic culture, you can use my underground liferaft. My liferaft isn't an operating system, but rather an attempt to help us not depend on them as much. I have no idea who's controlling GNU/Linux these days and Occupy was enough drama for one lifetime. My code has the same focus on clarity that Antirez put into his Redis codebase. My liferaft also empowers you to build and distribute tiny native portable programs (like Kilo!) using hermetically sealed tools. See https://github.com/jart/cosmopolitan


Thank you for the interesting angle.

>the lengths people will go, to try and control community projects

I've heard that echoed a couple times in Tim Pool's discussions of the (american) OWS. Scary stuff indeed.


This implies that a lot of the politicization of open source projects has to do with outsiders making power plays (for in group status or just because narcissism). I think this is part of it, for sure. I also think it can also manifest when parts of the community get trapped in a purity spiral, which is somewhat related but comes from within rather than without.

Advice? I don't know. Stay underground and ignore the mobs, they will get bored and move on if you ignore them.

Ironically, I think lowering the barriers for involvement in open source has let in a mass of people who have no fucking business being there.


Counting contributors & contributions is about as sensible as counting kLOC and pages of manual.

Conway's law about software architecture implies existence of management-space CAP theorem equivalent.

Communication suffers combinatorial explosion[1], and graph problems are pretty expensive to solve in meatspace.

Attention is an exhaustible resource, and easily DDoSed.

[edit]

dilandau - please note I've carefully avoided certain spicier keywords & expressions in the previous post as to not off put a casual reader and avoid attracting quick downvotes.

The couple spicy keywords in your response end up needlessly detracting a casual reader from the correct point you are making. And I'm not talking about the "fucking" adjective :)

--

[1] l = (n-1)*n/2


This is not first time Antirez quit. 10 or 8 years ago he deleted his Twitter account with 10k followers. I think today it reached critical mass, and he does not want to be public figure anymore.


Replying to myself to highlight antirez's own comment upthread:

>Yep it's the open source, and in general the "spontaneous" development world, that happens without big money, just for hacking. This "place" once was kinda free and not observed much. Now you can't say anything, if you don't respect a good practice (LOL) people yell at you on Twitter. Even saying that commenting is a good idea is a problem. Not cool.

So yeah, pretty much twitter.


Probably the same which was the reason Guido left Python as BDFL.


I am assuming low level systems in commercial software systems, would like to hear from @antirez :)


Perhaps the fact that a recent (2018, but posted here recently) blog post of his got flagged on HN after 141 comments has something to do with it...


If you don't know it's because we don't want you to know ;)


Moved the blog in a more decent server :D Faster now. But DNS propagation will take some time. Yet most of the new requests will go in the new server so also the old one will be faster.


> In eleven years I hope I was able to provide a point of view that certain persons understood, about an alternative way to write software. I hope that such point of view will be taken into consideration in the evolution of Redis.

To me this epitomises what Bill Gates meant when he said "Most people overestimate what they can do in one year and underestimate what they can do in ten years.".

I just wish I had something to show for my last decade that had as much impact as Redis!


As a redis user for more than 8 years, i just want to say thank you. I had embedded redis 2.8 on small IoT system with 200mhz/64Mb of ram to huge cluster as a message bus (redis-as-kafka pattern). Want a shared memory with a type system? Use redis. Want a queue? Use redis. Want something easy to mock, with an API in all major ecosystems? Use redis.

Thanks for your work :)


It's long past due that we should move to software which isn't maintained - because there's nothing to do. Adding features could be done either by writing a new one - because the requests don't really fit the meaning of old one, the creators saw that and rejected; fixing bugs - yes, fixing bugs may remain, but are there many bugs in, say, TEX code?

We don't yet know how to write a completed software well - the one which isn't updated on Github for years yet nobody calls it stale or outdated.


I know at least one software that was complete - hasn'tbeen updated in a long time and I still useit. It's Winamp.


I think video games fit in the area of 'completed software'. Most video games today rarely see updates a few years after they're released. And older video games were on read only mediums, so you would hope whatever you release is very stable and feature complete.


Antirez is an inspiration, for me at least. Not only because of what he achieved, Redis is a very nice piece of tech, but also because of his programming style.


Thank you! In building Redis you’ve contributed some wonderful software to the world. In addition, I’ve always found your blogs to be interesting reads. I’ve also learned by the examples you set both from a coding perspective (reading your wcode), and engineering perspective. Thank you again, looking forward to whatever is next!


I am struck by how beautifully expressed this letter is. @antirez, thank you so much.

It's really great to see when someone who is totally honest with themselves and what sparks joy in their life/career, and is also respectful to all the people who depend on the work/artifact. So much respect.

Thanks again.


Absolutely love your work @antirez. Also appreciate your blog.

Using Redis to handle greylisting on a custom Node.js backed email forwarding service:

https://github.com/forwardemail/free-email-forwarding/blob/0...

Also using it for job scheduling (with clustering support on top of Bull):

https://github.com/forwardemail/forwardemail.net/blob/master...

So many things you can do with Redis :tada:


"In essence, I would rather be remembered as a bad artist than a good programmer."

Of course an Italian programmer would say this.


Redis is an astonishingly good piece of software. I've always found its beauty to be the reflection of your philosophies, @antirez. Thank you. Here's to you finding joy in your pursuits!


When some software I was responsible for started melting down under a load 10x bigger than it could handle, I was able to fix it by doing an emergency rewrite of the data storage part using Redis with Lua scripting. This was back when that feature was still experimental, so I was using unstable tarballs in production -- and yet everything worked perfectly! The emergency was fixed in a single long day. It was a miracle.

Thanks for all the great things you've done with Redis! "Beautiful" describes it well.


First and foremost thanks and good luck @antirez, your comments and pointers here have been nothing less than amazing.

On a more selfish note, how is this going to affect Redis development?


Hey! I'm not part of how the new setup will be. I don't liked to maintain, and selecting a new development setup is the most mantainer-ing thing ever :D


Guess we'll all sleep with the fishes now. Good that you're going to guide them somewhat, I hope they carry the project forwards; good luck Salvatore! <3 We love you man


Looks like they’re already well covered with community contributions and two new (or pre-existing) maintainers?


I can think of few other programmers who have contributed so much, and ever fewer who have signed off in a way that was so filled with dignity. What a guy.


He shared some of his struggles a while ago: http://antirez.com/news/129

Great work @antirez! Thanks for your dedication. Stepping back as maintainer and giving your support from the Redis Labs advisory board is nothing less than what you did so far.

It's sensible that you don't want to make plans about the rest of your time right now.

Cheers


Thank you, @antirez! I have a live stock market site that heavily relies on redis for streaming data, tracking leaderboards, and message passing. It would have been difficult without Redis. You really affected my life. Big hug to you, Salvatore! I hope you find your next inspiration, and bless us with your next masterpiece. :)


My co-founder and I had successfully launched two of the major web 2.0 services of the Italian web.

What are these services?


One of them was LLOOGG: https://github.com/antirez/lloogg, which used to be at lloogg.com but it seems like the domain was not renewed.

I remember using it on my personal website long before I had even heard of Redis, it was a nice analytics tool for small sites with little traffic.


Segnalo and Oknotizie. Segnalo was similar to delicious, Oknotizie similar to Reddit/Digg. Later in order to create the first service, LLOOGG, I had to write Redis.


I know exactly what you mean when you say you wanna be a software developer, not a software maintainer


I've made a little bit of money thanks to Redis [0]. All I did was build integration for Redis on cPanel. So that speaks to the great quality brand of Redis.

Thank you and Godspeed!

[0] https://www.unixy.net/redis


I'm grateful to Antirez for inventing Redis in the first place and putting in all the great work he's done since. However I'm worried about the implications of this change for the continued existence of Redis as open-source in the public-goods sense.

What does it mean that Yossi and Oran are taking over as maintainers - are they doing so in their personal capacity or as employees of Redis Labs ?

How are potential conflicts between the business interests of Redis Labs and the interests of the community to be identified and resolved ?

Who will own the copyright over the newly submitted code and are there any safeguards against future versions of Redis being released under licenses more restrictive than the current one ?


> ... what I write is useful just as a side effect, but my first goal is to make something that is, in some way, beautiful ...

I love beautiful code too, however if it's not useful, then the beauty fades quickly for me. What's the point?


What a beautiful conclusion for him on such a beautiful project. This man clearly loves the art of programming... so much, that he would give up power, just to pursue it again.

Thanks for the wonderful blog posts (over the years) and products.


Thank you for writing this antirez, I think I'll remember it as a statement of some principles that I like to think I aspire to also: like many people here I guess, I would describe myself as someone who loves writing software, and in my own small way I've also tried to avoid being dragged into team/project management because that is not what I seek out of a lifetime involved with code. And, yes, I do like to think of writing code as a creative activity / form of expression. I also need to study your C code more! Perhaps I'll look at the early redis commits.


Congrats and thank you, Salvatore (@antirez), for producing such a beautiful, powerful, useful and important piece of software... and for articulating and demonstrating such passionate commitment to a personal vision that is so very rare, valuable, and inspiring... and for your responsible stewardship of its maintainance even when it came at the cost of your personal preferences. You're a class act, and I have no doubt you'll be successful with whatever comes next. Hats off for doing it right! Bravo!


Thank you very much for all your time and effort in starting and shepherding this very important project (and also in finding a great home to continue the legacy).

Redis was (and continues to be a very integral) part of my startup's stack. We've also extended the redis protocol for all sorts of custom hacks.

I will miss your humility and patience in communicating the roadmap, technicalities and all around community work. A great all-round example for all of us to follow.

Thanks so much - and eagerly looking forward to your next set of projects!


Just be an Italian dude, or Sicilliano, Antirezzzzano, whatever, you're great, thanks for Redis

Don't need to do much more. Just be You man. Live on. You are beautiful. We thank you for Redis


Over the last decade, Redis has been my go-to example of beautifully written code. Thank you for such an amazing creation @antirez, and best of luck for whatever you do next.


I first met antirez during the Engine Yard Hamming Distance contest. Does anyone else remember that? DJB, and his team, won it. It was a lot of fun to participate.

http://oldblog.antirez.com/post/some-math-about-the-engineya...

I wish companies would have contests such as this more often. I think it would be a great way to find and hire really good people.


Hi,

Antirez thanks for the Redis.. even though I have not used redis in real time.. some what I got attracted into redis and when I have attended redis conference in Bangalore got to know much about redis and got a chance to see and listen your talk.. all the best for your future hopefully you will come back with new thing where I can learn more from you.. partially missing you from github mail nofications which I didn't thought....all the best


  Recently I published videos in Italian language explaining technological concepts to the general public
where are the videos ? I can't find them



The fact that one person can (mostly on their own) create a tool as widely-used and respected as Redis is very inspirational to me. Good luck for the future!


If you flip that around, it's possible that being driven by one man was a contributing factor to redis' success.

Design by committee and all that.


It's been pretty cool to see that grow. I recall chatting with antirez about it on IRC ages ago when he was still working on the initial idea.


@antirez, thank you for Redis. It is my favorite database and I often refer to it as one of the most successful OS projects that I know of.


Thank you for such a great piece of software, Antirez. Redis has been an integral piece of my stack for years now.

I, too, am leaving the company I founded soon and have mixed emotions about it. I certainly don’t enjoy the monotonous nature of maintaining software and yearn for those early creative days.

Best of luck to you in the future! Looking forward to seeing what you create next.


The word that always comes to mind reading these posts is bittersweet.

On one hand, it’s sad that they’re leaving, and/or that circumstances made the job less enjoyable than it would otherwise be.

But on the other hand, I cannot help but be happy for one who has thrown off the chains and is now free to pursue their dreams again.

Best of luck wherever life may take you!


There are only a few pieces of infrastructure that I haven't found myself cursing at, redis and haproxy are among them. They both are the closest to set-it-and-forget-it I have worked with. No doubt the leadership of Antirez played some part in that. I hope the project can continue to reach the bar he set.


Coincidentally was reading an old discussion, few days ago, of Salvatore joining Redis labs fulltime from Pivotal labs. The discussion can be found here [0]

[0] https://news.ycombinator.com/item?id=9890824


> In essence, I would rather be remembered as a bad artist than a good programmer.

words of wisdom right there


Thanks for Redis! I never built anything that successful but can relate that being a software maintainer is really hard and many great software developers who build great software, have a hard time with it and not finding it very enjoyable.


As someone who loves programming and dreads most of project management (and being anywhere close to a limelight nowadays), I understand.

Redis is an awesome piece of software and who knows, maybe this'll free antirez to create another awesome tool.


Building a thing is fun, maintain not. Especially if it is a tool, a tool for a specific problem and it solved it. But people want more and more functionality. Then you work on things you never wanted to do.

You take the exit, i can fully understand it.


I think you've been a role model in how to build and maintain a popular software project while keeping the spirit of FOSS and promoting a positive community around it. I look forward to seeing what you get up to next.


Antirez, I look forward to seeing what you do next. I especially look forward to there being more software in the world that’s architected with your unique mindset—whether it be “useful” software or not. :)


Redis is one of the best pieces of software of the last 10 years, thank you so much for creating it and maintaining it! It has been incredibly useful for me and thousands (millions?) of developers.


Thank you for your amazing work. Redis has been by far the most dependable component of my tech stack and it's opened up a whole new way of thinking about data.

Best of luck in your future endeavors!


Thanks Antirez, Redis powers my startup and we could not have done it without you ! You and your beautiful release notes essays will be missed.


> I don’t like much what the underground programming world became in recent years,

I find this to be a provocative statement. Does anyone know what he means?


I absolutely love Redis! I really wish more software worked as well and was as easy to use - thank you for creating this absolute gem!


Honestly this change is great for Salvatore. Hope they find another bright idea and inspire the programming community! All the best!


Cheers @antirez, thank you for Redis!


Simon Wardley “system of theft” comes to mind. This is probably a good move. Keep on creating!


Thank you. Redis has been the nervous system of my main project for the last eight years.


a very nice interview (in Italian) published last May: https://www.youtube.com/watch?v=GgT6rXytKds

Towards the end he anticipates what is now public.


> In essence, I would rather be remembered as a bad artist than a good programmer.


We love redis. Thanks for the creating and contributing so long. Good luck @antirez.


“I would rather be remembered as a bad artist than a good programmer.”


redis complexity has been increasing a lot lately (module, stream, multi-thread,...)

not that i don't like it but antirez has been hesitated about adding those before.


thanks to @antirez, for the elegant data structures in redis. literally, cs concepts transferred to practicality, when I learned redis


Thanks for redis.


thanks and congrats. i always admired your approach to language, whether computer or human intended. good luck.


Redis is a pleasure to work with


redis is really a joy to work with. truly, thank you.


Thanks @antirez!


grazie mille Salvatore


@antirez - thank you so much for your work, and for your patience with dealing with us all over the years. I have benefited greatly from your willingness to share your engineering skills, and you are one of the most respected programmers in my list of people to follow online.

So, onwards and upwards to new things. Perhaps now you have time for my favourite of your projects, LOAD81? :)


Yeah, I don’t see how maintaining a project like that has any long-term appeal. You’re not the upstart anymore, you’re the government. You stand to lose more by mistakes that affect reliability than you stand to gain by changing or adding things.

I’m at a similar point in my life, though of course I’m much less influential than him. I’m getting to the end of the most stressful and most important part of my career, with no desire to do something similar again, without a clear idea of what’s next.


Is it possible to build software without maintenance ? I think we need a new model for software ... where original build is self-sufficient but you have any number of remixes.

Right to implement a basic feature to an existing software there is too much code that touches way too many files.


Thanks for all! Good luck in future


Redis has given me more than the occasional headache when it comes to its lax security defaults and how since it's going to be local then why bother changing them? But there's no denying that when it works, it works damnably well. So for that, I give you my thanks and good luck in whatever endeavors you find yourself involved in!




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: