Hacker Newsnew | comments | show | ask | jobs | submit | erichmond's comments login

If it makes you feel better, most of those financial benefits disappear once you cross a certain income threshold, as I so unexpectedly found out post-marriage.

Phenomenal comment. Hopefully people read this and contemplate it. I've gone through an intense period of my life with respect to life and death, and a couple of years ago I only thought about "doing the right thing", now I ensure I enjoy each day I have, because nothing is promised and possessions are ultimately useless.

-----


Amazon does not provide SLA agreements at all. I don't think people are necc. disagreeing with your vision of how things should be, but the fact is, enterprise software just doesn't work the way you're describing.

-----


http://aws.amazon.com/ec2/sla/

-----


Exactly. I see it as a tacit admission that you are effectively a cog in a wheel if those are the kinds of questions they are asking.

I know some people get frustrated by those kinds of questions, but I'd just see it as a reverse weeding out process. If you still want to work at (insert company here), just build something valuable and have them acquire you. At that point they'll acqui-hire you and you'll leap frog all the people who got in because they had Knuth books memorized.

-----


We are finalizing our production tests right now. We will be using it to do all of our user event processing. (workflow: app -> kafka -> onyx -> redis && s3.

Soon after that we will move our audio upload/transcoding process into a different pipeline as well.

If you're already using clojure, this is a no-brainer if you want to do stream or batch processing.

-----


Really excited to see where this project goes. Has the best "to production" story I've seen from any of the batch/streaming frameworks.

-----


Can you elaborate a bit on this aspect? In which way is it easier to deploy than Spark/Hadoop/...?

-----


Onyx feels more like a library then a framework, so it's not as 'heavy' as other frameworks. Also, since it relies on pure data and pure functions, it was actually trivial to get up and running with it when I was evaluating it. There was about 20 lines of boilerplate I needed to copy, and then I just built a workflow with the functions I had already been using and it all just kinda worked.

I was able to develop in the REPL, which was a huge win, and deploying is as simple as uberjar / copy to host.

-----


They had no choice. Remember, this was America in the 1920's. Black jazz musicians were not allowed to eat in the clubs they played in. Often times not allowed to walk in the front door of those same establishments. Dealing with organized crime was probably 100th on the list of issues African-Americans had to deal with at the time.

-----


Agreed 100%.

I am curious what people think a fair sentence would be, given the sheer amount of drugs sold on SR. Selling over a pound of weed here in NYC will cost you 15 years, which for most people would be about 1/6th of their life.

Also, I am interested with the number of people saying he didn't actually do anything that wrong. I wonder if they are saying the same thing petty drug offenders. Maybe people do but they don't vocalize it, but I think if we saw this kind of empathy for all non-violent drug dealers, things would look very different here in the US.

-----


It's easy to store messages in HDFS or S3 for long-term storage. It's also easy to replay messages from those mediums, if you need to re-ingest data later on.

-----


Very interesting choice to go with RabbitMQ over Kafka. Good stuff!

-----


I can imagine that Kafka might make more sense as we scale up further? RabbitMQ has the right trade off of performance / setup etc..

-----


Kafka in the long run is probably a better choice, we went with Rabbit as our core developers were pretty familiar with it and we had several libraries that were ready to go. That said Rabbit is providing more then enough throughput right now and once we're bigger enough for rabbit to be our bottleneck/problem area that will be a lovely problem to have :)

-----

More

Guidelines | FAQ | Support | API | Security | Lists | Bookmarklet | DMCA | Apply to YC | Contact

Search: