DataScience.com provides an enterprise data science platform that combines the tools, libraries, and languages data scientists love with the infrastructure and workflows their organizations need. Check out more details about our product at https://www.datascience.com/platform
DataScience.com Platform is deployed on-premises by our enterprise customers. We make extensive use of Docker to deliver single tenant infrastructure where many different data science workloads can run as containers. If you are excited by solving challenges around containers, their orchestration and management, this is a great opportunity.
We are hiring for multiple software engineering positions on our backend API team. You must be highly competent in Go or Python and have deep expertise in development of backend APIs.
Stack: Go/Python, gRPC/REST, Docker, Swarm/Kubernetes, Postgres & more
We are looking for candidates with good understanding of container service discovery (consul/kubedns/swarm routing mesh), container networking (host/bridge/overlay) and HTTP/websocket routing (nginx/haproxy). Any knowledge of data science tools (Jupyter, RStudio/RShiny etc) and workflow is a plus. We also have one open position that requires deep Hadoop expertise.
Send me an email at badar+hn (at) datascience.com if you are interested!
I had boot loop problems twice in less than 3 year span with two different Nexus phones one after the other! Nexus 4 and Nexus 5X. I gave up on Android after that. It sucks because I was a big Android fan. Not going back now even after the whole headphone jack fiasco with iPhone 7+
Location: Los Angeles, CA
Remote: Yes (preferred)
Willing to relocate: Possibly to Bay Area or Seattle
Technologies: Java,Node.js,Go,AWS(Dynamo/Kinesis/EMR/Redshift),Spark,Docker,Kubernetes
Email: hire+hn {at} badarahmed.com
Senior Software Engineer with 8 years of experience all across the stack from frontend to backend and Infrastructure Automation/DevOps to Data Engineering.
Looking for a remote friendly position either building microservices on the backend or Data Engineering.
I have had this annoying problem and had no idea what was going on until I stumbled upon forums somewhere after many Google searches. My Anker USB 3.0 hub would cause my bluetooth keyboard/mouse receivers to become unresponsive at random times (in retrospect at times when the hub was placed close to the Macbook Pro). I placed the hub at some distance from the MBP and voila the issue went away!
I'm glad to see that problems with Anker USB 3.0 Hubs happen not only for me. In my case, the Wifi became unusable once the Hub was connected. Quite a shame for a nice looking, affordable device to have a breaking issue with shielding.
I don't have a good idea of the requirements at Spotify, but looks to me that using a streaming system like Storm or Spark Streaming would solve the 30 min event delivery delay they are experiencing w/ unstructured text -> Avro conversion. The latency for delivery would go down to sub-second levels.
Also the article doesn't say WHY they didn't use Kafka to persist the events. Kafka it's designed to do that.
Once persisted the consumers can just read kafka data and send them to hadoop, with less latency. Or you can plug storm o spark in as you said and do the analisys there real time. Or both.
> When the system was built, one of the missing features from Kafka 0.7 was the ability of the Kafka Broker cluster to behave as a reliable persistent storage. This influenced a major design decision to not keep persistent state between the producer of data, Kafka Syslog Producer, and Hadoop. An event is considered reliably persisted only when it gets written to a file on HDFS.
DataScience.com provides an enterprise data science platform that combines the tools, libraries, and languages data scientists love with the infrastructure and workflows their organizations need. Check out more details about our product at https://www.datascience.com/platform
DataScience.com Platform is deployed on-premises by our enterprise customers. We make extensive use of Docker to deliver single tenant infrastructure where many different data science workloads can run as containers. If you are excited by solving challenges around containers, their orchestration and management, this is a great opportunity.
We are hiring for multiple software engineering positions on our backend API team. You must be highly competent in Go or Python and have deep expertise in development of backend APIs.
Stack: Go/Python, gRPC/REST, Docker, Swarm/Kubernetes, Postgres & more
We are looking for candidates with good understanding of container service discovery (consul/kubedns/swarm routing mesh), container networking (host/bridge/overlay) and HTTP/websocket routing (nginx/haproxy). Any knowledge of data science tools (Jupyter, RStudio/RShiny etc) and workflow is a plus. We also have one open position that requires deep Hadoop expertise.
Send me an email at badar+hn (at) datascience.com if you are interested!