Pat Patterson and Ted Malaska talk about current and emerging technologies. They evaluate each and understand how they are useful in solving problems related to large scale data processing, joining and combining streams. They also talk about the various ways of achieving "at least once" and "exactly once" processing and how we can make sure that data is processed in a timely fashion.

Ingest and Stream Processing - What will you choose? - Download as a PDF or view online for free

Ingest and Stream Processing - What will you choose? - Download as a PDF or view online for free

A lot has changed and a lot has stayed the same with Ingest and Stream Processing over the years. But today there are many options than even for Ingest and Stream Processing that one may wonder why one solution versus the other. The problem is that in this space, one size does not fit all, and that makes it all the more confusing. This talk aims at giving the audience a direction to choose when it comes to Ingest and Stream Processing. We aim to help the audience understand the solutions available to them, and to make the best choice based on their use-case. In this talk, we will be go over current and emerging technologies in the marketplace. We will evaluate each and understand how they are useful in solving problems related to large scale data processing, joining and combining streams. We will also look at the various ways of achieving "at least once" and "exactly once" processing. We will discuss how each of these can be scaled and how we can make sure that data is processed in a timely fashion.