Obtain the slides right here>>

Occasion Streaming is likely one of the most vital software program applied sciences within the present computing period because it allows techniques to course of large volumes of knowledge in blazingly excessive velocity and in real-time. It’s certainly the “glue” that may join information to move by disparate techniques and pipelines which are typical in cloud environments. Leveraging on the Pub/Sub sample for the message move, and designed with the cloud in thoughts, Apache Pulsar has emerged as a robust distributed messaging and occasion streaming platform lately. With its versatile and decoupled messaging type, it could possibly combine and work effectively with many different modern-day libraries and frameworks.

On this session, we’ll construct a contemporary, environment friendly streaming information pipeline utilizing Apache Pulsar and Apache Cassandra. Apache Pulsar will deal with the information ingest. The exterior information that is available in will probably be used for additional processing by Pulsar Capabilities that can in flip reference the tables in Cassandra as the information lookup sources. The outcomes of the reworked information will then be egressed and despatched to an Astra DB sink. We can even look at to see how we are able to additional optimize the complete processing pipeline.