Big Data for Small Dollars

Edward 1-4

The defining attribute of Big Data is size. It's big data, and that means it's going to cost money to store it for processing. Hardware isn't free.

So instead what we're going to look at here is running big data analytics in-memory prior to storage.

Using an in-memory streaming engine we can process the data as it comes in, derive the insights that help us, and only pay to store those insights. Effectively we store the output of the processing not the input. Naturally we'll store this in-memory too, in an in-memory data grid. And as a nice side benefit since we process the data as it arrives, the insights derived are available immediately, so we can act upon them real-time for competitive advantage.

The talk will be accompanied by a demo that you can download from Github after.

Profile picture for user
Solution Architect
Neil is a solution architect for Hazelcast, the world's leading open source in-memory data grid.
In more than 25 years of work in IT, Neil has designed, developed and debugged a number of software systems for companies large and small.