This post originated from an RSS feed registered with Java Buzz
by Marc Logemann.
Original Post: mixed storage applications (redis and rdbms)
Feed Title: Logemann Blog
Feed URL: http://feeds.feedburner.com/LogemannBlog
Feed Description: Marc Logemann's thoughts on java and other stuff
Gathering real time data and showing various statistics is a plus for each software product on the market. The same goes for our logistics projects we are doing. Here you have metrics like picked articles, number of orders, orderposition analysis and others. While some metrics are easy to gather and easy to visualize via normal RDBMS, others have quite a big impact on db read and write performance. Of course you can chose OLAP to visualize various statistics but this wouldnt be realtime anymore. We want to show stats as they are happening with the frontend techniques you have nowadays like Websockets or AJAX poll. If you do classic ajax polling for expensive stats (SQLs) in a normal db, you simply kill your system. Then you can start putting massive efforts into clustering rdbms or change the way you think about databases for certain features.
With redis, being an in-memory key-value datastore with persistence capabilities, you get insane performance. The only thing you need to be aware of is the projected size of the resulting datastore. You really dont want the OS swapping memory. But with some calculations and proper usage of time-to-live (TTL) of your entries, this can be handled.The good thing for real-time statistics data is, that its normally not business critical so if you start using redis in that area, you dont need to think about the persistence thing too much in the first run.
One weak point of redis is: Its quite new and you dont get a book on redis. redis itself is pretty simple from command set perspective but a best-practices book on building the best data structures for common use-case scenarios would be nice. Of course you can google a lot in that area (notably the blog of the redis author) and most solutions are not that hard to create yourself. In terms of API libraries you get at least two quite mature ones in java with jedis and jredis. Plus you can also get some kind of higher abstraction library with Spring-Data Redis which support both possible base libs.
NoSQL databases are eveywhere around and this opens a new world of possibilities. IMO they will never replace rdbms in database centric apps like erp or crm systems but they will help where rdbms are not performing that well. So in the future we will have more mixed-storage applications which will use the correct storage for the needed feature.
Previous Topic
