In previous article we have seen, how to write a "Kafka producer in java". In this article we will see how to write a kafka consumer in java with automatic offset committing to get data from
In previous article we have seen, how to write a "Kafka producer in java". In this article we will see how to write a
kafka consumer in java with manual offset committing to get data
from kafka cluster.
Apache Spark Multi-Node cluster can be setup using cluster managers like Hadoop YARN, Apache Mesos or
Standalone spark cluster manager. In this article we will see how to setup Apache Spark cluster on ubuntu
machines using Simple standalone spark cluster manager.
In this article we will see "How to create Spark Java Application and Submit it to Spark Cluster" and submit it to spark cluster to be executed. We will create a maven Java application with Spark Java API.
Apache Redis is an open source in memory cache store, used as a database cache and message broker.
Redis is rich in data structures like strings, hashes, lists, sets, sorted sets with range queries, bitmaps, hyperlog logs and geospatial indexes with radius queries.
Apart from that Redis provides built-in replication, Lua scripting, LRU eviction, transactions and different levels of on-disk persistence, and provides high availability via Redis
Sentinel and automatic partitioning with Redis Cluster.
Redis cluster provides automatic sharding or data replication on multiple nodes and some degree of fault tolerance, some degree means when majority of nodes are up and running cluster tends to work.
Redis cluster uses two ports client port i.e. 7000 and one internal communication port that is always (the client port + 10000) and fixed, so make sure there two ports are always open and do the needful in server security and firewall if needed.
In this article, we will see, how one can save memory on Redis while storing data in form of byte buffer. The Java application will get and set key-values on redis using byte arrays, while converting byte array to/from byte buffer.