In previous article we have seen, how to write a "Kafka producer in java". In this article we will see how to write a kafka consumer in java with automatic offset committing to get data from
In previous article we have seen, how to write a "Kafka producer in java". In this article we will see how to write a
kafka consumer in java with manual offset committing to get data
from kafka cluster.
Apache Spark Multi-Node cluster can be setup using cluster managers like Hadoop YARN, Apache Mesos or
Standalone spark cluster manager. In this article we will see how to setup Apache Spark cluster on ubuntu
machines using Simple standalone spark cluster manager.
In this article we will see "How to create Spark Java Application and Submit it to Spark Cluster" and submit it to spark cluster to be executed. We will create a maven Java application with Spark Java API.
Apache Redis is an open source in memory cache store, used as a database cache and message broker.
Redis is rich in data structures like strings, hashes, lists, sets, sorted sets with range queries, bitmaps, hyperlog logs and geospatial indexes with radius queries.
Apart from that Redis provides built-in replication, Lua scripting, LRU eviction, transactions and different levels of on-disk persistence, and provides high availability via Redis
Sentinel and automatic partitioning with Redis Cluster.
Redis cluster provides automatic sharding or data replication on multiple nodes and some degree of fault tolerance, some degree means when majority of nodes are up and running cluster tends to work.
Redis cluster uses two ports client port i.e. 7000 and one internal communication port that is always (the client port + 10000) and fixed, so make sure there two ports are always open and do the needful in server security and firewall if needed.
In this article, we will see, how one can save memory on Redis while storing data in form of byte buffer. The Java application will get and set key-values on redis using byte arrays, while converting byte array to/from byte buffer.
Apache Cassandra is a top level open source project from Apache Software Foundation. It was developed by Facebook for in-box search,in July 2008 facebook made it open-source. Apcahe included it in Incubator in March 2009 and later in Feb 2010 made it one of its top level project.
Cassandra Architecture is purely basic on one point that Hardware and Software Failures can happened and do happen and hence some mechanism should be implemented to deal with these scenarios without affecting the output.
Gossip is a peer-to-peer communication protocol that helps all the nodes to communicate and exchange state information of them and other another nodes they know about. This communication keeps on running every second and passed state inflammation to up to three nodes in the cluster. This process of exchanging state data of their own and other nodes they know about keeps all the nodes up to date.
Apache Cassandra is one the most popular No Sql database to manage large amount of structured, semi structures and un structured data across multiple data centers and the cloud. Cassandra is a write friendly nosql database to provide linear scalability, continuous availability and implementable simplicity across many commodity servers with no single point of failure.
In previous article we came across how to install and run a single node Cassandra cluster in Ubuntu. In this article we will come across how to setup a multi-node cluster on Ubuntu.
We will try to create a cluster using 5 different machines to make a ring of 5 nodes.
In Cassandra a keyspace can be considered as a scheme in Relational Database. Keyspaces are basically the containers for application data; they holds a group of similar column-families(tables in rdbms) all together. Generally a cluster has one keyspace per application and all the application data goes in it.
In Cassandra a table is known as column-family, column-families consists of rows and columns as in any relational Database. Cassandra tables can have a single or compound primary key, in this article we will see how to create a table in Cassandra with single primary key and compound primary key.
Till now, we have seen how to create a Cassandra keyspace, how to show all the tables of a keyspace, how to create a new table in keyspace and how to show structure of tables in a keyspace.
In this particular article we will see, how to insert a record in Cassandra tables to store application table. We will use already created table ?student? to insert a few rows of data.