Bigdata and NoSql Tutorials

Zookeeper is a centralized open-source server for maintaining and managing configuration information, naming conventions and synchronization for distributed cluster environment.

In this particular article we will see how to download and install Zookeeper on Ubuntu. We will install Zookeepr on single node, here are steps you need to follow to start ...

In this article we will create a Apache Zookeeper cluster on three machines, we have three Ubuntu machines with 1 GB ram.

Apache Kafka Multi Broker cluster setup on Ubuntu, In this article we will create a Apache Kafka multi broker cluster on three machines, we have three ubuntu machine with 4GB ram.

In previous articles we have seen, how to setup "Multi-Broker Apache Kafka Cluster" and "Zookeeper". In this article we will see how to write a kafka producer in java to write data on kafka cluster.

In previous article we have seen, how to write a "Kafka producer in java". In this article we will see how to write a kafka consumer in java with automatic offset committing to get data from kafka cluster.

In previous article we have seen, how to write a "Kafka producer in java". In this article we will see how to write a kafka consumer in java with manual offset committing to get data from kafka cluster.

In previous article we have seen, how to write a "Kafka producer in java". In this article we will see how to write a kafka consumer in java that can be assigned manually to a specific partition.

Apache Spark is a fast and general-purpose cluster computing system, it provides high-level APIs in Java, Scala, Python and R.

Install Apache Spark on Ubuntu - In this article we will see how to setup Apache Spark on ubuntu machines building from source code.

Apache Spark Multi-Node cluster can be setup using cluster managers like Hadoop YARN, Apache Mesos or Standalone spark cluster manager. In this article we will see how to setup Apache Spark cluster on ubuntu machines using Simple standalone spark cluster manager.

In this article we will see "How to create Spark Java Application and Submit it to Spark Cluster" and submit it to spark cluster to be executed. We will create a maven Java application with Spark Java API.

In this article we will see, how to join two datasets in spark with Java API, different type of joins available in Spark java programming and difference between them with sample java code.

Apache Redis is an open source in memory cache store, used as a database cache and message broker. Redis is rich in data structures like strings, hashes, lists, sets, sorted sets with range queries, bitmaps, hyperlog logs and geospatial indexes with radius queries. Apart from that Redis provides built-in replication, Lua scripting, LRU eviction, transactions and different levels of on-disk persistence, and provides high availability via Redis Sentinel and automatic partitioning with Redis Cluster.

Redis cluster provides automatic sharding or data replication on multiple nodes and some degree of fault tolerance, some degree means when majority of nodes are up and running cluster tends to work.

Redis cluster uses two ports client port i.e. 7000 and one internal communication port that is always (the client port + 10000) and fixed, so make sure there two ports are always open and do the needful in server security and firewall if needed.

In order to maintain fault tolerance, we must have to adopt master and slave model meaning that a master node should have 1 to N complete replicas; more replicas more fault tolerance.

In previous articles we have already seen, how to setup Redis Standalone Server in Ubuntu. In this particular article we will setup Spring Data with Standalone Redis Using Jedis Client.

In this article, we will see, how one can save memory on Redis while storing data in form of byte buffer. The Java application will get and set key-values on redis using byte arrays, while converting byte array to/from byte buffer.