Cluster Expected Volume Benchmark hardware Project Hardware requirements Cores RAM # nodes Disk Source 6 Million records / month ~ 3 records per second HDFS 6 million/month 1 namenode, 20 datanodes, 2 CPU/node, 64GB RAM/node 1 6G 1 : Master 3: Slaves 120% of 6G =7.2GB/month Kafka 4 topics 6 million/month per topic 1 nodes […]
With the help of Big data, Small Businesses can gain the competitive edge they require to stay ahead of the curve. For beginners, Big data includes large data sets of information that can reveal insights about your customers to help you make valuable business decisions. Data can help you to compose an overall strategy for […]
Data Scientists are known for having a knack for statistics, data analysis, etc. to understand and obtain insights from a given dataset, usually quite enormous in quantity. If you don’t think you have this skill set, but the career appeals to you, you can always take a course like a springboard data science which will […]
1- Download Docker for windows. 2- Install Docker for windows.exe 3- Check whether docker is running 4- View/update docker settings 5- Now Lets start using docker…. – docker #displays docker help – docker version #check docker version – docker images #check all images – docker ps #check current running containers – docker ps -a #check […]
This is a brief guide on a Multi Node Kafka Cluster Setup using Windows Docker: —————————————– Setting Up a Three Node Kafka Cluster —————————————– 1- Start ZooKeeper and Kafka using Docker Compose up command docker-compose up 2- In another terminal window, go to the same directory (kafka-cluster). Before we move on, let’s make sure the services […]
Introducing K2 as a Process Automation Platform HR consists of a wide variety of processes with integrated levels of checks & verifications across departments. K2 helps automate these HR processes through workflows that can increase process visibility, eliminate redundant operations and reduce repetitive, manual labor errors. K2’s HR management software solutions enable developers to solve […]
Logic app is a codeless integration service for communication between multiple platforms and services. It has an extensive set of connectors for communication purposes. In this article, we are just going to discuss two of them, Dropbox and SMTP connectors. Logic apps can perform various actions on Dropbox-like, get all lists of files, copying files […]
In BizTalk Server, SQL Adapter is the main component in order to communicate with the SQL Server. On the other hand, In Logic App we use the connector to communicate with the SQL server. In this tutorial, we will create a table in SQL Azure and perform read and write operations using the logic app. […]
Platform-as-a-Services in Azure We are going to discuss the Platform-as-a-Services offering from Microsoft Azure. The platform, as a service part of the Microsoft cloud, offers a lot of services that you can use to build applications. Using Microsoft azure you can target any platform with any technology. You can host any application like .net, node.js […]
