BIG DATA HADOOP

Please find details about training /consulting requirement Kindly find theContents: Read Kafka data and put into HDFS using Scala and spark streaming  Read Mysql data and put into HDFS using spark and Scala streaming  Hadoop Production Resource Allocation  Druid  Oozie scheduler and The JAVA API/framework integration with the Hadoop cluster More details: Is it real time data processing or batch processing? There is no real-time data processing here. • Spark streaming Job -> which reads data from Kafka and loads into HDFS using Spark & Scala • Spark Batch Job -> which reads data from MySql and loads into HDFS using Spark & Scala • Oozie -> used for scheduling both the kind of jobs. 2. More detail on data ingestion part - After loading data into HDFS using the above jobs there is a Druid server which does indexing part. 3. Experience of Audience in BigData - None of the Audience as experience in BigData apart from couple of Team Members with Java programming background