Demo Video: https://www.youtube.com/watch?v=EP59ny__mq4
Real time tweet monitoring system to identify toxic tweets and mapping them on Kibana Map accorind to randomized locations.
Specifications:
- Java 7
- Scala 2.11.12
- sbt 0.13.16
- storm 1.2.1
- Amazon Lambda
- Keras
- Amazon Web Services Running Sample Storm Project:
sbt clean compile assembly
java -jar target/scala-2.11/athena-assembly-0.1-SNAPSHOT.jar
Running TwitterLiveStream to take json dump
sbt 'project utils' clean assembly
On Spark Master execute the following command:
spark-submit --master <master-url> --class spark.TwitterLiveStream <jar-file> <output-location>
Output Location - Can be either an HDFS or S3 bucket path
Links: