-
Notifications
You must be signed in to change notification settings - Fork 2
mattf/taiol
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
Get data - curl -L -O https://github.com/starksm64/RaspberryPiBeaconParser/raw/master/data/SevenScannersRun-2015-05-11.json.gz Massage data, need 1:1 event:line - gunzip -c SevenScannersRun-2015-05-11.json.gz | sed 's/}{/}\n{/' | awk '{ORS=""; print} /}/ {ORS="\n"; print ""}' > data.json Run - (only need to do this once) sudo docker build -t taiol docker-taiol (do this whenever you change the processing layer) sudo docker build -t demo2015 docker-demo2015 sudo docker run -t demo2015 <src address, e.g. amqp://1.2.3.4/name> <dest address, e.g. amqp://1.2.3.4/name_processed> Other - Stage data: sudo docker run --privileged -w /mnt -v $PWD:/mnt -it taiol ./play.py data.json amqp://1.2.3.4/name Fordwarder: sudo docker run --privileged -p 1984:1984 -w /mnt -v $PWD:/mnt -it taiol ./docker-demo2015/forward.py amqp://1.2.3.4/name Archiver: ./archive amqp://1.2.3.4/name Processor: sudo docker run --privileged -w /mnt -v $PWD:/mnt -it taiol spark-submit docker-demo2015/stage0.py -a amqp://1.2.3.4/name -d data.json
About
No description, website, or topics provided.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published