feature: 🐳 - Allow to store Quickstart dockers data in a folder for persistance

[afranzi]

This PR aims to allow to modify the docker-compose file allowing us to specify a data folder for storing the data from MySQL, Elastic, Neo4j and Zookeeper.

It's adding two new components (kafka-rest-proxy & kafka-topics-ui) so it's easier to debug the kafka integration.

And modified the Broker host to use $HOSTNAME, so in case of deploying the quickstart solution in an EC2 instance, it's easier to access the broker from outside.

[mars-lan]

Are we ready to merge this in @keremsahin1?

[afranzi]

I will try to provide the quickstart.sh script that @keremsahin1 requested today.

[mars-lan]

Ping @afranzi? Would really love to get your awesome changes in.

[afranzi]

My fault, busy days.

[mars-lan]

Actually I start getting the following error in elasticsearch docker after this PR

elasticsearch           | [2020-04-02T13:53:43,546][WARN ][o.e.b.ElasticsearchUncaughtExceptionHandler] [] uncaught exception in thread [main]
elasticsearch           | org.elasticsearch.bootstrap.StartupException: java.lang.IllegalStateException: Failed to create node environment
elasticsearch           | 	at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:136) ~[elasticsearch-5.6.8.jar:5.6.8]
elasticsearch           | 	at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:123) ~[elasticsearch-5.6.8.jar:5.6.8]
elasticsearch           | 	at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:70) ~[elasticsearch-5.6.8.jar:5.6.8]
elasticsearch           | 	at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:134) ~[elasticsearch-5.6.8.jar:5.6.8]
elasticsearch           | 	at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-5.6.8.jar:5.6.8]
elasticsearch           | 	at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:91) ~[elasticsearch-5.6.8.jar:5.6.8]
elasticsearch           | 	at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:84) ~[elasticsearch-5.6.8.jar:5.6.8]
elasticsearch           | Caused by: java.lang.IllegalStateException: Failed to create node environment
elasticsearch           | 	at org.elasticsearch.node.Node.<init>(Node.java:268) ~[elasticsearch-5.6.8.jar:5.6.8]
elasticsearch           | 	at org.elasticsearch.node.Node.<init>(Node.java:245) ~[elasticsearch-5.6.8.jar:5.6.8]
elasticsearch           | 	at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:233) ~[elasticsearch-5.6.8.jar:5.6.8]
elasticsearch           | 	at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:233) ~[elasticsearch-5.6.8.jar:5.6.8]
elasticsearch           | 	at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:342) ~[elasticsearch-5.6.8.jar:5.6.8]
elasticsearch           | 	at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:132) ~[elasticsearch-5.6.8.jar:5.6.8]
elasticsearch           | 	... 6 more
elasticsearch           | Caused by: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/data/nodes
elasticsearch           | 	at sun.nio.fs.UnixException.translateToIOException(UnixException.java:84) ~[?:?]
elasticsearch           | 	at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) ~[?:?]
elasticsearch           | 	at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) ~[?:?]
elasticsearch           | 	at sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:384) ~[?:?]
elasticsearch           | 	at java.nio.file.Files.createDirectory(Files.java:674) ~[?:1.8.0_161]
elasticsearch           | 	at java.nio.file.Files.createAndCheckIsDirectory(Files.java:781) ~[?:1.8.0_161]
elasticsearch           | 	at java.nio.file.Files.createDirectories(Files.java:767) ~[?:1.8.0_161]
elasticsearch           | 	at org.elasticsearch.env.NodeEnvironment.<init>(NodeEnvironment.java:221) ~[elasticsearch-5.6.8.jar:5.6.8]
elasticsearch           | 	at org.elasticsearch.node.Node.<init>(Node.java:265) ~[elasticsearch-5.6.8.jar:5.6.8]
elasticsearch           | 	at org.elasticsearch.node.Node.<init>(Node.java:245) ~[elasticsearch-5.6.8.jar:5.6.8]
elasticsearch           | 	at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:233) ~[elasticsearch-5.6.8.jar:5.6.8]
elasticsearch           | 	at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:233) ~[elasticsearch-5.6.8.jar:5.6.8]
elasticsearch           | 	at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:342) ~[elasticsearch-5.6.8.jar:5.6.8]
elasticsearch           | 	at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:132) ~[elasticsearch-5.6.8.jar:5.6.8]
elasticsearch           | 	... 6 more

Seem likes the chown 1000:1000 ${DATA_STORAGE_FOLDER}/elasticsearch trick didn't resolve the permission issue. Did you test it on Linux or Mac, @afranzi ?

[afranzi]

I've tested on Linux

[mars-lan]

I see. I'm having this issue on Mac. Let me test it on Linux.

[mars-lan]

The Mac issue is fixed in #1621