Create own CA and CA signed certificates

      No Comments on Create own CA and CA signed certificates

To provide your own SSL extensions create one extension file containing below details x509.ext file: [ ca ] # X509 extensions for a ca keyUsage                = critical, cRLSign, keyCertSign basicConstraints        = CA:TRUE, pathlen:0 subjectKeyIdentifier    = hash authorityKeyIdentifier  = keyid:always,issuer:always… Read more »

Kafka MirrorMaker

      No Comments on Kafka MirrorMaker

The Mirror Maker consumer needs to be client compatible with the source cluster. The Mirror Maker producer needs to be client compatible with the destination cluster. General Considerations MirrorMaker does not provide a guarantee of having a similar offset as there can be multiple consumers and only one single producer…. Read more »

Apache Spark CheatSheet

      No Comments on Apache Spark CheatSheet

To get all spark configs from spark shell sc._conf.getAll() To give specific GC overhead memory –conf spark.yarn.executor.memoryOverhead=12288  To enable GC logging –conf “spark.driver.extraJavaOptions=-verbose:gc -XX:+PrintGCDetails” –conf “spark.executor.extraJavaOptions=-verbose:gc -XX:+PrintGCDetails”