Uploaded image for project: 'ONAP Architecture Committee'
  1. ONAP Architecture Committee
  2. ONAPARC-392

Kafka Broker via Helm Charts and Operators

    XMLWordPrintable

    Details

      Description

      Ensure that the helm charts created can be used to deploy Kafka broker and associated zookeeper multiple times.  Some times, in the same K8S cluster, but via different namespace.

      Use operators to create topics and users dynamically.

      Even operator is used to deploy Kafka and zookeeper, helm charts are expected to be created even if CRDs are used.

      Parameterization should be flexible enough to deploy kafka multiple times.

      Following activities are identified as part of this:

      • PoC Setup
      • Convert to Helm charts
        • Instead of using yaml files in examples, use helm charts - Convert examples yaml files to Helm charts.
        • Ensure that parameterization happens well.
        • Test again producer and consumer examples.
      • Deploy it using K8S plugin of ONAP.
        • Ensure that multiple instances can be created in various cloud regions.
        • Ensure that multiple instances can  be created in different namespaces of a cloud-region.
        • Ensure that multiple instances work using producer and consumer clients.
        • Also, ensure that things work even if producer and consumers are in a namespace that is different from kafka broker namespace.
        • Also, ensure that things work even producer and consumer are in different namespaces.
      • Create various configuration profiles for various scenarios. Scenario include sites  that only can use no replica. Sites with various replicas, Sites with kafka-connect etc...
      • Test above using SDC and SO when K8S plugin is integrated with SDC & SO.
      • Avoid multiple zookeeper daemon
        • Since HDFS/HBASE also use zookeeper, ensure that only one zookeeper is present.
      • Integrate with Prometheus collection and HDFS/HBASE/OpenTSDB/Spark (all in a single set of helm charts).
      • Test with a sample application to ensure that all component work together.

       

        Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

            Assignee:
            dileep.ranganathan Dileep Ranganathan
            Reporter:
            saddepalli Srinivasa Addepalli
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: