Job of the service:
- Prefer golang based for memory reasons. It was found that kafka client, consul agent, avro encoding/decoding libraries are present in golang.
- Get hold of node-exporter and cAdvisor instances and reach-ability information from Consul (COnsul FQDN is part of configMap)
- Poll each collectD instance periodically for configured metric families at configured interval.
- Convert collected metrics to Avro format (based on configured schema)
- Publish avro message on Kafka topic (on configured topic).
- Read configuration from Consul (whose FDQN is part of configMap)