Loading...

Type: Story
Resolution: Unresolved
Priority: Medium
Fix Version/s: Amsterdam Release
Affects Version/s: None
Component/s: None
Labels:
None

Epic Link:
Automated platform deployment on Docker/Kubernetes
Sprint:
OOM Sprint 2, OOM Sprint 3

20170824: would need to update review to helm-enable the code if in 1.1/master

20170817: update

git pull ssh://michaelobrien@gerrit.onap.org:29418/oom refs/changes/67/7867/1
git pull ssh://michaelobrien@gerrit.onap.org:29418/oom refs/changes/77/7877/1

   My first commit to ONAP (doors are opened now) – I just need to reverify the pods (today or/by 1500 tomorrow) using this code because I merged some changes from master in – on a separate machine (Also to verify I didn’t miss anything)
    These include the dcae.sh and nexus3 ref changes.
 
https://jira.onap.org/browse/OOM-5
https://gerrit.onap.org/r/#/c/7287/
 
Pending:
Add reviewers to gerrit review above (today/tomorrow)
Talk with Borislav by tomorrow over docker image registration for nexus3 (jenkins job) and involve other 4 devs
Retest pods to pull new images.

enables closed-loop behavior around DMaaP/APPC

20170719: 32 of 33 containers up - we can move to SDC provisioning and DCAE

2070725: uploaded dcae yaml zip - I am going to push (for review) this code that I was provided by the kubernetes team (would be my first commit) - after I'll push the image changes for nexus3

20170724: Using dcae.zip provided by mail from original seed code developer for dcae (would like to push entire code set)

11 containers and 2 drives

docker images need to be pushed to nexus (6 DockerFile entries)

# can be replaced by public dockerHub link
wurstmeister/zookeeper:latest
attos/dmaap:latest
dockerfiles_kafka:latest
# already dockerized
openecomp/dcae-dmaapbc:latest 
openecomp/dcae-collector-common-event:latest
# have DockerFile
onap/dcae/cdap:1.0.7
onap/dcae/pgaas:latest
# need DockerFile
openecomp/dcae-controller:latest
onap/dcae/dcae-ves-collector:release-1.0.0

from: registry.stratlab.local:30002/onap/dcae/cdap:1.0.7

to: nexus3.onap.org:10001/openecomp

going through all the yamls
# source: email from original seec code project developer
# manual deployment order is mentioned - but we need to specify dependencies in the service
KUBECTL_CMD="kubectl --namespace $1-$2 $3 -f ../$2"

printf "dcae....\n"


# manual deployment order is mentioned - but we need to specify dependencies in the service
$KUBECTL_CMD/message-router/dcae-zookeeper.yaml
$KUBECTL_CMD/message-router/dcae-kafka.yaml
$KUBECTL_CMD/message-router/dcae-dmaap.yaml

#pgass/setup.sh
$KUBECTL_CMD/pgaas/pgaas.yaml

$KUBECTL_CMD/dcae-collector-common-event.yaml
$KUBECTL_CMD/dcae-collector-dmaapbc.yaml
$KUBECTL_CMD/dcae-collector-pvs.yaml
# not required (no secondary orchestration for DCAE)
#$KUBECTL_CMD/dcae-controller.yaml
#$KUBECTL_CMD/dcae-controller-pvs.yaml

#cdap/deploy-cdap-k8s.sh
$KUBECTL_CMD/cdap/cdap0-dep.yaml
$KUBECTL_CMD/cdap/cdap1-dep.yaml
$KUBECTL_CMD/cdap/cdap2-dep.yaml

The following is a preliminary dcae.sh to retrofit into the createAll.sh framework

root@obriensystemskub0:~/oom/kubernetes/oneclick# cat dcae.sh
#!/bin/bash
KUBECTL_CMD="kubectl --namespace $1-$2 $3 -f ../$2"

printf "DCAE....\n"
# source: email from original seec code project developer

# manual deployment order is mentioned - but we need to specify dependencies in the service
$KUBECTL_CMD/message-router/dcae-zookeeper.yaml
$KUBECTL_CMD/message-router/dcae-kafka.yaml
$KUBECTL_CMD/message-router/dcae-dmaap.yaml

#pgass/setup.sh
$KUBECTL_CMD/pgaas/pgaas.yaml

$KUBECTL_CMD/dcae-collector-common-event.yaml
$KUBECTL_CMD/dcae-collector-dmaapbc.yaml
$KUBECTL_CMD/dcae-collector-pvs.yaml
$KUBECTL_CMD/dcae-controller.yaml
$KUBECTL_CMD/dcae-controller-pvs.yaml
$KUBECTL_CMD/dcae-ves-collector.yaml

#cdap/deploy-cdap-k8s.sh
$KUBECTL_CMD/cdap/cdap0-dep.yaml
$KUBECTL_CMD/cdap/cdap1-dep.yaml
$KUBECTL_CMD/cdap/cdap2-dep.yaml

status

root@obriensystemskub0:~/oom/kubernetes/oneclick# ./createAll.bash -n onap -a dcae
********** Creating up ONAP: dcae
Creating namespaces **********
namespace "onap-dcae" created
secret "regsecret" created
serviceaccount "default" patched
Creating services **********
service "dcae-collector-common-event" created
service "dcae-collector-dmaapbc" created
service "dcae-ves-collector" created
********** Creating deployments for  dcae **********
DCAE....
deployment "zookeeper" created
deployment "kafka" created
deployment "dmaap" created
service "zldciad4vipstg00" created
deployment "dcae-pgaas" created
deployment "dcae-collector-common-event" created
deployment "dcae-collector-dmaapbc" created
persistentvolume "dcae-collector-common-event-config" created
persistentvolumeclaim "dcae-collector-common-event-config" created
persistentvolume "dcae-collector-dmaapbc-config" created
persistentvolumeclaim "dcae-collector-dmaapbc-config" created
persistentvolume "dcae-ves-collector-config" created
persistentvolumeclaim "dcae-ves-collector-config" created
service "dcae-controller" created
deployment "dcae-controller" created
persistentvolume "dcae-controller-config" created
persistentvolumeclaim "dcae-controller-config" created
error: the path "../dcae/dcae-dcae.yaml" does not exist
deployment "cdap0" created
deployment "cdap1" created
deployment "cdap2" created

rerun for ves
deployment "dcae-ves-collector" created

fixing (use nexus)
Failed to pull image "registry.stratlab.local:30001/onap/dcae/pgaas:latest": rpc error: code = 2 desc = Error response from daemon: {"message":"Get https://registry.stratlab.local:30001/v1/_ping: dial tcp: lookup registry.stratlab.local: no such host"} 
Error syncing pod, skipping: failed to "StartContainer" for "dcae-pgaas" with ErrImagePull: "rpc error: code = 2 desc = Error response from daemon: {\"message\":\"Get https://registry.stratlab.local:30001/v1/_ping: dial tcp: lookup registry.stratlab.local: no such host\"}"

2 persistent volumes also created (controller-pvs, collector-pvs)

root@obriensystemskub0:~/oom/kubernetes/oneclick# kubectl get pods --all-namespaces -o wide | grep dcae
onap-dcae             cdap0-801098998-1j83b                          0/1       Init:ImagePullBackOff   0          7m        10.42.170.56    obriensystemskub0
onap-dcae             cdap1-1109312935-sv8g0                         0/1       Init:ImagePullBackOff   0          7m        10.42.184.43    obriensystemskub0
onap-dcae             cdap2-2495595959-fxnmg                         0/1       Init:ImagePullBackOff   0          7m        10.42.69.133    obriensystemskub0
onap-dcae             dcae-collector-common-event-2687859322-jcv7n   1/1       Running                 0          7m        10.42.219.171   obriensystemskub0
onap-dcae             dcae-collector-dmaapbc-2087600858-sb98v        1/1       Running                 0          7m        10.42.225.93    obriensystemskub0
onap-dcae             dcae-controller-1960065296-95xxx               0/1       ContainerCreating       0          7m        <none>          obriensystemskub0
onap-dcae             dcae-pgaas-3690783998-v4w60                    0/1       ImagePullBackOff        0          7m        10.42.28.81     obriensystemskub0
onap-dcae             dcae-ves-collector-1184035059-t0t7s            0/1       ImagePullBackOff        0          7m        10.42.223.26    obriensystemskub0
onap-dcae             dmaap-3637563410-2s7b2                         0/1       CrashLoopBackOff        6          7m        10.42.7.93      obriensystemskub0
onap-dcae             kafka-2923495538-tb218                         0/1       CrashLoopBackOff        6          7m        10.42.49.109    obriensystemskub0
onap-dcae             zookeeper-2122426841-2n6h5                     1/1       Running                 0          7m        10.42.192.205   obriensystemskub0
root@obriensystemskub0:~/oom/kubernetes/oneclick# kubectl get services --all-namespaces -o wide | grep dcae
onap-dcae             dcae-collector-common-event   10.43.97.177    <nodes>       8080:30236/TCP,8443:30237/TCP,9999:30238/TCP                                 8m        app=dcae-collector-common-event
onap-dcae             dcae-collector-dmaapbc        10.43.100.153   <nodes>       8080:30239/TCP,8443:30240/TCP                                                8m        app=dcae-collector-dmaapbc
onap-dcae             dcae-controller               10.43.117.220   <nodes>       8000:30234/TCP,9998:30235/TCP                                                7m        app=dcae-controller
onap-dcae             dcae-ves-collector            10.43.215.194   <nodes>       8080:30241/TCP,9999:30242/TCP                                                8m        app=dcae-ves-collector
onap-dcae             zldciad4vipstg00              10.43.110.169   <nodes>       5432:30245/TCP                                                               8m        app=dcae-pgaas

- - Sort By Name
  - Sort By Date
  - Ascending
  - Descending
  - Thumbnails
  - List
  - Download All

20170630_dcae.zip
22 kB
25/Jul/17 3:02 PM
dcae_20170731_modified.tar.gz
42 kB
31/Jul/17 8:46 PM
dcae_verify_gerrit_branch_2nd_machine.zip
23 kB
11/Aug/17 12:56 AM
dcae.sh
0.6 kB
29/Aug/17 2:47 PM
dcae.tgz
13 kB
28/Aug/17 2:33 PM
OOM-5_20170809_dcae.patch
257 kB
09/Aug/17 2:46 PM

blocks

DCAEGEN2-85 DCAE Containerization for R1

Closed

LOG-28 Logging provider configuration - DCAE

Closed

OOM-162 DCAE Gen2 Version 1.1 Deployed in Kubernetes

Closed

OOM-242 Modify DCAE seed for Helm

Closed

is blocked by

OOM-3 Docker credentials secret missing from deployment yaml files - image download failing

Closed

DCAEGEN2-69 DCAE initialisation failure

Closed

OOM-62 Build DCAE gen1 1.0 docker images (cdap, ves, pgaas) and push to nexus3

Closed

OOM-238 20170828 release-1.0.0 branch does not accept reviews

Closed

DCAEGEN2-7 Sync-up DCAE with Vanilla Openstack environment

Closed

OOM-146 20170817: createAll option error bringing up module - non-blocking

Closed

relates to

OOM-110 OOM ONAP Logging - Elastic Stack components deployment

Closed

OOM-147 setenv.bash needs chmod 777 in repo

Closed

DCAEGEN2-33 R1 - DCAE Platform optimization and delivering seed code

Closed

CLI-14 ONAP Deployment support

Closed

OOM-107 DCAE Gen2 deployed in Kubernetes

Closed

OOM-176 DCAE Gen1 Version 1.1 Deployed in Kubernetes

Closed

links to

http://gerrit.onap.org/r/7833

https://gerrit.onap.org/r/#/c/7287/

https://lists.onap.org/pipermail/onap-discuss/2017-August/003965.html

mentioned in: Page Loading...

Wiki Page: Wiki Page Loading...

(5 is blocked by, 6 relates to, 3 links to, 1 mentioned in, 1 Wiki Page)

1.	DCAE K8S message-router deployments (3)	Closed	michaelobrien
2.	DCAE K8S pgaas deployment	Closed	michaelobrien
3.	DCAE K8S dcae-common-event deployments	Closed	michaelobrien
4.	DCAE K8S dcae-collector deployments (3)	Closed	michaelobrien
5.	DCAE K8S dcae-ves-collector deployment - missing	Closed	Unassigned
6.	DCAE K8S dcae-cdap cluster deployments (3)	Closed	michaelobrien
7.	DCAE Kafka failed container	Closed	michaelobrien
8.	Refresh DCAE config container files	Closed	obrienmi

Details

Description

Attachments

Attachments

Issue Links

Sub-Tasks

Activity

People

Dates

Time Tracking