Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Azure devops test #1169

Open
wants to merge 118 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
118 commits
Select commit Hold shift + click to select a range
e3ff16b
added ui config
rapkalya Feb 9, 2024
9631765
Merge branch 'azure-devops' of https://github.com/PublicisSapient/PSk…
rapkalya Feb 9, 2024
2f39658
Update customapi.yaml
sandhami Feb 20, 2024
a81a3f3
Create azure-keyvault.yaml
sandhami Feb 20, 2024
ff81343
Update customapi.yaml
sandhami Feb 20, 2024
6fbddf7
Update ingress.yaml
sandhami Feb 20, 2024
10882a3
env changes for all yml file
sandhami Feb 21, 2024
65e772b
changing inage name
sandhami Feb 21, 2024
335bea2
changing image azure-board-processor
sandhami Feb 21, 2024
fefc92d
removing space
sandhami Feb 21, 2024
38d4338
removing space
sandhami Feb 21, 2024
39cd354
adding LB
sandhami Feb 22, 2024
45daadc
changing knowhow ingress
sandhami Feb 22, 2024
be2c9eb
changing ingress file
sandhami Feb 23, 2024
de61920
changing ingress
sandhami Feb 23, 2024
e37d69c
adding ssl
sandhami Feb 23, 2024
a616320
adding commnet
sandhami Feb 23, 2024
ba4d152
adding new
sandhami Feb 23, 2024
c8716f7
adding notification value
sandhami Feb 27, 2024
15631c2
adding kafka
sandhami Feb 29, 2024
82ebabd
kafka yamls
sandhami Mar 1, 2024
7e6e4a2
changing secret configration
sandhami Mar 4, 2024
187cab6
changing customapi.yaml
sandhami Mar 4, 2024
d6c4dd5
adding debbie secret
sandhami Mar 4, 2024
e43db27
changing image
sandhami Mar 8, 2024
03ae2c1
adding env variables
sandhami Mar 11, 2024
4d7b2fe
adding new key
sandhami Mar 11, 2024
62df232
deleted files
sandhami Mar 13, 2024
7be8795
change uat to stage
sandhami Mar 15, 2024
7fda12f
file changes
sandhami Mar 15, 2024
c1f141e
id changed
sandhami Mar 15, 2024
c30ff05
adding new IG value
sandhami Mar 18, 2024
3fd54c3
chnaging uat to stage in config
sandhami Mar 18, 2024
b307017
changing replica from 3 to 1
sandhami Mar 18, 2024
8d0085b
chnaging configmap for kafka
sandhami Mar 18, 2024
9d84fe1
removed crs word
sandhami Mar 18, 2024
3cafe7b
adding o in kafka
sandhami Mar 18, 2024
eb95c3b
changing kafka-consumer
sandhami Mar 18, 2024
3a279f6
adding ingress file for prometheus
sandhami Mar 20, 2024
523ec48
create ingress for grafana
sandhami Mar 20, 2024
7203fef
url change
sandhami Mar 20, 2024
8fd8882
changing yaml for debbie
sandhami Mar 20, 2024
63ff5d4
commented 2 files
sandhami Mar 20, 2024
03f6aed
changing debbie knowhow
sandhami Mar 20, 2024
379c6fd
chnaging ui and api
sandhami Mar 20, 2024
0a0d543
files changes
sandhami Mar 20, 2024
c2a2be9
updating rebbitmq
sandhami Mar 21, 2024
5d71cc2
commenting redinessprobe
sandhami Mar 21, 2024
857ccba
chnanging configmap
sandhami Mar 21, 2024
55e4b2f
changing tag
sandhami Mar 22, 2024
6461330
changing version
sandhami Mar 22, 2024
994ce0d
Update values.yaml of knowhow debbie image name
rapkalya Mar 22, 2024
d8664a3
Update devops.yaml
rapkalya Mar 25, 2024
3d814d9
adding jira crons
sandhami Mar 27, 2024
171e3a3
Merge branch 'azure_devops_test' of https://github.com/PublicisSapien…
sandhami Mar 27, 2024
dc357d9
commented jira cron
sandhami Mar 27, 2024
42d910a
cron added
sandhami Mar 27, 2024
ce1e95c
adding cron for sonar
sandhami Mar 27, 2024
7fc8085
commenting jira
sandhami Mar 27, 2024
1eb2e42
removing cron sonar
sandhami Mar 27, 2024
991ed65
adding crons for all
sandhami Apr 1, 2024
01968f7
adding commect zira
sandhami Apr 1, 2024
bf207a9
apply all changes
sandhami Apr 3, 2024
eeeb774
cron version change
sandhami Apr 3, 2024
3047755
volume-mount change
sandhami Apr 3, 2024
b6d2451
volume uldated
sandhami Apr 3, 2024
aa8338a
jenkins cron change
sandhami Apr 3, 2024
6c1d048
cron changes
sandhami Apr 3, 2024
6f2733c
changing all helm files
sandhami Apr 4, 2024
03c8b93
jenkins cron change
sandhami Apr 4, 2024
cf7229b
jenkinsfile for deploy
sandhami Apr 4, 2024
3cbe66d
conflicts resolved from common master
Apr 4, 2024
6c0ae83
files changes for prod
sandhami Apr 12, 2024
d27823d
Merge branch 'azure_devops_test' of https://github.com/PublicisSapien…
sandhami Apr 12, 2024
8de1f8e
changing stage to prod
sandhami Apr 12, 2024
dc79221
final chnages
Apr 23, 2024
20fd5f9
Update configmap.yaml
rapkalya Apr 26, 2024
e75b327
Update configmap.yaml
rapkalya Apr 26, 2024
33de2c8
chnaging manifest files
Apr 30, 2024
93a6915
adding env
May 1, 2024
3ac3493
changing notification variable
May 7, 2024
b20c175
changing configmap file for both
May 10, 2024
daabac1
changing configmap
May 13, 2024
c184615
deployed with tag 9.1.0
May 13, 2024
a507481
9.1.0 tag change
May 15, 2024
6526eb6
changing files
May 23, 2024
96d37f1
changing tag version
Jun 6, 2024
7f89699
adding promtail config
Jun 12, 2024
317d3de
adding promtail in api
sandhami Jun 12, 2024
2f26725
adding promtail in every service1
sandhami Jun 12, 2024
a765c35
adding promtail in every service2
sandhami Jun 12, 2024
9a3f964
adding promtail in every service3
sandhami Jun 13, 2024
39752a7
adding promtail in every service4
sandhami Jun 13, 2024
beb018d
adding promtail in every service5
sandhami Jun 13, 2024
0791c45
adding promtail in every service6
sandhami Jun 13, 2024
6bce276
reverting api and jira
sandhami Jun 14, 2024
9c55062
changing request limit for devops
sandhami Jun 14, 2024
1b08911
changing request for menifest
Jun 14, 2024
ad2d27d
chnaging request and limit1
sandhami Jun 18, 2024
4494317
chnaging request and limit2
sandhami Jun 18, 2024
7da9a32
chnaging promtail configmap
sandhami Jun 18, 2024
8362509
changing zira and devops
sandhami Jun 18, 2024
d5e1d1e
changing zira and devop1
sandhami Jun 18, 2024
6a0ffad
increasing rediness
sandhami Jun 18, 2024
77d5d1a
increasing rediness1
sandhami Jun 18, 2024
e8a848d
increasing rediness2
sandhami Jun 18, 2024
cf749c1
increasing rediness3
sandhami Jun 18, 2024
3403cf9
increasing rediness4
sandhami Jun 18, 2024
d79e4a4
changing tagversion to 9.3.0
sandhami Jun 18, 2024
f9f69f9
changing for notification
Jun 19, 2024
acde2c3
adding resources limit
sandhami Jun 19, 2024
1dc3cf0
chnaging image tag version
sandhami Jun 24, 2024
1acc1ff
changing initial delay in devops
sandhami Jun 24, 2024
dbfc941
adding redinessprob
sandhami Jun 24, 2024
7fe51de
cpu limit increased for api
sandhami Jun 26, 2024
cbf062f
commenting resource limit for customapi
sandhami Jun 27, 2024
cfbcbd9
9.3 t0 9.4
rapkalya Jul 3, 2024
ec58645
adding prop
rapkalya Jul 3, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
128 changes: 128 additions & 0 deletions Kubernetes-prod/Kubernetes-manifest/azure-board.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,128 @@
apiVersion: apps/v1
kind: Deployment
metadata:
name: azure-board-processor
namespace: prod-knowhow
labels:
app: azure-board-processor
spec:
replicas: 1
selector:
matchLabels:
app: azure-board-processor
template:
metadata:
labels:
app: azure-board-processor
spec:
# initContainers:
# # - name: init-mongodb
# # image: busybox:1.28
# # command: ['sh', '-c', "until nslookup mongodb.$(cat /var/run/secrets/kubernetes.io/serviceaccount/namespace).svc.cluster.local; do echo waiting for mongodb; sleep 2; done"]
# - name: init-customapi
# image: busybox:1.28
# command: ['sh', '-c', "until nslookup customapi.$(cat /var/run/secrets/kubernetes.io/serviceaccount/namespace).svc.cluster.local; do echo waiting for customapi; sleep 2; done"]
containers:
- name: azure-board-processor
image: speedtools.azurecr.io/knowhow-azure-board-processor:9.4.0
imagePullPolicy: Always
env:
- name: spring.data.mongodb.uri
valueFrom:
secretKeyRef:
name: prod-knhdbconnectionstring
key: prod-knhdbconnectionstring
- name: spring.data.mongodb.host
valueFrom:
secretKeyRef:
name: prod-knhdbhost
key: prod-knhdbhost

- name: aesEncryptionKey
valueFrom:
secretKeyRef:
name: knowhowaesencryptionkeynew
key: knowhowaesencryptionkeynew
- name: auth.secret
valueFrom:
secretKeyRef:
name: knowhow-auth-secret
key: knowhow-auth-secret
- name: spring.data.mongodb.username
valueFrom:
secretKeyRef:
name: prod-knhdbusername
key: prod-knhdbusername
- name: spring.data.mongodb.password
valueFrom:
secretKeyRef:
name: prod-knhdbpassword
key: prod-knhdbpassword
- name: mongock.migration-scan-package
value: com.publicissapient.kpidashboard.apis.mongock.installation
# Adding cron expressions
- name: azure.cron
value: "0 0 */12 * * *"
resources:
requests:
memory: "250Mi"
cpu: "0.2"
limits:
memory: "1Gi"
cpu: "0.5"
ports:
- containerPort: 50017
readinessProbe:
tcpSocket:
port: 50017
initialDelaySeconds: 40 # Wait for 40 seconds before starting probes
periodSeconds: 30 # Check every 30 seconds
livenessProbe:
tcpSocket:
port: 50017
initialDelaySeconds: 40
periodSeconds: 30
envFrom:
- configMapRef:
name: knowhow-config
volumeMounts:
- name: knowhow-secrets-store
mountPath: "/mnt/prod-secrets-store"
readOnly: true
- name: azure-board-processor-log-volume
mountPath: /app/logs
- name: promtail
image: grafana/promtail:2.9.2
args:
- -config.file=/etc/promtail/config/promtail.yaml
volumeMounts:
- name: azure-board-processor-log-volume
mountPath: /app/logs
- name: promtail-config
mountPath: /etc/promtail/config
volumes:
- name: knowhow-secrets-store
csi:
driver: secrets-store.csi.k8s.io
readOnly: true
volumeAttributes:
secretProviderClass: "prod-secretproviderclass"
- name: azure-board-processor-log-volume
emptyDir: {}
- name: promtail-config
configMap:
name: promtail-config

---
apiVersion: v1
kind: Service
metadata:
name: azure-board-processor
namespace: prod-knowhow
spec:
selector:
app: azure-board-processor
ports:
- protocol: TCP
port: 50017
targetPort: 50017
197 changes: 197 additions & 0 deletions Kubernetes-prod/Kubernetes-manifest/azure-keyvault.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,197 @@
# This is a SecretProviderClass example using user-assigned identity to access your key vault. The secretObjects section is used to create Kubernetes secrets from the mounted Azure Key Vault secrets.
apiVersion: secrets-store.csi.x-k8s.io/v1
kind: SecretProviderClass
metadata:
name: prod-secretproviderclass
namespace: prod-knowhow
spec:
provider: azure
parameters:
usePodIdentity: "false"
useVMManagedIdentity: "true" # Set to true for using managed identity
userAssignedIdentityID: "98718c79-7f75-4fcf-8dbd-1b919dd63ca4" # Set the clientID of the user-assigned managed identity to use, from the previous step
keyvaultName: mpgsseunspdkv01 # Set to the name of your key vault
objects: |
array:
- |
objectName: prod-knhdbusername
objectType: secret
objectVersion: ""
- |
objectName: prod-knhdbpassword
objectType: secret
objectVersion: ""
- |
objectName: prod-knhdbhost
objectType: secret
objectVersion: ""
- |
objectName: prod-knhdbconnectionstring
objectType: secret
objectVersion: ""
- |
objectName: prod-test-knhdbconnectionstring
objectType: secret
objectVersion: ""
- |
objectName: prod-rabbitpass
objectType: secret
objectVersion: ""
- |
objectName: prod-debbieuser
objectType: secret
objectVersion: ""
- |
objectName: prod-debbiepassword
objectType: secret
objectVersion: ""
- |
objectName: prod-repo-tool-api-key
objectType: secret
objectVersion: ""
- |
objectName: prod-debbie-secret-key
objectType: secret
objectVersion: ""
- |
objectName: prod-debbie-internal-key
objectType: secret
objectVersion: ""
- |
objectName: prod-debbie-db-url
objectType: secret
objectVersion: ""
- |
objectName: tenginequerypass
objectType: secret
objectVersion: ""
- |
objectName: knowhowaesencryptionkeynew
objectType: secret
objectVersion: ""
- |
objectName: knowhow-auth-secret
objectType: secret
objectVersion: ""
- |
objectName: debbietengineauthtoken
objectType: secret
objectVersion: ""
- |
objectName: debbiemailhostpass
objectType: secret
objectVersion: ""
- |
objectName: exposed-api-key
objectType: secret
objectVersion: ""
- |
objectName: auth-resourceapikeys
objectType: secret
objectVersion: ""
- |
objectName: scan-status-apis-token-debbie
objectType: secret
objectVersion: ""
tenantId: "d52c9ea1-7c21-47b1-82a3-33a74b1f74b8" # The tenant ID of the key vault
secretObjects: #https://secrets-store-csi-driver.sigs.k8s.io/topics/sync-as-kubernetes-secret
- secretName: prod-knhdbusername
type: Opaque
data:
- objectName: prod-knhdbusername # This refers to the name of the secret as it is stored in Azure Key Vault
key: prod-knhdbusername # This is the key name under which the value of the Azure Key Vault secret will be stored in the Kubernetes secret. The key names (clientId and clientToken) must match (case sensitivity) exactly what the wiz Helm chart is expecting.
- secretName: prod-knhdbpassword
type: Opaque
data:
- objectName: prod-knhdbpassword
key: prod-knhdbpassword
- secretName: prod-knhdbhost
type: Opaque
data:
- objectName: prod-knhdbhost
key: prod-knhdbhost
- secretName: prod-knhdbconnectionstring
type: Opaque
data:
- objectName: prod-knhdbconnectionstring # This refers to the name of the secret as it is stored in Azure Key Vault
key: prod-knhdbconnectionstring # This is the key name under which the value of the Azure Key Vault secret will be stored in the Kubernetes secret. The key names (clientId and clientToken) must match (case sensitivity) exactly what the wiz Helm chart is expecting.
- secretName: prod-test-knhdbconnectionstring
type: Opaque
data:
- objectName: prod-test-knhdbconnectionstring # This refers to the name of the secret as it is stored in Azure Key Vault
key: prod-test-knhdbconnectionstring
- secretName: prod-rabbitpass
type: Opaque
data:
- objectName: prod-rabbitpass
key: prod-rabbitpass
- secretName: prod-debbieuser
type: Opaque
data:
- objectName: prod-debbieuser
key: prod-debbieuser
- secretName: prod-debbiepassword
type: Opaque
data:
- objectName: prod-debbiepassword # This refers to the name of the secret as it is stored in Azure Key Vault
key: prod-debbiepassword # This is the key name under which the value of the Azure Key Vault secret will be stored in the Kubernetes secret. The key names (clientId and clientToken) must match (case sensitivity) exactly what the wiz Helm chart is expecting.
- secretName: prod-repo-tool-api-key
type: Opaque
data:
- objectName: prod-repo-tool-api-key
key: prod-repo-tool-api-key
- secretName: prod-debbie-secret-key
type: Opaque
data:
- objectName: prod-debbie-secret-key # This refers to the name of the secret as it is stored in Azure Key Vault
key: prod-debbie-secret-key # This is the key name under which the value of the Azure Key Vault secret will be stored in the Kubernetes secret. The key names (clientId and clientToken) must match (case sensitivity) exactly what the wiz Helm chart is expecting.
- secretName: prod-debbie-internal-key
type: Opaque
data:
- objectName: prod-debbie-internal-key
key: prod-debbie-internal-key
- secretName: prod-debbie-db-url
type: Opaque
data:
- objectName: prod-debbie-db-url
key: prod-debbie-db-url
- secretName: tenginequerypass
type: Opaque
data:
- objectName: tenginequerypass
key: tenginequerypass
- secretName: knowhowaesencryptionkeynew
type: Opaque
data:
- objectName: knowhowaesencryptionkeynew # This refers to the name of the secret as it is stored in Azure Key Vault
key: knowhowaesencryptionkeynew # This is the key name under which the value of the Azure Key Vault secret will be stored in the Kubernetes secret. The key names (clientId and clientToken) must match (case sensitivity) exactly what the wiz Helm chart is expecting.
- secretName: knowhow-auth-secret
type: Opaque
data:
- objectName: knowhow-auth-secret
key: knowhow-auth-secret
- secretName: debbietengineauthtoken
type: Opaque
data:
- objectName: debbietengineauthtoken
key: debbietengineauthtoken
- secretName: debbiemailhostpass
type: Opaque
data:
- objectName: debbiemailhostpass
key: debbiemailhostpass
- secretName: exposed-api-key
type: Opaque
data:
- objectName: exposed-api-key
key: exposed-api-key
- secretName: auth-resourceapikeys
type: Opaque
data:
- objectName: auth-resourceapikeys
key: auth-resourceapikeys
- secretName: scan-status-apis-token-debbie
type: Opaque
data:
- objectName: scan-status-apis-token-debbie
key: scan-status-apis-token-debbie
Loading
Loading