kubernetes55 Kubeflow 1.0 in On-prem 구성 2020.06.08 1. 환경 - Kubeflow 1.0.2 - K8s Server Version: v1.15.12 - CentOS Linux release 7.8 - Dex (https://github.com/dexidp/dex) Dex is an identity service that uses OpenID Connect to drive authentication for other apps. 2. Kubeflow Install - https://www.kubeflow.org/docs/started/k8s/kfctl-istio-dex/ a. Notes on the configuration file a-1. Disabling istio installation If your Kubernetes cluster.. 2021. 9. 24. Kubeflow 1.0 using MiniKF 구성 (Windows 10) 2020.02.13 1. What is MiniKF ? - A fast and easy way to deploy Kubeflow on your laptop. - MiniKF = MiniKube + Kubeflow + Arrikto’s Rok Data Management Platform https://www.kubeflow.org/docs/other-guides/virtual-dev/getting-started-minikf/ https://www.arrikto.com/minikf/ https://www.cncf.io/wp-content/uploads/2019/10/Arrikto-Webinar-Scalable-ML-Workflows-with-Advanced-Data-Management-on-Kubeflow... 2021. 9. 24. Kubeflow 1.0 in GCE 구성 2020.02.20 1. 개요 - 본 문서에서는 GCP(Google Cloud Platform)에서 Kubernetes 기반의 End 2 End ML Platform인 Kubeflow를 구성하는 절차를 설명하고자 함 - Ref. Page: https://www.kubeflow.org/docs/gke/deploy/deploy-cli/ 2. What is Kubeflow ? - Kubeflow is the ML toolkit for Kubernetes. The following diagram shows Kubeflow as a platform for arranging the components of your ML system on top of Kubernetes. - https://www.kubeflow.o.. 2021. 9. 24. Istio - Virtual service config 2020.04.27 1. 참고 사이트 - Istio Traffic management (https://bcho.tistory.com/1367) - https://istio.io/docs/ops/best-practices/traffic-management/ - https://istio.io/docs/ops/best-practices/traffic-management/#split-virtual-services 2. 등록 고려 대상 - 대상 ✓ kubernetes-dashboard ✓ weave scope ✓ istio tool : kiali, jaeger, prometheus, grafana - 관련 서비스 $ k get svc grafana jaeger-query kiali prometheus -n ist.. 2021. 9. 23. Istio 1.5 구성 2020.04.24 1. 개요 - Environments: Google Compute Engine, CentOS 7.7, Kubernetes 1.15 - Istio 1.5 has been tested with these Kubernetes releases: 1.14, 1.15, 1.16. - The Helm installation approach will be deprecated in the future. - 참고 사이트 https://istio.io/docs/setup/getting-started/ https://istio.io/docs/setup/install/istioctl/ #1 - 마이크로 서비스와 서비스 매쉬 (https://bcho.tistory.com/1293?category=731548).. 2021. 9. 23. ClusterIP, NodePort, Ingress 개념 2020.04.10 1. ClusterIP - A ClusterIP service is the default Kubernetes service. It gives you a service inside your cluster that other apps inside your cluster can access. There is no external access. $ k proxy --port=8080 & [1] 893 ysjeon71_kubeflow2@cs-6000-devshell-vm-92bccb22-ff7a-491b-99a2-c333678d033d:~/exam-tfserving$ Starting to serve on 127.0.0.1:8080 The service’s proxy URL: http://kub.. 2021. 9. 23. Cert-manager with LetsEncrypt (DNS challenge) 2020.07.16 Cert-manager with LetsEncrypt (DNS challenge) Cert-manager with LetsEncrypt (HTTP challenge): https://1week.tistory.com/57 1. 개요 - cert-manager is a native Kubernetes certificate management controller. It can help with issuing certificates from a variety of sources, such as Let’s Encrypt, HashiCorp Vault, Venafi, a simple signing key pair, or self signed. - cert-manager can be used to.. 2021. 9. 23. Crobjob 2020.08.07 1. K8s CronJob https://kubernetes.io/ko/docs/concepts/workloads/controllers/cron-jobs/ 2. CrobJob Test $ cat cronjob.yaml apiVersion: batch/v1beta1 kind: CronJob metadata: name: hello namespace: yoosung-jeon spec: schedule: "*/1 * * * *" jobTemplate: spec: template: spec: containers: - name: hello image: busybox args: - /bin/sh - -c - date; echo Hello from the Kubernetes cluster resta.. 2021. 9. 23. Crunchy PostgreSQL Operator #2 2021.04.22, 2020.09.10 Crunchy PostgreSQL Operator #1 1. Crunchy PostgreSQL Operator 소개 2. PostgreSQL Operator Configuration 3. Create a PostgreSQL Cluster (Multi-Tenancy) 4. pgAdmin4 Crunchy PostgreSQL Operator #2 5. High-Availability 6. Disaster Recovery: Backups & Restores 7. Monitoring 8. pgBouncer 5. High-Availability - High-Availability: Scaling Up & Down https://access.crunchydata.com/doc.. 2021. 9. 23. RabbitMQ Cluster Operator 2021.01.20 1. 개요 - RabbitMQ ✓ RabbitMQ is an open-source message-broker software (sometimes called message-oriented middleware) that originally implemented the Advanced Message Queuing Protocol (AMQP) and has since been extended with a plug-in architecture to support Streaming Text Oriented Messaging Protocol (STOMP), MQ Telemetry Transport (MQTT), and other protocols. - Message queue pattens ht.. 2021. 9. 21. Helm 2020.09.04 1. Helm Helm is the Kubernetes package manager 2. Helm 3.3.1 구성하기 - https://helm.sh/docs/intro/install/ a. Install Helm $ curl -fsSL -o get_helm.sh https://raw.githubusercontent.com/helm/helm/v3.3.1/scripts/get-helm-3 $ chmod 744 get_helm.sh $ ./get_helm.sh Downloading https://get.helm.sh/helm-v3.3.1-darwin-amd64.tar.gz Preparing to install helm into /usr/local/bin Password: helm inst.. 2021. 9. 21. Giblab 2021.03.20 1. GitLab ? - GitLab is a web-based DevOps lifecycle tool that provides a Git-repository manager providing wiki, issue-tracking and continuous integration and deployment pipeline features. - GitLab license ✓ GitLab Community Edition (MIT License) vs GitLab Enterprise Edition (EE) license https://about.gitlab.com/install/ce-or-ee/ ✓ GitLab Community Edition is open source, with an MIT .. 2021. 9. 17. K8s - Slab memory leakage 2020.12.02 a. Problem: POD - cannot allocate memory - Environments Kubernetes 1.16.15, centos 7.8 / 7.9, Docker 19.03 / 20.10 - leakage 발생 centos 7.8 / 3.10.0-1127.el7.x86_64 / Docker 19.03 (iap10, iap11) centos 7.9 / 3.10.0-1160.15.2.el7.x86_64 / Dcoker 20.10.3 - leakage 미 발생 centos 7.8 / 3.10.0-1127.el7.x86_64 / Docker 18.06 (iap04 ~ iap09) [iap@iap01 ~]$ k describe pod rook-ceph-osd-prepare-i.. 2021. 9. 16. K8s - Node NotReady 2021.05.11 1. 개요 - Issue ✓ 특정 Node가 NotReady 상태가 되면, Node에 속한 POD는 Terminating 상태로 변경/유지되면서 self-healing이 진행되지 않음 ✓ 영향도 ▷ Deployments는 서비스가 가능 (단, replica 수 > 1 & Node 간 분산 배치) ▷ Statefulsets는 애플리케이션 마다 서비스 지속 여부가 다름 (ex. MariaDB 서비스 불가, Redis cluster는 서비스 가능) ✓ If an entire node goes down, Kubernetes generally isn’t able to spin a new one up ▷ AWS, GCP에서는 autoscaling groups 기능으로, Azure에서는 scale.. 2021. 9. 16. K8s - CNI not ready 2020.12.01 a. Problem: Worker node - 재기동 후 상태가 not ready임 (cni) - Environments Kubernetes 1.16.15 [iap@iap01 ~]$ k get nodes iap11 NAME STATUS ROLES AGE VERSION iap11 NotReady 60d v1.16.15 [iap@iap01 ~]$ k describe nodes iap11 | grep Conditions -A6 Conditions: Type Status LastHeartbeatTime LastTransitionTime Reason Message ---- ------ ----------------- ------------------ ------ ------- MemoryPre.. 2021. 9. 15. 이전 1 2 3 4 다음
