본문 바로가기

Kubeflow22

Running the MNIST using distributed training 2021.5.28 1. Running the MNIST on-prem Jupyter notebook - The MNIST on-prem notebook builds a Docker image, launches a TFJob to train a model, and creates an InferenceService (KFServing) to deploy the trained model. - https://v1-2-branch.kubeflow.org/docs/started/workstation/minikube-linux/#running-the-mnist-on-prem-jupyter-notebook a. Prerequisites - Step 1: Set up Python environment in MacOS y.. 2021. 9. 24.
Kubeflow Jupyter Custom Image 추가 2021.06.29 1. 개요 - kubeflow Notebook Server 생성을 위하여 Custom Image를 추가 - References https://www.kangwoo.kr/tag/jupyter/ https://github.com/kubeflow/kubeflow/tree/v1.2.0/components/tensorflow-notebook-image https://towardsdatascience.com/make-kubeflow-into-your-own-data-science-workspace-cc8162969e29 - Custom Image spec ✓ Base image: tensorflow/tensorflow:2.5.0-gpu-jupyter (cuda 11.2, cuDNN 8.1.0),.. 2021. 9. 24.
Kubeflow 1.2 in On-prem 구성 2021.05.03 1. 환경 - Kubeflow 1.2.0 - Kubernetes 1.16.15 - CentOS Linux release 7.8 - Dex (https://github.com/dexidp/dex) Dex is an identity service that uses OpenID Connect to drive authentication for other apps. - Kubernetes compatibility 2. Kubeflow Install - https://v1-2-branch.kubeflow.org/docs/started/k8s/kfctl-istio-dex/ a. Notes on the configuration file - Istio configuration for trustwort.. 2021. 9. 24.
Kubeflow 1.2 in Minikube 구성 2021.04.27 1. 개요 - Minikube 기반 하에 kubeflow 구성 - https://v1-2-branch.kubeflow.org/docs/started/workstation/minikube-linux/ 문서에서 설명한 옵션을 사용할 경우 Kubeflow dashboard 접근시 오류 발생 (service-account-signing-key-file 값, Troubleshooting 참조) 2. Envrionments - minikube 1.17.1 - kubernetes 1.16.15 - kubeflow 1.2 - macOS 11.2 3. Install Kubeflow a. Prerequisites - Recommended resources 8 cores, 16GB RAM, 250GB s.. 2021. 9. 24.
Kubeflow 1.0 in On-prem 구성 2020.06.08 1. 환경 - Kubeflow 1.0.2 - K8s Server Version: v1.15.12 - CentOS Linux release 7.8 - Dex (https://github.com/dexidp/dex) Dex is an identity service that uses OpenID Connect to drive authentication for other apps. 2. Kubeflow Install - https://www.kubeflow.org/docs/started/k8s/kfctl-istio-dex/ a. Notes on the configuration file a-1. Disabling istio installation If your Kubernetes cluster.. 2021. 9. 24.
Kubeflow 1.0 using MiniKF 구성 (Windows 10) 2020.02.13 1. What is MiniKF ? - A fast and easy way to deploy Kubeflow on your laptop. - MiniKF = MiniKube + Kubeflow + Arrikto’s Rok Data Management Platform https://www.kubeflow.org/docs/other-guides/virtual-dev/getting-started-minikf/ https://www.arrikto.com/minikf/ https://www.cncf.io/wp-content/uploads/2019/10/Arrikto-Webinar-Scalable-ML-Workflows-with-Advanced-Data-Management-on-Kubeflow... 2021. 9. 24.
Kubeflow 1.0 in GCE 구성 2020.02.20 1. 개요 - 본 문서에서는 GCP(Google Cloud Platform)에서 Kubernetes 기반의 End 2 End ML Platform인 Kubeflow를 구성하는 절차를 설명하고자 함 - Ref. Page: https://www.kubeflow.org/docs/gke/deploy/deploy-cli/ 2. What is Kubeflow ? - Kubeflow is the ML toolkit for Kubernetes. The following diagram shows Kubeflow as a platform for arranging the components of your ML system on top of Kubernetes. - https://www.kubeflow.o.. 2021. 9. 24.