Google Cloud Engine - Automatically Run Notebook Once a Month

Pretty easy - figure our how this function works to luanch a VM with a startup script. And have the outputs save to google cloud storage.

function execute_notebook_with_cpu() {

IMAGE_FAMILY="tf-latest-cpu" # Or use any required DLVM image.

ZONE="us-central1-b"

INSTANCE_NAME="notebook-executor3"

INSTANCE_TYPE="n1-standard-8"

INPUT_NOTEBOOK_PATH=$1

OUTPUT_NOTEBOOK_PATH=$2

STARTUP_SCRIPT="papermill ${INPUT_NOTEBOOK_PATH} ${OUTPUT_NOTEBOOK_PATH}"

# Create DLVM

gcloud compute instances create $INSTANCE_NAME \

--zone=$ZONE \

--image-family=$IMAGE_FAMILY \

--image-project=deeplearning-platform-release \

--machine-type=$INSTANCE_TYPE \

--boot-disk-size=100GB \

--scopes=[login to view URL] \

--metadata="startup-script=${STARTUP_SCRIPT}"

gcloud --quiet compute instances delete $INSTANCE_NAME --zone $ZONE

}

execute_notebook_with_cpu gs://quantamental-data/Fundamental/[login to view URL] gs://quantamental-data/Fundamental/[login to view URL]

구글 클라우드 스토리지 Google Cloud Platform Automation

프로젝트 ID: #29597420

프로젝트 소개