Graphistry on Azure: Manual Environment Setup Instructions#
DEPRECATION WARNING:
Get started more quickly and securely with Graphistry in Azure Marketplace.
We no longer recommend manually installing drivers via the original Graphistry-maintained bootstrap scripts. Instead, we now recommend using Graphistry in Azure Marketplace which has been preconfigured, and for advanced manual enterprise users, to use the Nvidia GPU Container (Ubuntu) “Nvidia NGC” base image.
Deprecated instructions#
Graphistry runs on Azure. This document describes initial Azure virtual machine environment setup. From here, proceed to the general Graphistry installation instructions linked below.
The document assumes light familiarity with how to provision a standard CPU virtual machine in Azure.
Contents:
Prerequisites: Azure GPU Quota
Testing if you already have GPU Quota
Requesting Azure for GPU Quota
Start a new GPU virtual machine
Proceed to general Graphistry installation
Subsequent reading: General installation
Prerequisites: Azure GPU Quota#
You may need to make quota requests to add GPUs to each of your intended locations:
Minimal GPU type: Standard_NC4as_T4_v3 in your region
Maximal GPU type: N-Series (NC T4_v3, NC v2, NC v3, and A100), see general documentation for sizing considerations
Testing if you already have GPU quota#
Go through the Start a new GPU virtual machine, then tear it down if successful
Requesting Azure for GPU Quota#
For each location in which you want to run Graphistry:
Start help ticket:
? (Help)->Help + support->New support requestFill out ticket
Basics:
Quota-><Your Subscription>->Compute (cores/vCPUs)->NextProblem: Specify location/SKU, e.g.,
West US 2orEast USforNCv2+ SeriesandND+ SeriesContact Information: Fill out and submit
Expect 1-3 days based on your requested Severity rating and who Azure assigns to your ticket
1. Start a new GPU virtual machine#
See general installation instructions for currently supported Linux versions (subject to above Azure restrictions and general support restrictions.)
Virtual machines ->
Create virtual machineUbuntu 16.04 LTS Please let us know if another OS is required
Basics: As desired; make sure can login, such as by SSH public key; needs to be a region with GPU quota
Size: GPU of all disk types, e.g., NC6v2 (hdd) is cheapest for development
Settings: Open ports for administration (SSH) and usage (HTTP, HTTPS)
Summary: Should say “
Validation passed” at the top -> visually audit settings + hitCreate
2. Confirm proper instance#
Test login; see SSH command at
Overview->Connect->Login using VM AccountCheck to make sure GPU is attached:
$ lspci -vnn | grep VGA -A 12
0000:00:08.0 VGA compatible controller [0300]: Microsoft Corporation Hyper-V virtual VGA [1414:5353] (prog-if 00 [VGA controller])
Flags: bus master, fast devsel, latency 0, IRQ 11
Memory at f8000000 (32-bit, non-prefetchable) [size=64M]
[virtual] Expansion ROM at 000c0000 [disabled] [size=128K]
Kernel driver in use: hyperv_fb
Kernel modules: hyperv_fb
5dc5:00:00.0 3D controller [0302]: NVIDIA Corporation GK210GL [Tesla K80] [10de:102d] (rev a1)
Subsystem: NVIDIA Corporation GK210GL [Tesla K80] [10de:106c]
Flags: bus master, fast devsel, latency 0, IRQ 24, NUMA node 0
Memory at 21000000 (32-bit, non-prefetchable) [size=16M]
Memory at 1000000000 (64-bit, prefetchable) [size=16G]
Memory at 1400000000 (64-bit, prefetchable) [size=32M]
3. Proceed to general Graphistry installation#
Login to your instance (see Test login above) and use the instructions for general installation.
For steps involving an IP address, see needed IP value at Azure console in Overview -> Public IP address
Install docker-compose:
sudo curl -L "https://github.com/docker/compose/releases/download/1.23.1/docker-compose-$(uname -s)-$(uname -m)" -o /usr/local/bin/docker-compose
sudo chmod +x /usr/local/bin/docker-compose
NGC already sets the default docker runtime to nvidia for you (/etc/docker/daemon.json).
From here, you can perform a general installation.