Machine Learning | wondernerd.net

Sep 02

Unlocking the Magic of Gen-AI in VMware VCF: Where Dreams Meet Reality

By Tony in AI, Deep Learning, Explore, Machine Learning, vExpert, VMware
September 2, 2024

If you had the chance to join us live for this community session at VMware Explore for session CMTY2254LV, thank you so much. If you are checking it after the event thank you as well! Your support means the world to us. This page contains links to the videos, the session abstract and a bunch …

AI, Deep Learning, DL, Explore, GenAI, GPU, LLM, Machine Learning, ML, Neural Networks, NVIDIA, RAG, retrieval-augmented generation, SLM, VCF, vGPU, VMware, VMworld

Permanent link to this article: https://www.wondernerd.net/unlocking-the-magic-of-gen-ai-in-vmware-vcf-where-dreams-meet-reality/

Mar 13

Scripting VDI By Day and Compute By Night

By Tony in Deep Learning, GPU, Horizon, HPC, Large Scale Compute, Machine Learning, NGCA, PowerCLI, Programming, vExpert
March 13, 2019

Over the weekend I finished writing a PowerCLI script to do VDI by day and compute by night. In in this post I’m going to share the script and how to set it up with you.

For those not familiar with the term VDI by day and compute by night here is my vision for it. Let’s say you have a bunch of VDI users who are structural engineers. They typically work from 8 in the morning to 5 or so at night. On their VDI desktops they have programs like like AutoCAD which require high end GPUs, but since they are using VDI they’re virtual GPUs or vGPUs. That means you have these high end GPUs that might be sitting idle for 12 to 16 hours a day and the organization spent a lot of money for those GPUs.

Now what if you could use those GPUs for something other than just engineers virtual desktops? You know, get a little more millage out of them. The R&D department keeps wanting more servers for their high performance computing (HPC) farm… What could 12 extra hours a day of GPU time coming from the Engineers idle VDI hosts do to help them?

Cycle Harvesting, Deep Learning, DL, EUC, HPC, Machine Learning, ML, Power Shell, PowerCLI, PowerShell, Reclaim Resources, Script, Scripting, VDI by Day Compute by Night, vGPU, vGPU Capacity, vGPU Carrying Capacity, vGPU Cycle Harvesting, VMware Horizon, VMware PowerCLI, VMware {Code}

Permanent link to this article: https://www.wondernerd.net/scripting-vdi-by-day-and-compute-by-night/

Feb 19

Number of vGPUs Available in vSphere

By Tony in AI, Deep Learning, GPU, Horizon, Machine Learning, PowerCLI, Programming, VMware
February 19, 2019

I’ve been working on a PowerCLI function for the last few months in my free time and now I’d like to share it with everyone. This is a pretty spiffy function for those folks working with vGPUs, and it’s not just for VDI it can help those looking to virtualize ML/DL systems too. It calculates the vGPU carrying capacity of a vSphere environment.

Code, Deep Learning, Display Controller, DL, EUC, Get-VM, Get-VMhostPciDevice, GRID, Horizon, Horizon vGPU, Horizon vGPU capacity, Horizon View, Machine Learning, Max vGPU, ML, NVIDIA, NVIDIA GRID, P4, P40, Power Shell, PowerCLI, PowerShell, Script, Snipit, VDI, VDI by Day Compute by Night, vGPU, vGPU Capacity, vGPU Carrying Capacity, vGPU Cycle Harvesting, vGPU Scheduling, VMware Horizon, VMware Horizon View, VMware PowerCLI, VMware {Code}

Permanent link to this article: https://www.wondernerd.net/number-of-vgpus-available-in-vsphere/

Sep 14

Taking Back Resources

By Tony in AI, CUDA, Deep Learning, GPU, Horizon, HPC, Large Scale Compute, Machine Learning, NGCA, vExpert
September 14, 2018

In this post I’m looking at reclaiming resources from virtual environments. To which you might be saying that’s simple, VMware put out a white paper on cycle harvesting. https://www.vmware.com/content/dam/digitalmarketing/vmware/en/pdf/solutions/vmware-jackson-national-life-insurance-white-paper.pdf The above paper was based on what a VMware customer did to reclaim idle CPU resources from their VDI environment. They did this by setting share …