ChefConf 2013 Talk: Writing a Knife cloud plugin for your shiny VMWare vCloud Director

Writing a Knife Plugin for yourshiny new VMWare vCloudDirectorChirag Jog, CTO [email protected] → Execution → Solution → Delivered

http://www.clogeny.com© 2012 Clogeny TechnologiesAbout MeBuilt cutting edgeproducts:• Hybrid Cloud MigrationAppliances• Enterprise Java PaaS• Multi-cloud single pane ofglass DashboardContributed to severalknife plugins• VMWare vCloud Director• Google Compute Engine• Windows Azure• Citrix Cloudstack• Terremark• Amazon EC2Co-founder/CTO at Clogeny

http://www.clogeny.com© 2012 Clogeny TechnologiesAgenda What is the knife plugins ? The Knife cloud plugin framework VMWare vCloud Director API Model Code Walkthrough of the knife-vcloud plugin Demo of the knife vcloud plugin

http://www.clogeny.com© 2012 Clogeny TechnologiesWhat are knife cloud plugins ?Extend Knife to support additional functionality Virtual Machine Life cycle Server Create Linux and Windows Bootstrapping Server Destroy List available cloud resources Images Flavors / Server Types Networks Servers

http://www.clogeny.com© 2012 Clogeny TechnologiesKnife Plugin Usagegem install knife-<cloudname>knife <cloudname> server create• Flavor or Server size• Image• Zone/Region• Template/Distro• Chef Node Name• SSH params – sshusername, password, keypair, keypair file• WinRM params – username, password, AD/Kerberosparams• Cloud Vendor Credentials

http://www.clogeny.com© 2012 Clogeny TechnologiesKnife Plugin Usageknife <cloudname> server delete• Chef Node Name• Purge Node/Clientknife <cloudname> server listknife <cloudname> image listknife <cloudname> flavor list

http://www.clogeny.com© 2012 Clogeny TechnologiesFogFog - Multi-Cloud Services LibraryOpen source, Community drivenPortable, Powerful, EstablishedSimulated Fog behavior using MockOrganizes resources –servers, images, networks, vapps as collection ofmodels.

http://www.clogeny.com© 2012 Clogeny TechnologiesUsing Fog Interactive$ fogWelcome to fog interactive!>> connection = Fog::Compute.new(:provider => <CloudProvider>, credential params..)>> images = connection.images.all[<Fog::Compute::Cloud::Image id=…, name=“ubuntu”>,<Fog::Compute::Cloud::Image id=…, name=“centos”>…]>> servers = connection.servers.all>> server =connection.servers.create(server_def_params)

http://www.clogeny.com© 2012 Clogeny TechnologiesUsing Fog Interactive$ fogWelcome to fog interactive!>> connection = Fog::Compute.new(:provider => <CloudProvider>, credential params..)>> images = connection.images.all[<Fog::Compute::Cloud::Image id=…, name=“ubuntu”>,<Fog::Compute::Cloud::Image id=…, name=“centos”>…]>> servers = connection.servers.all>> server = connection.servers.create(server_def_params)

http://www.clogeny.com© 2012 Clogeny TechnologiesKnife plugin – Fog collectionsknife-cloudknife cloud server createknife cloud server deleteknife cloud server listknife cloud flavor listknife cloud image listserversimagesflavorsFogCollections

http://www.clogeny.com© 2012 Clogeny Technologiesknife cloud server createclass Chefclass Knifeclass CloudServerCreate < Knifebanner "knife vcloud server create (options)”option :flavor,:short => "-f FLAVOR_ID",:long => "--flavor FLAVOR_ID",:description => "The flavor ID of server (m1.small, m1.medium, etc)",:proc => Proc.new { |f| Chef::Config[:knife][:flavor] = f }option :image,:short => "-I IMAGE_ID",:long => "--image IMAGE_ID",:description => "The image ID for the server",:proc => Proc.new { |i| Chef::Config[:knife][:image] = i }option :chef_node_name….option :zone…Several bootstrapping options

http://www.clogeny.com© 2012 Clogeny Technologiesknife cloud server createclass Chefclass Knifeclass CloudServerCreate < Knifebanner "knife vcloud server create (options)”option :flavor,:short => "-f FLAVOR_ID",:long => "--flavor FLAVOR_ID",:description => "The flavor ID of server(m1.small, m1.medium, etc)",:proc => Proc.new { |f| Chef::Config[:knife][:flavor] = f }option :image,:short => "-I IMAGE_ID",:long => "--image IMAGE_ID",:description => "The image ID for the server",:proc => Proc.new { |i| Chef::Config[:knife][:image] = i }option :chef_node_name….option :zone…Several bootstrapping optionsInherit from theChef::Knife class

http://www.clogeny.com© 2012 Clogeny Technologiesknife cloud server createclass Chefclass Knifeclass CloudServerCreate < Knifebanner "knife vcloud server create (options)”option :flavor,:short => "-f FLAVOR_ID",:long => "--flavor FLAVOR_ID",:description => "The flavor ID of server(m1.small, m1.medium, etc)",:proc => Proc.new { |f| Chef::Config[:knife][:flavor] = f }option :image,:short => "-I IMAGE_ID",:long => "--image IMAGE_ID",:description => "The image ID for the server",:proc => Proc.new { |i| Chef::Config[:knife][:image] = i }option :chef_node_name….option :zone…Several bootstrapping optionsUsage BannerInherit from theChef::Knife class

http://www.clogeny.com© 2012 Clogeny Technologiesknife cloud server createclass Chefclass Knifeclass CloudServerCreate < Knifebanner "knife vcloud server create (options)”option :flavor,:short => "-f FLAVOR_ID",:long => "--flavor FLAVOR_ID",:description => "The flavor ID of server(m1.small, m1.medium, etc)",:proc => Proc.new { |f| Chef::Config[:knife][:flavor] = f }option :image,:short => "-I IMAGE_ID",:long => "--image IMAGE_ID",:description => "The image ID for the server",:proc => Proc.new { |i| Chef::Config[:knife][:image] = i }option :chef_node_name….option :zone…Several bootstrapping optionsParameter Optionslike Serversize, Image, Zoneand BootstrappingOptionsUsage BannerInherit from theChef::Knife class

http://www.clogeny.com© 2012 Clogeny Technologiesknife cloud server create (run)def runvalidate compulsory parameters….connection = Fog::Compute.new(…)…Cloud provider based checks…server = connection.servers.create(params)…Cloud provider specific logic –Enable Networking,Associate IP Address,Reconfigure Server…if windows_image?wait_for_winrmelsewait_for_sshdend// Server is now up and runningBootstrap the Nodeend

http://www.clogeny.com© 2012 Clogeny Technologiesknife cloud server create (run)def runvalidate compulsory parameters….connection = Fog::Compute.new(…)…Cloud provider based checks…server = connection.servers.create(params)…Cloud provider specific logic –Enable Networking,Associate IP Address,Reconfigure Server…if windows_image?wait_for_winrmelsewait_for_sshdend// Server is now up and runningBootstrap the NodeendKnife commands are run bycalling the `#run` method onan instance of your commandclass

http://www.clogeny.com© 2012 Clogeny Technologiesknife cloud server create (run)def runvalidate compulsory parameters….connection = Fog::Compute.new(…)…Cloud provider based checks…server = connection.servers.create(params)…Cloud provider specific logic –Enable Networking,Associate IP Address,Reconfigure Server…if windows_image?wait_for_winrmelsewait_for_sshdend// Server is now up and runningBootstrap the NodeendKnife commands are run bycalling the `#run` method onan instance of your commandclassCreate the fog connectionobject

http://www.clogeny.com© 2012 Clogeny Technologiesknife cloud server create (run)def runvalidate compulsory parameters….connection = Fog::Compute.new(…)…Cloud provider based checks…server = connection.servers.create(params)…Cloud provider specific logic –Enable Networking,Associate IP Address,Reconfigure Server…if windows_image?wait_for_winrmelsewait_for_sshdend// Server is now up and runningBootstrap the NodeendKnife commands are run bycalling the `#run` method onan instance of your commandclassCreate the fog connectionobjectCreate and configure theserver

http://www.clogeny.com© 2012 Clogeny Technologiesknife cloud server create (run)def runvalidate compulsory parameters….connection = Fog::Compute.new(…)…Cloud provider based checks…server = connection.servers.create(params)…Cloud provider specific logic –Enable Networking,Associate IP Address,Reconfigure Server…if windows_image?wait_for_winrmelsewait_for_sshdend// Server is now up and runningBootstrap the NodeendKnife commands are run bycalling the `#run` method onan instance of your commandclassCreate the fog connectionobjectCreate and configure theserverWait for WinRM/SSH Serviceto start

http://www.clogeny.com© 2012 Clogeny Technologiesknife cloud server create (run)def runvalidate compulsory parameters….connection = Fog::Compute.new(…)…Cloud provider based checks…server = connection.servers.create(params)…Cloud provider specific logic –Enable Networking,Associate IP Address,Reconfigure Server…if windows_image?wait_for_winrmelsewait_for_sshdend// Server is now up and runningBootstrap the NodeendKnife commands are run bycalling the `#run` method onan instance of your commandclassCreate the fog connectionobjectCreate and configure theserverWait for WinRM/SSH Serviceto startWindows or LinuxBootstrapping

http://www.clogeny.com© 2012 Clogeny TechnologiesBootstrappingInstalls Chef and runs thechef-client tocommunicate with a ChefServer• via SSH• via Windows RemoteManagement(WinRM)Ref: http://www.lemen.com/imageBootstrap1.html

http://www.clogeny.com© 2012 Clogeny Technologiesknife cloud server deleteclass Chefclass Knifeclass CloudServerDelete < Knifebanner "knife vcloud server delete (options)”def runvalidate compulsory parameters….connection = Fog::Compute.new(…)Check whether server(s) exists or not@name_args.each do |server_id|beginserver = connection.servers.get(server_id)if !serverui.warn(“Server does not exists”)nextendconfirm("Do you really want to delete this server”)server.destroyui.warn("Deleted server #{server.id}")#Destroy Chef Node# Destroy Chef ClientendInherit from theChef::Knife classUsage BannerFind the Server andDelete it

http://www.clogeny.com© 2012 Clogeny Technologiesknife cloud image listclass Chefclass Knifeclass CloudImageList < Knifebanner "knife cloud image list (options)"def runimage_list = [ui.color(ID, :bold),ui.color(Name, :bold)]connection.images.sort_by(&:name).each do |image|image_list << image.id.to_simage_list << image.nameendputs ui.list(image_list, :uneven_columns_across, 2)endendendendInherit from theChef::Knife classUsage BannerList Resource andDisplay it

http://www.clogeny.com© 2012 Clogeny Technologiesknife plugin directory structureknife-vcloud├── Gemfile├── knife-vcloud.gemspec├── lib├ chef├ knife-vcloud├ version.rb├ knife├ vcloud_server_create.rb├ vcloud_server_delete.rb├ vcloud_image_list.rb├── spec├── README.md└── LICENSE

http://www.clogeny.com© 2012 Clogeny Technologiesknife plugin directory structureknife-vcloud├── Gemfile├── knife-vcloud.gemspec├── lib├ chef├ knife-vcloud├ version.rb├ knife├ vcloud_server_create.rb├ vcloud_server_delete.rb├ vcloud_image_list.rb├── spec├── README.md└── LICENSEParent Directory

http://www.clogeny.com© 2012 Clogeny Technologiesknife plugin directory structureknife-vcloud├── Gemfile├── knife-vcloud.gemspec├── lib├ chef├ knife-vcloud├ version.rb├ knife├ vcloud_server_create.rb├ vcloud_server_delete.rb├ vcloud_image_list.rb├── spec├── README.md└── LICENSERequired to buildthe gemParent Directory

http://www.clogeny.com© 2012 Clogeny Technologiesknife plugin directory structureknife-vcloud├── Gemfile├── knife-vcloud.gemspec├── lib├ chef├ knife-vcloud├ version.rb├ knife├ vcloud_server_create.rb├ vcloud_server_delete.rb├ vcloud_image_list.rb├── spec├── README.md└── LICENSEVersion InfoRequired to buildthe gemParent Directory

http://www.clogeny.com© 2012 Clogeny Technologiesknife plugin directory structureknife-vcloud├── Gemfile├── knife-vcloud.gemspec├── lib├ chef├ knife-vcloud├ version.rb├ knife├ vcloud_server_create.rb├ vcloud_server_delete.rb├ vcloud_image_list.rb├── spec├── README.md└── LICENSEActual CodeVersion InfoRequired to buildthe gemParent Directory

VMWare vCloud Director

http://www.clogeny.com© 2012 Clogeny TechnologiesvAppsContainer of one ormore VMs• Package up Multi-tierApplications into vApps• Operate on VMs as oneunit• Can be created byscratch• Can be imported fromoutside the cloudReference: http://download3.vmware.com/vcat/documentation-center/index.html#page/Consuming%20a%20vCloud/3c%20Consuming%20a%20VMware%20vCloud.2.077.html

http://www.clogeny.com© 2012 Clogeny TechnologiesCatalogsCatalogs are collections of vApps, vAppsTemplates and mediaExamples:• Infrastructure as Service Catalogs• Pre-installed Windows/Linux VMs• OS Media files• App Catalogs

http://www.clogeny.com© 2012 Clogeny TechnologiesvCloud Layered NetworkExternal NetworkOrganization NetworkvApp NetworkExternal Network : Providing a connection to the outside worldOrganization Network : Network contained within an organizationvApp Network : Network contained within a vAppRef: http://hol-prt.cloudfoundry.com/HOL-PRT-04_EN/HOL-PRT-04-m1/lessons/vCloud_Director_networking_and_Cisco_Nexus_1000V.html

http://www.clogeny.com© 2012 Clogeny Technologiesknife-vcloudGit repo: https://github.com/opscode/knife-vcloudSupport to provision one-VM vApps onto the Org-level networkSupported Commands:• knife vcloud server create• knife vcloud server list• knife vcloud server delete• knife vcloud image list• knife vcloud network list

http://www.clogeny.com© 2012 Clogeny Technologiesknife-vcloudGit repo: https://github.com/opscode/knife-vcloudSupport to provision one-VM vApps onto the Org-level networkSupported Commands:• knife vcloud server create• knife vcloud server list• knife vcloud server delete• knife vcloud image list• knife vcloud network listLets focus on it!

http://www.clogeny.com© 2012 Clogeny TechnologiesDeploying a vAppRef: http://hol-prt.cloudfoundry.com/HOL-PRT-04_EN/HOL-PRT-04-m1/lessons/vCloud_Director_networking_and_Cisco_Nexus_1000V.htmlSelect the vApp Template.

http://www.clogeny.com© 2012 Clogeny TechnologiesDeploying a vAppRef: http://hol-prt.cloudfoundry.com/HOL-PRT-04_EN/HOL-PRT-04-m1/lessons/vCloud_Director_networking_and_Cisco_Nexus_1000V.htmlSelect the vApp Template.Select the Network

http://www.clogeny.com© 2012 Clogeny TechnologiesDeploying a vAppRef: http://hol-prt.cloudfoundry.com/HOL-PRT-04_EN/HOL-PRT-04-m1/lessons/vCloud_Director_networking_and_Cisco_Nexus_1000V.htmlSelect the vApp Template.Select the NetworkProvide a name, administrator Password to thevApp being deployed.

http://www.clogeny.com© 2012 Clogeny TechnologiesDeploying a vAppSelect the vApp Template.Select the NetworkProvide a name, administrator Password to thevApp being deployed.Configure the virtual machines inside thevApp, including• computer name,• CPU and Memory• Network and IP Assignment.

http://www.clogeny.com© 2012 Clogeny TechnologiesDeploying a vAppSelect the vApp Template.Select the NetworkProvide a name, administrator Password to thevApp being deployed.Configure the virtual machines inside thevApp, including• computer name,• CPU and Memory• Network and IP Assignment.Bootstrapping!

http://www.clogeny.com© 2012 Clogeny Technologiesknife vcloud server create (Linux)knife vcloud server create--image <vApp-Linux-template ID>--node-name linux_node_test--network <Network ID>--ssh-user <SSH Username>--ssh-password <SSH Password>--distro chef-full

http://www.clogeny.com© 2012 Clogeny Technologiesknife vcloud server create (Windows)knife vcloud server create--image <vApp-Windows-template ID>--node-name windows_node_test--network <Network ID>--bootstrap-protocol winrm--winrm-password <Windows WinRM Password>--template-file ../knife-windows/lib/chef/knife/bootstrap/windows-chef-client-msi.erb-VV

Thank You!Innovation → Execution → Solution → DeliveredFeel free to reach out :Email: [email protected]: @cheezo

http://www.clogeny.com	2665
http://clogeny.com	1335
http://www.opscode.com	545
http://www.getchef.com	334
http://blogs.clogeny.com	250
https://twitter.com	21
http://www.linkedin.com	9
https://www.linkedin.com	3
http://webcache.googleusercontent.com	3
https://www.google.com	2
http://cloud.feedly.com	1
http://www.spundge.com	1
http://www.clogeny.com&_=1372503318515 HTTP	1
https://www.google.co.in	1
https://www.getchef.com	1

ChefConf 2013 Talk: Writing a Knife cloud plugin for your shiny VMWare vCloud Director

by Clogeny Technologies

on Apr 26, 2013

Statistics

Views

Actions

15 Embeds 5,172

Accessibility

Categories

Upload Details

Usage Rights

Report content

ChefConf 2013 Talk: Writing a Knife cloud plugin for your shiny VMWare vCloud Director Presentation Transcript