Skip to main content

Autonomic live adaptation of virtual networked environments in a multidomain infrastructure

Abstract

The trend toward cloud-based services is creating the need for large scale shared distributed infrastructures. Behind many clouds lay shared distributed infrastructures formed through the federation of many resources residing in multiple domains. Such shared infrastructures enable massive amounts of aggregated computation resources to be shared among large numbers of users. The core technologies enabling these distributed clouds are machine and network virtualization. Virtualization is the technology that enables the execution of arbitrary distributed applications on top of these increasingly popular shared physical infrastructures.

In this paper, we go beyond supporting applications in the cloud and support autonomic adaptation of virtual computation environments as active, integrated entities. More specifically, driven by both dynamic availability of infrastructure resources and dynamic application resource demand, a virtual computation environment is able to automatically relocate itself across the infrastructure and scale its share of infrastructural resources. Such autonomic adaptation is transparent to both users of virtual environments and administrators of infrastructures, maintaining the look and feel of a stable, dedicated environment for the user. As our proof-of-concept, we present the design, implementation, and evaluation of a system called VIOLIN, which is composed of a virtual network of virtual machines capable of live migration across a multidomain physical infrastructure.

References

  1. 1.

    Amazon ec2. http://aws.amazon.com/ec2/

  2. 2.

    Google app engine. http://code.google.com/appengine/

  3. 3.

    Anderson DP (2004) Boinc: a system for public-resource computing and storage. In: Proceedings of the 5th IEEE/ACM international workshop on grid computing, GRID ’04, Washington, DC, USA. IEEE Computer Society, Los Alamitos, pp 4–10

    Google Scholar 

  4. 4.

    Barham P, Dragovic B, Fraser K, Hand S, Harris T, Ho A, Neugebauer R, Pratt I, Warfield A (2003) Xen and the art of virtualization. In: SOSP ’03: proceedings of the nineteenth ACM symposium on operating systems principles, New York, NY, USA. ACM, New York, pp 164–177

    Google Scholar 

  5. 5.

    Bavier A, Bowman M, Chun B, Culler D, Karlin S, Muir S, Peterson L, Roscoe T, Spalink T, Wawrzoniak M (2004) Operating system support for planetary-scale network services. In Proceedings of the 1st conference on symposium on networked systems design and implementation (NSDI’04), vol 1. USENIX Association, Berkeley, p 19

    Google Scholar 

  6. 6.

    Chase JS, Irwin DE, Grit LE, Moore JD, Sprenkle SE (2003) Dynamic virtual clusters in a grid site manager. In: HPDC ’03: proceedings of the 12th IEEE international symposium on high performance distributed computing (HPDC’03), Washington, DC, USA. IEEE Computer Society, Los Alamitos, p 90

    Google Scholar 

  7. 7.

    Clark C, Fraser K, Hand S, Hansen JG, Jul E, Limpach C, Pratt I, Warfield A (2005) Live migration of virtual machines. In: Proceedings of USENIX NSDI

    Google Scholar 

  8. 8.

    Dike J (2000) User-mode port of the Linux kernel. In: Proceedings of the USENIX annual Linux showcases and conference

    Google Scholar 

  9. 9.

    Figueiredo RJ, Dinda PA, Fortes JAB (2003) A case for grid computing on virtual machines. In Proceedings of the 23rd international conference on distributed computing systems (ICDCS ’03). IEEE Computer Society, Washington, p 550

    Google Scholar 

  10. 10.

    Foster I, Kesselman C (1997) Globus: a metacomputing infrastructure toolkit. Int J Supercomput Appl 11(2)

  11. 11.

    Foster I, Kesselmann C (1999) Globus: a toolkit-based grid architecture. In: The grid: blueprints for a new computing infrastructure, pp 259–278

    Google Scholar 

  12. 12.

    Foster I (2001) The anatomy of the grid: enabling scalable virtual organizations. In IEEE international symposium on cluster computing and the grid (CCGrid’01), IEEE Computer Society, Los Alamitos, p 6

    Google Scholar 

  13. 13.

    Ganguly A, Agrawal A, Boykin PO, Figueiredo RJO Wow: self-organizing wide area overlay networks of virtual workstations. In: IEEE international symposium on high performance distributed computing, pp 30–42

  14. 14.

    Jiang X, Buchholz F, Walters A, Xu D, Wang Y-M, Spafford EH (2008) Tracing worm break-in and contaminations via process coloring: a provenance-preserving approach. IEEE Trans Parallel Distrib Syst 19(7). doi:10.1109/TPDS.2007.70765

  15. 15.

    Jiang X, Xu D (2003) Violin: virtual internetworking on overlay infrastructure. Technical report, Purdue University

  16. 16.

    Jiang X, Xu D, Wang Y-M (2006) Collapsar: a VM-based honeyfarm and reverse honeyfarm architecture for network attack capture and detention. J Parallel Distrib Comput 66(9), 1165–1180

    MATH  Article  Google Scholar 

  17. 17.

    Jung G, Hiltunen MA, Joshi KR, Schlichting RD, Pu C (2010) In: Mistral: dynamically managing power, performance, and adaptation cost in cloud infrastructures. IEEE Press, New York, pp 62–73

    Google Scholar 

  18. 18.

    Jung G, Joshi KR, Hiltunen MA, Schlichting RD, Pu C (2009) A cost-sensitive adaptation engine for server consolidation of multitier applications. In: Proceedings of the 10th ACM/IFIP/USENIX international conference on middleware, middleware ’09, New York, NY, USA. Springer, New York, pp 9:1–9:20

    Google Scholar 

  19. 19.

    Kallahalla M, Uysal M, Swaminathan R, Lowell DE, Wray M, Christian T, Edwards N, Dalton CI, Gittler F (2004) SoftUDC: a software-based data center for utility computing. IEEE Comput 37(11):38–46

    Article  Google Scholar 

  20. 20.

    Kangarlou A, Eugster P, Xu D (2009) Vnsnap: taking snapshots of virtual networked environments with minimal downtime. In: Proceedings of the 39th IEEE/IFIP international conference on dependable systems and networks

    Google Scholar 

  21. 21.

    Krsul I, Ganguly A, Zhang J, Fortes JAB, Figueiredo RJ (2004) Vmplants: providing and managing virtual machine execution environments for grid computing. In: SC ’04: proceedings of the proceedings of the ACM/IEEE SC2004 conference (SC’04), Washington, DC, USA. IEEE Computer Society, Los Alamitos, p 7

    Google Scholar 

  22. 22.

    Nathuji R, Schwan K (2007) Virtualpower: coordinated power management in virtualized enterprise systems. In: Proceedings of twenty-first ACM SIGOPS symposium on operating systems principles, SOSP ’07, New York, NY, USA. ACM, New York, pp 265–278

    Google Scholar 

  23. 23.

    Nocentino A, Ruth P (2009) Toward dependency-aware live virtual machine migration. In: The proceedings of the 3rd international workshop on virtualization technology in distributed computing (VTDC)

    Google Scholar 

  24. 24.

    Petitet A, Whaley RC, Dongarra J, Cleary A (2004) A portable implementation of the high-performance Linpack benchmark for distributed-memory computers, No. 2387600, http://academic.research.microsoft.com/

  25. 25.

    Pordes R, Petravick D, Kramer B, Olson D, Livny M, Roy A, Avery P, Blackburn K, Wenaus T, Wirthwein F, Foster I, Gardner R, Wilde M, Blatecky A, McGee J, Quick R (2007) The open science grid. J Phys Conf Ser 78(1):012057

    Article  Google Scholar 

  26. 26.

    Ruth P, Jiang X, Xu D, Goasguen S (2005) Virtual distributed environments in a shared infrastructure. IEEE Comput 38(5):63–69

    Article  Google Scholar 

  27. 27.

    Ruth P, McGachey P, Xu D (2005) Viocluster: virtualization for dynamic computational domains. In: CLUSTER 2005

    Google Scholar 

  28. 28.

    Sundararaj A, Gupta A, Dinda P (2005) Increasing application performance in virtual environments through run-time inference and adaptation. In: Proceedings of the 14th IEEE international symposium on high performance distributed computing (HPDC 2005)

    Google Scholar 

  29. 29.

    Sundararaj AI, Dinda PA (2004) Towards virtual networks for virtual machine grid computing. In: Virtual machine research and technology symposium, pp 177–190

    Google Scholar 

  30. 30.

    Tesauroa G, Chess DM, Walsh WE, Das R, Segal A, Whalley I, Kephart JO, White SR (2004) A multi-agent systems approach to autonomic computing. In: Proceedings of the third international joint conference on autonomous agents and multiagent systems, pp 464–471

    Google Scholar 

  31. 31.

    Thain D, Tannenbaum T, Livny M (2004) Distributed computing in practice: the condor experience. In: Concurrency and computation: practice and experience

    Google Scholar 

  32. 32.

    http://user-mode-linux.sourceforge.net

  33. 33.

    Verma A, Ahuja P, Neogi A (2008) pmapper: power and migration cost aware application placement in virtualized systems. In: Proceedings of the 9th ACM/IFIP/USENIX international conference on Middleware, Middleware ’08, New York, NY, USA. Springer, New York, pp 243–264

    Google Scholar 

  34. 34.

    Verma A, De P, Mann V, Nayak KT, Purohit A, Dasgupta G, Kothari R (2010) Brownmap: enforcing power budget in shared data centers. In: Middleware, pp 42–63

    Google Scholar 

  35. 35.

    VMware. http://www.vmware.com

  36. 36.

    White SR, Hanson JE, Whalley I, Chess DM, Kephart JO (2004) An architectural approach to autonomic computing. In: Proceedings of the IEEE international conference on autonomic computing

    Google Scholar 

  37. 37.

    Xu J, Adabala S, Fortes JAB (2005) Towards autonomic virtual applications in the in-vigo system. In: Proceedings of the 2nd IEEE international conference on autonomic computing (ICAC-05), pp 15–26

    Google Scholar 

Download references

Author information

Affiliations

Authors

Corresponding author

Correspondence to Paul Ruth.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Ruth, P., Rhee, J., Xu, D. et al. Autonomic live adaptation of virtual networked environments in a multidomain infrastructure. J Internet Serv Appl 2, 141–154 (2011). https://doi.org/10.1007/s13174-011-0031-1

Download citation

Keywords

  • Virtual machines
  • Cloud computing
  • Cyberinfrastructure
  • Autonomics