TY - JOUR
T1 - Composable architecture for rack scale big data computing
AU - Li, Chung Sheng
AU - Franke, Hubertus
AU - Parris, Colin
AU - Abali, Bulent
AU - Kesavan, Mukil
AU - Chang, Victor
N1 - Publisher Copyright:
© 2016 Elsevier B.V.
PY - 2017/2/1
Y1 - 2017/2/1
N2 - The rapid growth of cloud computing, both in terms of the spectrum and volume of cloud workloads, necessitates re-visiting the traditional rack-mountable servers based datacenter design. Next generation datacenters need to offer enhanced support for: (i) fast changing system configuration requirements due to workload constraints, (ii) timely adoption of emerging hardware technologies, and (iii) maximal sharing of systems and subsystems in order to lower costs. Disaggregated datacenters, constructed as a collection of individual resources such as CPU, memory, disks etc., and composed into workload execution units on demand, are an interesting new trend that can address the above challenges. In this paper, we demonstrate the feasibility of composable systems through building a rack scale composable system prototype using PCIe switches. Through empirical approaches, we develop an assessment of the opportunities and challenges for leveraging the composable architecture for rack scale cloud datacenters with a focus on big data and NoSQL workloads. In particular, we compare and contrast the programming models that can be used to access the composable resources, and develop the implications for the network and resource provisioning and management for rack scale architecture.
AB - The rapid growth of cloud computing, both in terms of the spectrum and volume of cloud workloads, necessitates re-visiting the traditional rack-mountable servers based datacenter design. Next generation datacenters need to offer enhanced support for: (i) fast changing system configuration requirements due to workload constraints, (ii) timely adoption of emerging hardware technologies, and (iii) maximal sharing of systems and subsystems in order to lower costs. Disaggregated datacenters, constructed as a collection of individual resources such as CPU, memory, disks etc., and composed into workload execution units on demand, are an interesting new trend that can address the above challenges. In this paper, we demonstrate the feasibility of composable systems through building a rack scale composable system prototype using PCIe switches. Through empirical approaches, we develop an assessment of the opportunities and challenges for leveraging the composable architecture for rack scale cloud datacenters with a focus on big data and NoSQL workloads. In particular, we compare and contrast the programming models that can be used to access the composable resources, and develop the implications for the network and resource provisioning and management for rack scale architecture.
KW - Big data platforms
KW - Composable datacenter
KW - Composable system architecture
KW - Disaggregated datacenter architecture
KW - Software defined environments
KW - Software defined networking
UR - http://www.scopus.com/inward/record.url?scp=84988667189&partnerID=8YFLogxK
U2 - 10.1016/j.future.2016.07.014
DO - 10.1016/j.future.2016.07.014
M3 - Article
AN - SCOPUS:84988667189
SN - 0167-739X
VL - 67
SP - 180
EP - 193
JO - Future Generation Computer Systems
JF - Future Generation Computer Systems
ER -