Interactive Cloud Microservices

Datacenters support a large and ever-increasing fraction of the world's digital computation power, including search engines, social networks, and machine learning analytics. As modern cloud services grow in popularity, their design shifts from supporting complex monolithic applications to supporting collections of specialized, loosely-coupled microservices. These microservices impact resource requirements and complicate computer cluster management, hurting availability and service reliability. Guaranteeing the responsiveness expected from cloud services while using datacenters efficiently requires a joint hardware-software approach.

Christina Delimitrou, Electrical and Computer Engineering, is taking a holistic view toward designing a system stack for interactive cloud microservices—running on large-scale datacenters that are resource-efficient. More datacenter services are switching to this new application model. Acknowledging this trend, Delimitrou is pursuing automated, learning-based techniques, as she highlights the value of leveraging practical machine learning techniques to better navigate the increasing complexity of the cloud.

At the hardware level, this project first quantifies the implications that microservices have on server design, and second, explores their potential for hardware acceleration. At the software level, the work is developing a new cluster manager that accounts for the dependencies among microservices in an automated and transparent-to-the-user way. This guarantees end-to-end performance. By innovating in both hardware and software, Delimitrou’s research aims to achieve performance and efficiency gains that neither hardware-only or software-only approaches can provide.


Originally published by Cornell Research.

Graphic by Beatrice Jin.

Other Articles of Interest

Magic Eye

Rick Johnson, an engineering professor on the Hill—and, at the risk of a mixed metaphor, something of a Renaissance man. At Cornell since 1981, Johnson has spent decades teaching and doing research in electrical engineering, particularly in the fields of control systems and signal processing. But over the past twelve years, his interests have entailed as much art as science. A pioneer in the field of computational art history, Johnson leverages both his engineering acumen and his abiding passion for art to study the physical materials with which works are made. Read more about Magic Eye