ON SCHEDULING AND COMMUNICATION ISSUES IN DATA CENTERS
| dc.contributor.advisor | Khuller, Samir | en_US |
| dc.contributor.author | Yang, Sheng | en_US |
| dc.contributor.department | Computer Science | en_US |
| dc.contributor.publisher | Digital Repository at the University of Maryland | en_US |
| dc.contributor.publisher | University of Maryland (College Park, Md.) | en_US |
| dc.date.accessioned | 2021-07-07T05:32:36Z | |
| dc.date.available | 2021-07-07T05:32:36Z | |
| dc.date.issued | 2020 | en_US |
| dc.description.abstract | The proliferation of datacenters to handle the rapidly growing amount of data being managed in the cloud, necessitates the design, management and effective utilization of the thousands of machines that constitute a data center. Many modern big data applications require access to a large number of machines and datasets for training neural nets or for other big data processing. In this thesis, we present research challenges and progress along two fronts. The first challenge addresses the need to schedule communication between machines in a much more effective manner, as several running applications compete for network bandwidth. We address a basic question known as coflow scheduling to optimize the weighted average completion time of tasks that are running across different machines in a datacenter and to effectively handle their communication needs. Sometimes, we are forced to distribute a task among multiple datacenters due to cost or legal reasons. For this case, we also study a related model that addresses communication needs of tasks that process data on multiple data centers and handles communication requirements of such tasks across a wide area network with possibly widely varying bandwidth and network structures across different pairs of machines. The second challenge is from a cloud user's perspective - since access to resources such as those provided by Amazon AWS can be expensive at scale, cloud computing providers often sell under utilized resources at a significant discount via a spot instance market. However, these instances are not dedicated and while they offer a cheaper alternative, there is a chance that the user's job will be interrupted to make room for higher priority tasks. Certain non-critical applications are not significantly impacted by delays due to interruptions, and we develop an initial framework to study some basic scheduling questions under this circumstance. In all of these topics, the problems we study are NP-hard and our focus is on developing good approximation algorithms. In addition, while we attack these problems from a theoretical perspective, all the algorithms developed in this thesis are practical and efficient, and can be easily deployed in practice, some are already deployed. | en_US |
| dc.identifier | https://doi.org/10.13016/q9fi-n9qa | |
| dc.identifier.uri | http://hdl.handle.net/1903/27217 | |
| dc.language.iso | en | en_US |
| dc.subject.pqcontrolled | Computer science | en_US |
| dc.subject.pquncontrolled | coflow | en_US |
| dc.subject.pquncontrolled | scheduling | en_US |
| dc.subject.pquncontrolled | stochastic | en_US |
| dc.title | ON SCHEDULING AND COMMUNICATION ISSUES IN DATA CENTERS | en_US |
| dc.type | Dissertation | en_US |
Files
Original bundle
1 - 1 of 1