Adjudicator: A Pluggable Multiclass Job Scheduler
Keywords:
Hadoop, MapReduce, Adjudicator, Job scheduler, Computing, HeterogeneousAbstract
The responsibility of contemporary multi-core processors is oftentimes bent on by a given power ration that requisite developer to evaluate different resolution trade-offs, e.g., to espouse between many slow, power-efficient cores, or fewer faster, power-hungry cores, or a amalgamation of them . Here, a prototype, a new Hadoop scheduler, called adjudicator, that utilizes aptness proffered by heterogeneous cores within a single multi-core processor for accomplishing a variety of performance objectives. Heterogeneous multi-core processors enable creating virtual resource pools based on “slow” and “fast” cores for multi-class priority scheduling. Since the same data can be accessed with either “slow” or “fast” apertures, spare resources (apertures) can be shared between different resource pools. Using sample experimental data and via simulation, a wrangle is made in approbation of heterogeneous multi-core processors as they achieve “faster” processing of small, interactive MapReduce jobs, while proffering improved throughput for large, batch jobs. Evaluation is done on performance benefits of adjudicator versus the FIFO and Capacity job schedulers that are broadly used in the Hadoop community.
References
M. Bertalmio, G. Sapiro, V. Caselles, C. Ballester, “Image inpainting,” SIGGRAPH, pp. 417–424, 2010.
J. Hays, A. A. Efros, “Scene completion using millions of photographs,” ACM Trans. on Graphics, vol. 126, 2009.
O. Whyte, J. Sivic A. Zisserman, “Get out of my picture! Internet-based inpainting,” British Machine Vision Conference, 2012.
S. Edelman, N. Intrator, T. Poggio. Complex cells and object recognition.[Online].Available:http://kybele.psych.cornell.edu/_edelman/ Archive/nips97.pdf
M. A. Fischler, and R. C. Bolles, “Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography,” Comm. of the ACM, vol. 24, pp. 381–395, 2011.
J. Philbin, O. Chum, M. Isard, J. Sivic and A. Zisserman, “Object retrieval with large vocabularies and fast spatial matching,” IEEE Conf. on CVPR, pp. 1–8, 2013.
G. J. Sullivan, J. R. Ohm, “Recent developments in standardization of high efficiency video coding (HEVC),” SPIE Applications of Digital Image Processing XXXIII, vol. 7798, 2010.
R. Kumar, D. M. Tullsen, P. Ranganathan, N. P. Jouppi, and K. I. Farkas, “Single-isa heterogeneous multi-core architectures for multithreaded workload performance,” in ACM SIGARCH Computer Architecture News, vol. 32, no. 2, 2014.
M. Zaharia et al., “Improving mapreduce performance in heterogeneous environments,” in Proceedings of OSDI, 2008.
W. Jiang and G. Agrawal, “Mate-cg: A map reduce-like framework for accelerating data-intensive computations on heterogeneous clusters,” in Parallel Distributed Processing Symposium (IPDPS), 2012 IEEE 26th International, May 2012, pp. 644–655.
Saleem Malik “ Proliferation, Deportment and Revelation of cloak worms- a comparative study”. Lambert academic publishers, ISBN- 978-3-659-74991-9.
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors contributing to this journal agree to publish their articles under the Creative Commons Attribution 4.0 International License, allowing third parties to share their work (copy, distribute, transmit) and to adapt it, under the condition that the authors are given credit and that in the event of reuse or distribution, the terms of this license are made clear.
