Hadoop Mapreduce Outline in Big Figures Analytics
Keywords:
Framework, HDFS, Mapreduce, Shuffle, WorkflowAbstract
As Hadoop is a Substantial scale, exposed basis software design scheme dedicated to adaptable, disseminated, info concentrated processing. Hadoop [1] mapreduce is a software design construction for professionally composing requisitions which prepare boundless events of info (multi-terabyte info sets) in parallel on extensive bunches (many hubs) of merchandise fittings in a dependable, shortcoming tolerant way. A mapreduce [6] skeleton comprises of two parts. They are "mapper" and "reducer" which consume remained inspected in this paper. Fundamentally this newspaper saves tabs on mapreduce adapting model, preparation undertakings, overseeing and re-execution of the fizzled assignments. Workflow of mapreduce is designated in this exchange.
References
Yuan Bao ; Lei Ren ; Lin Zhang ; Xuesong Zhang ; Yongliang Luo “Massive sensor data management framework in Cloud manufacturing based on Hadoop” Industrial Informatics (INDIN), 2012 10th IEEE International Conference on Publication Year: 2012 , Page(s): 397 - 401
Abbasi, A. ; Khunjush, F. ; Azimi, R. “A preliminary study of incorporating GPUs in the Hadoop framework” Computer Architecture and Digital Systems (CADS), 2012 16th CSI International Symposium on Publication Year: 2012 , Page(s): 178 – 185
R.K. ; Manimegalai, R. ; Kumar, S.S. “Medical Image Retrieval System in Grid Using Hadoop Framework Grace”, Computational Science and Computational Intelligence (CSCI), 2014 International Conference on Volume: 1 Publication Year: 2014 , Page(s): 144 – 148
Tomar, Anuradha ; Bodhankar, Jahnavi ; Kurariya, Pavan ; Jain, Priyanka ; Lele, Anuradha ; Darbari, Hemant ; Bhavsar, Virendrakumar C. “Translation Memory for a Machine Translation System Using the Hadoop Framework” Advances in Computing and Communications (ICACC), 2014 Fourth International Conference on Publication Year: 2014 , Page(s): 203 – 207
Lan Huang ; Wang Xiao-wei ; Zhai Yan-dong ; Bin Yang “Extraction of User Profile Based on the Hadoop Framework Wireless Communications”, Networking and Mobile Computing, 2009. WiCom '09. 5th International Conference on Publication Year: 2009 , Page(s): 1 - 6
Therdphapiyanak, J. ; Piromsopa, K. “An analysis of suitable parameters for efficiently applying K-means clustering to large TCPdump data set using Hadoop framework” Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON), 2013 10th International Conference on Publication Year: 2013 , Page(s): 1 – 6
Sethi, Priyanka, Kumar, Prakash “Leveraging hadoop framework to develop duplication detector and analysis using Mapreduce, Hive and Pig” Contemporary Computing (IC3), 2014 Seventh International Conference on Publication Year: 2014 , Page(s): 454 – 460
Jai-Andaloussi, S. ; Elabdouli, A. ; Chaffai, A. ; Madrane, N. ;Sekkaki, A. “Medical content based image retrieval by using the Hadoop framework” Telecommunications (ICT), 2013 20th International Conference on Publication Year: 2013 , Page(s): 1 – 5
Hui Li ; Chunmei Liu “Prediction of protein structures using a map-reduce Hadoop framework based simulated annealing algorithm” Bioinformatics and Biomedicine (BIBM), 2013 IEEE International Conference on Publication Year: 2013 , Page(s): 6 – 10
Weikuan Yu ; Yandong Wang ; Xinyu Que “Design and Evaluation of Network-Levitated Merge forHadoop Acceleration” Parallel and Distributed Systems, IEEE Transactions on Volume: 25 , Issue: 3 Publication Year: 2014 , Page(s): 602 – 611
Shen Li ; Shaohan Hu ; Shiguang Wang ; Lu Su ; Abdelzaher, T. ;Gupta, I. ; Pace, R. “WOHA: Deadline-Aware Map-Reduce Workflow Scheduling Framework over Hadoop Clusters Distributed Computing Systems (ICDCS)”, 2014 IEEE 34th International Conference on Publication Year: 2014 , Page(s): 93 – 103
Lightweight workflow engine based on HADOOP and OSGI Shengmei Luo ; Lixia Liu ; Juan Yang ; Di Zhang Broadband Network & Multimedia Technology (IC-BNMT), 2013 5th IEEE International Conference on Publication Year: 2013 , Page(s): 262 – 267
Wenjun Wu ; Hui Zhang ; Yaokuan Mao ; Liang Luo GreenPipe,”A Hadoop Based Workflow System on Energy-efficient Clouds” Parallel and Distributed Processing Symposium Workshops & PhD Forum (IPDPSW), 2012 IEEE 26th International Publication Year: 2012 , Page(s): 2211 - 2219
Sethi, M. ; Sachindran, N. ; Raghavan, S. “SASH: Enabling continuous incremental analytic workflowson Hadoop Data Engineering (ICDE), 2013 IEEE 29th International Conference on Publication Year: 2013 , Page(s): 1219 – 1230
Gattiker, A. ; Gebara, F.H. ; Hofstee, H.P. ; Hayes, J.D. ; Hylick, A. “Big Data text-oriented benchmark creation for Hadoop” IBM Journal of Research and Development Volume: 57 , Issue: 3/4 Publication Year: 2013 , Page(s): 10:1 - 10:6
Liu, Yewei ; Xiao, Guirong ; Wu, Jianwei ; Lin, Jianfeng CSWf: A cloud service workflow system Information Science and Technology (ICIST), 2013 International Conference on Publication Year: 2013 , Page(s): 408 – 413
Zhuoyao Zhang ; Cherkasova, L. ; Boon Thau Loo Getting more for less in optimized MapReduce workflows Integrated Network Management (IM 2013), 2013 IFIP/IEEE International Symposium on Publication Year: 2013 , Page(s): 93 – 100
Altintas, I.“Workflow-driven programming paradigms for distributed analysis of biological big data” Computational Advances in Bio and Medical Sciences (ICCABS), 2013 IEEE 3rd International Conference Publication Year: 2013 ,
Page(s): 1-5
Rongrong Gu ; Shaochun Wu ; Han Dong ; Yongquan Xu ; Gaozhao Chen ; Lingyu Xu A Modeling Method of Scientific Workflow Based on Cloud Environment Computer and Information Science (ICIS), 2012 IEEE/ACIS 11th International Conference on Publication Year: 2012 , Page(s): 31 – 36
Tudoran, R. ; Costan, A. ; Rad, R.R. ; Brasche, G. ; Antoniu, G. “Adaptive file management for scientific workflows on the Azure cloud Big Data”, 2013 IEEE International Conference on Publication Year: 2013 , Page(s): 273 - 281
Jingui Li ; Xuelian Lin ; Xiaolong Cui ; Yue Ye “Improving the Shuffle of Hadoop MapReduce Cloud Computing Technology and Science (CloudCom)”, 2013 IEEE 5th International Conference on Volume: 1 Publication Year: 2013 , Page(s): 266 – 273
Yandong Wang ; Cong Xu ; Xiaobing Li ; Weikuan Yu “JVM-Bypass for Efficient Hadoop Shuffling” Parallel & Distributed Processing (IPDPS), 2013 IEEE 27th International Symposium on Publication Year: 2013 , Page(s): 569 – 578
Mandal, A. ; Yufeng Xin ; Baldine, I. ; Ruth, P. ; Heerman, C. ; Chase, J. ; Orlikowski, V. ; Yumerefendi, A. “Provisioning and Evaluating Multi-domain Networked Clouds for Hadoop-based Applications Cloud Computing Technology and Science (CloudCom)”, 2011 IEEE Third International Conference on Publication Year: 2011 , Page(s): 690 - 697
Wasi-Ur-Rahman, M. ; Islam, N.S. ; Xiaoyi Lu ; Jose, J. ; Subramoni, H. ; Hao Wang ; Panda, D.K.D. “High-Performance RDMA-based Design of HadoopMapReduce over InfiniBand” Parallel and Distributed Processing Symposium Workshops & PhD Forum (IPDPSW), 2013 IEEE 27th International Publication Year: 2013 , Page(s): 1908 – 1917
Hadoop Acceleration in an OpenFlow-Based Cluster Narayan, S. ; Bailey, S. ; Daga, A. High Performance Computing, Networking, Storage and Analysis (SCC), 2012 SC Companion: Publication Year: 2012 , Page(s): 535 - 538
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors contributing to this journal agree to publish their articles under the Creative Commons Attribution 4.0 International License, allowing third parties to share their work (copy, distribute, transmit) and to adapt it, under the condition that the authors are given credit and that in the event of reuse or distribution, the terms of this license are made clear.
