000 03605naa a22005417i 4500
001 UMUN-OA-20261005-CS-047
003 local
005 20261005174812.0
006 m o d
007 cr||||||||||||
008 261005s2023 xx o u000 0 eng d
024 7 _a10.26599/bdma.2022.9020014
_2doi
035 _a(local)OpenAlex:W4320525798
040 _alocal
_beng
_clocal
041 0 _aeng
100 0 _aXudong Sun
_eauthor.
245 1 0 _aSurvey of Distributed Computing Frameworks for Supporting Big Data Analysis /
_cXudong Sun; Yulin He; Dingming Wu [and others].
264 1 _a[Place of publication not identified] :
_bTsinghua University Press,
_c2023.
300 _a1 online resource (1 article).
336 _atext
_btxt
_2rdacontent
337 _acomputer
_bc
_2rdamedia
338 _aonline resource
_bcr
_2rdacarrier
500 _aPublication type: Journal article.
500 _aLinked open-access copy: published version.
506 0 _aOpen access; no subscription required for the linked open-access version.
_fUnrestricted online access
_2star
520 3 _aDistributed computing frameworks are the fundamental component of distributed computing systems. They provide an essential way to support the efficient processing of big data on clusters or cloud. The size of big data increases at a pace that is faster than the increase in the big data processing capacity of clusters. Thus, distributed computing frameworks based on the MapReduce computing model are not adequate to support big data analysis tasks which often require running complex analytical algorithms on extremely big data sets in terabytes. In performing such tasks, these frameworks face three challenges: computational inefficiency due to high I/O and communication costs, non-scalability to big data due to memory limit, and limited analytical algorithms because many serial algorithms cannot be implemented in the MapReduce programming model. New distributed computing frameworks need to be developed to conquer these challenges. In this paper, we review MapReduce-type distributed computing frameworks that are currently used in handling big data and discuss their problems when conducting big data analysis. In addition, we present a non-MapReduce distributed computing framework that has the potential to overcome big data analysis challenges.
540 _aCreative Commons Attribution (licence family recorded by the source; version not supplied in metadata).
_uhttps://openalex.org/W4320525798
546 _aIn English.
588 0 _aDescription generated from OpenAlex bibliographic metadata retrieved on 5 October 2026; full text linked from the source.
590 _aCourse allocation: B. Sc. Computer Science.
650 4 _adistributed computing framework
650 4 _abig data analytics
650 4 _aMapReduce
650 4 _ascalability
650 4 _amemory constraints
650 4 _acluster computing
653 _aB. Sc. Computer Science
653 _aUMUN open access collection
653 _adistributed computing
655 4 _aJournal articles.
700 0 _aYulin He
_eauthor.
700 0 _aDingming Wu
_eauthor.
700 0 _aJoshua Zhexue Huang
_eauthor.
773 0 _tBig Data Mining and Analytics
_gVol. 6, no. 2, (2023), pages/article 154-169
_x2096-0654
856 4 0 _uhttps://ieeexplore.ieee.org/ielx7/8254253/10026288/10026506.pdf
_yRead open-access publication
_zOpen access.
_70
_qapplication/pdf
884 _aCourse selection and automated MARC21 enrichment from OpenAlex metadata.
_g20261005
_khttps://openalex.org/W4320525798
_qlocal
942 _n0
999 _c409
_d409