| 000 | 03605naa a22005417i 4500 | ||
|---|---|---|---|
| 001 | UMUN-OA-20261005-CS-047 | ||
| 003 | local | ||
| 005 | 20261005174812.0 | ||
| 006 | m o d | ||
| 007 | cr|||||||||||| | ||
| 008 | 261005s2023 xx o u000 0 eng d | ||
| 024 | 7 |
_a10.26599/bdma.2022.9020014 _2doi |
|
| 035 | _a(local)OpenAlex:W4320525798 | ||
| 040 |
_alocal _beng _clocal |
||
| 041 | 0 | _aeng | |
| 100 | 0 |
_aXudong Sun _eauthor. |
|
| 245 | 1 | 0 |
_aSurvey of Distributed Computing Frameworks for Supporting Big Data Analysis / _cXudong Sun; Yulin He; Dingming Wu [and others]. |
| 264 | 1 |
_a[Place of publication not identified] : _bTsinghua University Press, _c2023. |
|
| 300 | _a1 online resource (1 article). | ||
| 336 |
_atext _btxt _2rdacontent |
||
| 337 |
_acomputer _bc _2rdamedia |
||
| 338 |
_aonline resource _bcr _2rdacarrier |
||
| 500 | _aPublication type: Journal article. | ||
| 500 | _aLinked open-access copy: published version. | ||
| 506 | 0 |
_aOpen access; no subscription required for the linked open-access version. _fUnrestricted online access _2star |
|
| 520 | 3 | _aDistributed computing frameworks are the fundamental component of distributed computing systems. They provide an essential way to support the efficient processing of big data on clusters or cloud. The size of big data increases at a pace that is faster than the increase in the big data processing capacity of clusters. Thus, distributed computing frameworks based on the MapReduce computing model are not adequate to support big data analysis tasks which often require running complex analytical algorithms on extremely big data sets in terabytes. In performing such tasks, these frameworks face three challenges: computational inefficiency due to high I/O and communication costs, non-scalability to big data due to memory limit, and limited analytical algorithms because many serial algorithms cannot be implemented in the MapReduce programming model. New distributed computing frameworks need to be developed to conquer these challenges. In this paper, we review MapReduce-type distributed computing frameworks that are currently used in handling big data and discuss their problems when conducting big data analysis. In addition, we present a non-MapReduce distributed computing framework that has the potential to overcome big data analysis challenges. | |
| 540 |
_aCreative Commons Attribution (licence family recorded by the source; version not supplied in metadata). _uhttps://openalex.org/W4320525798 |
||
| 546 | _aIn English. | ||
| 588 | 0 | _aDescription generated from OpenAlex bibliographic metadata retrieved on 5 October 2026; full text linked from the source. | |
| 590 | _aCourse allocation: B. Sc. Computer Science. | ||
| 650 | 4 | _adistributed computing framework | |
| 650 | 4 | _abig data analytics | |
| 650 | 4 | _aMapReduce | |
| 650 | 4 | _ascalability | |
| 650 | 4 | _amemory constraints | |
| 650 | 4 | _acluster computing | |
| 653 | _aB. Sc. Computer Science | ||
| 653 | _aUMUN open access collection | ||
| 653 | _adistributed computing | ||
| 655 | 4 | _aJournal articles. | |
| 700 | 0 |
_aYulin He _eauthor. |
|
| 700 | 0 |
_aDingming Wu _eauthor. |
|
| 700 | 0 |
_aJoshua Zhexue Huang _eauthor. |
|
| 773 | 0 |
_tBig Data Mining and Analytics _gVol. 6, no. 2, (2023), pages/article 154-169 _x2096-0654 |
|
| 856 | 4 | 0 |
_uhttps://ieeexplore.ieee.org/ielx7/8254253/10026288/10026506.pdf _yRead open-access publication _zOpen access. _70 _qapplication/pdf |
| 884 |
_aCourse selection and automated MARC21 enrichment from OpenAlex metadata. _g20261005 _khttps://openalex.org/W4320525798 _qlocal |
||
| 942 | _n0 | ||
| 999 |
_c409 _d409 |
||