<?xml version="1.0" encoding="UTF-8"?>
<mods xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="http://www.loc.gov/mods/v3" version="3.1" xsi:schemaLocation="http://www.loc.gov/mods/v3 http://www.loc.gov/standards/mods/v3/mods-3-1.xsd">
  <titleInfo>
    <title>Survey of Distributed Computing Frameworks for Supporting Big Data Analysis</title>
  </titleInfo>
  <name type="personal">
    <namePart>Xudong Sun</namePart>
    <role>
      <roleTerm authority="marcrelator" type="text">creator</roleTerm>
    </role>
    <role>
      <roleTerm type="text">author.</roleTerm>
    </role>
  </name>
  <name type="personal">
    <namePart>Yulin He</namePart>
    <role>
      <roleTerm type="text">author.</roleTerm>
    </role>
  </name>
  <name type="personal">
    <namePart>Dingming Wu</namePart>
    <role>
      <roleTerm type="text">author.</roleTerm>
    </role>
  </name>
  <name type="personal">
    <namePart>Joshua Zhexue Huang</namePart>
    <role>
      <roleTerm type="text">author.</roleTerm>
    </role>
  </name>
  <typeOfResource>text</typeOfResource>
  <genre authority="">Journal articles.</genre>
  <originInfo>
    <place>
      <placeTerm type="code" authority="marccountry">xx</placeTerm>
    </place>
    <dateIssued encoding="marc">2023</dateIssued>
    <issuance>monographic</issuance>
  </originInfo>
  <language>
    <languageTerm authority="iso639-2b" type="code">eng</languageTerm>
  </language>
  <physicalDescription>
    <internetMediaType>application/pdf</internetMediaType>
    <extent>1 online resource (1 article).</extent>
  </physicalDescription>
  <abstract>Distributed computing frameworks are the fundamental component of distributed computing systems. They provide an essential way to support the efficient processing of big data on clusters or cloud. The size of big data increases at a pace that is faster than the increase in the big data processing capacity of clusters. Thus, distributed computing frameworks based on the MapReduce computing model are not adequate to support big data analysis tasks which often require running complex analytical algorithms on extremely big data sets in terabytes. In performing such tasks, these frameworks face three challenges: computational inefficiency due to high I/O and communication costs, non-scalability to big data due to memory limit, and limited analytical algorithms because many serial algorithms cannot be implemented in the MapReduce programming model. New distributed computing frameworks need to be developed to conquer these challenges. In this paper, we review MapReduce-type distributed computing frameworks that are currently used in handling big data and discuss their problems when conducting big data analysis. In addition, we present a non-MapReduce distributed computing framework that has the potential to overcome big data analysis challenges.</abstract>
  <note type="statement of responsibility">Xudong Sun; Yulin He; Dingming Wu [and others].</note>
  <note>Publication type: Journal article.</note>
  <note>Linked open-access copy: published version.</note>
  <note>Open access; no subscription required for the linked open-access version. Unrestricted online access star</note>
  <note xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://openalex.org/W4320525798">Creative Commons Attribution (licence family recorded by the source; version not supplied in metadata). https://openalex.org/W4320525798</note>
  <note>In English.</note>
  <subject>
    <topic>distributed computing framework</topic>
  </subject>
  <subject>
    <topic>big data analytics</topic>
  </subject>
  <subject>
    <topic>MapReduce</topic>
  </subject>
  <subject>
    <topic>scalability</topic>
  </subject>
  <subject>
    <topic>memory constraints</topic>
  </subject>
  <subject>
    <topic>cluster computing</topic>
  </subject>
  <subject>
    <topic>B. Sc. Computer Science</topic>
  </subject>
  <subject>
    <topic>UMUN open access collection</topic>
  </subject>
  <subject>
    <topic>distributed computing</topic>
  </subject>
  <relatedItem type="host">
    <titleInfo>
      <title>Big Data Mining and Analytics</title>
    </titleInfo>
    <identifier type="issn">2096-0654</identifier>
    <part>
      <text>Vol. 6, no. 2, (2023), pages/article 154-169</text>
    </part>
  </relatedItem>
  <identifier type="uri">https://ieeexplore.ieee.org/ielx7/8254253/10026288/10026506.pdf</identifier>
  <location>
    <url displayLabel="Read open-access publication">https://ieeexplore.ieee.org/ielx7/8254253/10026288/10026506.pdf</url>
  </location>
  <accessCondition type="restrictionOnAccess">Open access; no subscription required for the linked open-access version.</accessCondition>
  <accessCondition type="useAndReproduction">Creative Commons Attribution (licence family recorded by the source; version not supplied in metadata).</accessCondition>
  <recordInfo>
    <recordContentSource authority="marcorg">local</recordContentSource>
    <recordCreationDate encoding="marc">261005</recordCreationDate>
    <recordChangeDate encoding="iso8601">20261005174812.0</recordChangeDate>
    <recordIdentifier source="local">UMUN-OA-20261005-CS-047</recordIdentifier>
    <languageOfCataloging>
      <languageTerm authority="iso639-2b" type="code">eng</languageTerm>
    </languageOfCataloging>
  </recordInfo>
</mods>
