Home > Papers

 
 
Large-scale Data Analysis based on Hadoop
Liu Yijun * #
Department of Computer Science, Beijing University of Posts and Telecommunications
*Correspondence author
#Submitted by
Subject:
Funding: none
Opened online:15 December 2009
Accepted by: none
Citation: Liu Yijun.Large-scale Data Analysis based on Hadoop[OL]. [15 December 2009] http://en.paper.edu.cn/en_releasepaper/content/37600
 
 
With the development of complex network and the increase of data scale, the performance of data analysis becomes more and more important. In this paper, we present a new approach for network analysis about the flight data based on Hadoop which is an implementation of the MapReduce parallel framework: Firstly, we identity and group the information of passengers and flights. Secondly, we extract graph nodes, which represent the passengers, and graph edges, which represent the relationship between the passengers. Finally we visualize the passenger’s egocentric network to help network analysis.
Keywords:Hadoop;Complex network;Data analysis;Visualization
 
 
 

For this paper

  • PDF (0B)
  • ● Revision 0   
  • ● Print this paper
  • ● Recommend this paper to a friend
  • ● Add to my favorite list

    Saved Papers

    Please enter a name for this paper to be shown in your personalized Saved Papers list

Tags

Add yours

Related Papers

Statistics

PDF Downloaded 722
Bookmarked 0
Recommend 5
Comments Array
Submit your papers