Home > Papers

 
 
Design and Implementation of Big Data Processing Platform Based on SCA and Spark
Zhou Yongjiang #,Zhang Yang *
Institute of Network Technology, Beijing University of Posts and Telecommunications,Beijing 100876
*Correspondence author
#Submitted by
Subject:
Funding: none
Opened online: 5 January 2017
Accepted by: none
Citation: Zhou Yongjiang,Zhang Yang.Design and Implementation of Big Data Processing Platform Based on SCA and Spark[OL]. [ 5 January 2017] http://en.paper.edu.cn/en_releasepaper/content/4713662
 
 
With the rapid development of computer technology, electronic information technology and network technology, the traditional data processing method based on web service has become difficult to meet the demand of big data. On the other hand, big data software needs to be reconstructed, They can`t reuse the existing business logic. Apache Spark is an open source cluster computing technology specifically designed for large scale data processing. Tuscany is a framework of SCA. The paper introduces a system to combine Spark and Tuscany to calculate the complex logic fleetly. At the same time, the system provide a friendly user interface to data analysis.
Keywords:Big data processing platform; web service; SCA;spark
 
 
 

For this paper

  • PDF (0B)
  • ● Revision 0   
  • ● Print this paper
  • ● Recommend this paper to a friend
  • ● Add to my favorite list

    Saved Papers

    Please enter a name for this paper to be shown in your personalized Saved Papers list

Tags

Add yours

Related Papers

Statistics

PDF Downloaded 161
Bookmarked 0
Recommend 0
Comments Array
Submit your papers