Sparql2flink: Evaluation of sparql queries on apache flink

Oscar Ceballos; Carlos Alberto Ramírez Restrepo; María Constanza Pabón; Andres M. Castillo; Oscar Corcho

doi:10.3390/app11157033

Sparql2flink: Evaluation of sparql queries on apache flink

Oscar Ceballos, Carlos Alberto Ramírez Restrepo, María Constanza Pabón, Andres M. Castillo, Oscar Corcho

Research output: Contribution to journal › Article › peer-review

5 Scopus citations

Abstract

Existing SPARQL query engines and triple stores are continuously improved to handle more massive datasets. Several approaches have been developed in this context proposing the storage and querying of RDF data in a distributed fashion, mainly using the MapReduce Programming Model and Hadoop-based ecosystems. New trends in Big Data technologies have also emerged (e.g., Apache Spark, Apache Flink); they use distributed in-memory processing and promise to deliver higher data processing performance. In this paper, we present a formal interpretation of some PACT transformations implemented in the Apache Flink DataSet API. We use this formalization to provide a mapping to translate a SPARQL query to a Flink program. The mapping was implemented in a prototype used to determine the correctness and performance of the solution. The source code of the project is available in Github under the MIT license.

Original language	English
Article number	7033
Journal	Applied Sciences (Switzerland)
Volume	11
Issue number	15
DOIs	https://doi.org/10.3390/app11157033
State	Published - 01 Aug 2021

Keywords

Apache flink
Massive static RDF data
PACT programming model
SPARQL

Access to Document

10.3390/app11157033

Cite this

@article{6130c4c01c9f4bbab62fde7367da55e3,

title = "Sparql2flink: Evaluation of sparql queries on apache flink",

abstract = "Existing SPARQL query engines and triple stores are continuously improved to handle more massive datasets. Several approaches have been developed in this context proposing the storage and querying of RDF data in a distributed fashion, mainly using the MapReduce Programming Model and Hadoop-based ecosystems. New trends in Big Data technologies have also emerged (e.g., Apache Spark, Apache Flink); they use distributed in-memory processing and promise to deliver higher data processing performance. In this paper, we present a formal interpretation of some PACT transformations implemented in the Apache Flink DataSet API. We use this formalization to provide a mapping to translate a SPARQL query to a Flink program. The mapping was implemented in a prototype used to determine the correctness and performance of the solution. The source code of the project is available in Github under the MIT license.",

keywords = "Apache flink, Massive static RDF data, PACT programming model, SPARQL",

author = "Oscar Ceballos and Restrepo, {Carlos Alberto Ram{\'i}rez} and Pab{\'o}n, {Mar{\'i}a Constanza} and Castillo, {Andres M.} and Oscar Corcho",

note = "Publisher Copyright: {\textcopyright} 2021 by the authors. Licensee MDPI, Basel, Switzerland.",

year = "2021",

month = aug,

day = "1",

doi = "10.3390/app11157033",

language = "English",

volume = "11",

journal = "Applied Sciences (Switzerland)",

issn = "2076-3417",

publisher = "Multidisciplinary Digital Publishing Institute (MDPI)",

number = "15",

}

TY - JOUR

T1 - Sparql2flink

T2 - Evaluation of sparql queries on apache flink

AU - Ceballos, Oscar

AU - Restrepo, Carlos Alberto Ramírez

AU - Pabón, María Constanza

AU - Castillo, Andres M.

AU - Corcho, Oscar

PY - 2021/8/1

Y1 - 2021/8/1

N2 - Existing SPARQL query engines and triple stores are continuously improved to handle more massive datasets. Several approaches have been developed in this context proposing the storage and querying of RDF data in a distributed fashion, mainly using the MapReduce Programming Model and Hadoop-based ecosystems. New trends in Big Data technologies have also emerged (e.g., Apache Spark, Apache Flink); they use distributed in-memory processing and promise to deliver higher data processing performance. In this paper, we present a formal interpretation of some PACT transformations implemented in the Apache Flink DataSet API. We use this formalization to provide a mapping to translate a SPARQL query to a Flink program. The mapping was implemented in a prototype used to determine the correctness and performance of the solution. The source code of the project is available in Github under the MIT license.

AB - Existing SPARQL query engines and triple stores are continuously improved to handle more massive datasets. Several approaches have been developed in this context proposing the storage and querying of RDF data in a distributed fashion, mainly using the MapReduce Programming Model and Hadoop-based ecosystems. New trends in Big Data technologies have also emerged (e.g., Apache Spark, Apache Flink); they use distributed in-memory processing and promise to deliver higher data processing performance. In this paper, we present a formal interpretation of some PACT transformations implemented in the Apache Flink DataSet API. We use this formalization to provide a mapping to translate a SPARQL query to a Flink program. The mapping was implemented in a prototype used to determine the correctness and performance of the solution. The source code of the project is available in Github under the MIT license.

KW - Apache flink

KW - Massive static RDF data

KW - PACT programming model

KW - SPARQL

UR - http://www.scopus.com/inward/record.url?scp=85111696891&partnerID=8YFLogxK

U2 - 10.3390/app11157033

DO - 10.3390/app11157033

M3 - Article

AN - SCOPUS:85111696891

SN - 2076-3417

VL - 11

JO - Applied Sciences (Switzerland)

JF - Applied Sciences (Switzerland)

IS - 15

M1 - 7033

ER -

Sparql2flink: Evaluation of sparql queries on apache flink

Abstract

Keywords

Access to Document

Other files and links

Fingerprint

Cite this