*Cite as:

@article{sdeaas, author = {Antonios Kontaxakis and Nikos Giatrakos and Dimitris Sacharidis and Antonios Deligiannakis}, title = {{And Synopses for All: a Synopses Data Engine for Extreme Scale Analytics-as-a-Service}}, journal = {Inf. Syst.}, volume = {116}, year = {2023}, } *

args[0]={@link #kafkaDataInputTopic} DEFAULT: "Forex")
args[1]={@link #kafkaRequestInputTopic} DEFAULT: "Requests")
args[2]={@link #kafkaOutputTopic} (DEFAULT: "OUT")
args[3]={@link #kafkaBrokersList} (DEFAULT: "localhost:9092")
args[4]={@link #parallelism} Job parallelism (DEFAULT: "4")

SDE reads the Data and the Requests from a Kafka Topic each, given as arguments. Based on the Request's KEY - VALUE pair SDE performs different actions.

Input Data Example

{
  "values" : 
	  "{"time":"02/19/2019 06:07:14",
	  "StockID":"ForexALLNoExpiry",
	  "price":"110.11"}",
  "streamID" : "ForexALLNoExpiry",
  "dataSetkey" : "Forex"
}

Request Example for adding new Synopses

{
  "streamID" : "INTEL",
  "synopsisID" : 4,
  "requestID" : 1,
  "dataSetkey" : "Forex",
  "param" : [ "StockID", "price","Queryable", “1“, “720", “3600", "8" ],
  "noOfP" : 4,
  "uid" : 1110
}

• git clone https://github.com/akontaxakis/SDE.git
• mvn package
• You can find the "Fat-Jar" under the Directory ./target with all the dependencies included

For any questions don't hesitate to ask:

Antonios Kontaxakis, antonios.kontaxakis-ATNOSPAM-ulb.be

Nikos Giatrakos, ngiatrakos-ATNOSPAM-tuc.gr

Dimitris Sacharidis, dimitris.sacharidis-ATNOSPAM-ulb.be

Antonios Deligiannakis, adeligiannakis-ATNOSPAM-tuc.gr