ontop / vig Goto Github PK

Virtual Instances Generator

License: Apache License 2.0

Shell 1.04% Java 98.96%

vig's Introduction

Virtual Instances Generator (VIG) (v 1.8.1)

VIG is a data scaler specifically designed for benchmarks of Ontology-based Data Access (OBDA) systems such as Ontop. VIG takes as input a source database instance and a scale factor, and produces a scaled database instance that satisfies the schema constraints and that is “similar” to the source instance according to certain ad-hoc similarity measures. The produced database instance is in form of csv files that can be effectively imported into any relational database management system (RDBMS).

VIG is currently the official data scaler of the NPD benchmark.

Download, Configure, and Run

Please refer to the documentation (http://ontop.github.io/vig/ or docs folder) for more information.

Publications

The following list contains a few publications describing VIG. We suggest to skim through them, so as to save time and understand exactly how VIG works and what data it can generate for you.

Experimental Evaluations

Checkout to the evaluations/results branch. Evaluations will be in the "evaluations" folder.

Contacts

Davide Lanti

vig's People

Contributors

Stargazers

Watchers

Forkers

oeg-dataintegration

vig's Issues

Error running ./build.sh vig v1.8.1

It seems that there is a dependency that is not available in the pom of vig-data-pumper:

[WARNING] The POM for it.unibz.inf.vig:vig-test-unit:jar:1.8.1 is missing, no dependency information available
[INFO] Reactor Summary:
[INFO]
[INFO] vig ................................................ SUCCESS [  1.446 s]
[INFO] vig-cpsolver ....................................... SUCCESS [  3.256 s]
[INFO] vig-mappings-analyzer .............................. SUCCESS [  2.534 s]
[INFO] vig-options ........................................ SUCCESS [  1.792 s]
[INFO] vig-data-pumper .................................... FAILURE [  0.054 s]
[INFO] vig-distribution ................................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 9.313 s
[INFO] Finished at: 2019-10-08T15:38:50+02:00
[INFO] Final Memory: 38M/1223M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project vig-data-pumper: Could not resolve dependencies for project it.unibz.inf.vig:vig-data-pumper:jar:1.8.1: Failure to find it.unibz.inf.vig:vig-test-unit:jar:1.8.1 in https://repo.maven.apache.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of central has elapsed or updates are forced -> [Help 1]

Add support for double column type

Can not pump npd database

I tested the vig tool on the npd database and the tool
seems to run without failure, but the pumped database
stays empty.

I run the following:

 $ java -jar vig-distribution-0.1.0-SNAPSHOT-jar-with-dependencies.jar --res=resources --inc=2

and the following output is produced:

INFO  DBMSConnection - Adding schema apaAreaGross
0 [main] INFO connection.DBMSConnection  - Adding schema apaAreaGross
INFO  DBMSConnection - Adding schema apaAreaNet
29 [main] INFO connection.DBMSConnection  - Adding schema apaAreaNet
INFO  DBMSConnection - Adding schema baaArea
45 [main] INFO connection.DBMSConnection  - Adding schema baaArea
INFO  DBMSConnection - Adding schema bsns_arr_area
58 [main] INFO connection.DBMSConnection  - Adding schema bsns_arr_area
INFO  DBMSConnection - Adding schema bsns_arr_area_area_poly_hst
68 [main] INFO connection.DBMSConnection  - Adding schema bsns_arr_area_area_poly_hst
INFO  DBMSConnection - Adding schema bsns_arr_area_licensee_hst
82 [main] INFO connection.DBMSConnection  - Adding schema bsns_arr_area_licensee_hst
INFO  DBMSConnection - Adding schema bsns_arr_area_operator
87 [main] INFO connection.DBMSConnection  - Adding schema bsns_arr_area_operator
INFO  DBMSConnection - Adding schema bsns_arr_area_transfer_hst
93 [main] INFO connection.DBMSConnection  - Adding schema bsns_arr_area_transfer_hst
INFO  DBMSConnection - Adding schema company
103 [main] INFO connection.DBMSConnection  - Adding schema company
INFO  DBMSConnection - Adding schema company_reserves
118 [main] INFO connection.DBMSConnection  - Adding schema company_reserves
INFO  DBMSConnection - Adding schema discovery
122 [main] INFO connection.DBMSConnection  - Adding schema discovery
INFO  DBMSConnection - Adding schema discovery_reserves
127 [main] INFO connection.DBMSConnection  - Adding schema discovery_reserves
INFO  DBMSConnection - Adding schema dscArea
131 [main] INFO connection.DBMSConnection  - Adding schema dscArea
INFO  DBMSConnection - Adding schema facility_fixed
136 [main] INFO connection.DBMSConnection  - Adding schema facility_fixed
INFO  DBMSConnection - Adding schema facility_moveable
146 [main] INFO connection.DBMSConnection  - Adding schema facility_moveable
INFO  DBMSConnection - Adding schema fclPoint
155 [main] INFO connection.DBMSConnection  - Adding schema fclPoint
INFO  DBMSConnection - Adding schema field
165 [main] INFO connection.DBMSConnection  - Adding schema field
INFO  DBMSConnection - Adding schema field_activity_status_hst
174 [main] INFO connection.DBMSConnection  - Adding schema field_activity_status_hst
INFO  DBMSConnection - Adding schema field_description
185 [main] INFO connection.DBMSConnection  - Adding schema field_description
INFO  DBMSConnection - Adding schema field_investment_yearly
194 [main] INFO connection.DBMSConnection  - Adding schema field_investment_yearly
INFO  DBMSConnection - Adding schema field_licensee_hst
198 [main] INFO connection.DBMSConnection  - Adding schema field_licensee_hst
INFO  DBMSConnection - Adding schema field_operator_hst
208 [main] INFO connection.DBMSConnection  - Adding schema field_operator_hst
INFO  DBMSConnection - Adding schema field_owner_hst
217 [main] INFO connection.DBMSConnection  - Adding schema field_owner_hst
INFO  DBMSConnection - Adding schema field_production_monthly
226 [main] INFO connection.DBMSConnection  - Adding schema field_production_monthly
INFO  DBMSConnection - Adding schema field_production_totalt_NCS_month
236 [main] INFO connection.DBMSConnection  - Adding schema field_production_totalt_NCS_month
INFO  DBMSConnection - Adding schema field_production_totalt_NCS_year
241 [main] INFO connection.DBMSConnection  - Adding schema field_production_totalt_NCS_year
INFO  DBMSConnection - Adding schema field_production_yearly
252 [main] INFO connection.DBMSConnection  - Adding schema field_production_yearly
INFO  DBMSConnection - Adding schema field_reserves
263 [main] INFO connection.DBMSConnection  - Adding schema field_reserves
INFO  DBMSConnection - Adding schema fldArea
268 [main] INFO connection.DBMSConnection  - Adding schema fldArea
INFO  DBMSConnection - Adding schema licence
272 [main] INFO connection.DBMSConnection  - Adding schema licence
INFO  DBMSConnection - Adding schema licence_area_poly_hst
282 [main] INFO connection.DBMSConnection  - Adding schema licence_area_poly_hst
INFO  DBMSConnection - Adding schema licence_licensee_hst
291 [main] INFO connection.DBMSConnection  - Adding schema licence_licensee_hst
INFO  DBMSConnection - Adding schema licence_oper_hst
301 [main] INFO connection.DBMSConnection  - Adding schema licence_oper_hst
INFO  DBMSConnection - Adding schema licence_petreg_licence
310 [main] INFO connection.DBMSConnection  - Adding schema licence_petreg_licence
INFO  DBMSConnection - Adding schema licence_petreg_licence_licencee
319 [main] INFO connection.DBMSConnection  - Adding schema licence_petreg_licence_licencee
INFO  DBMSConnection - Adding schema licence_petreg_licence_oper
329 [main] INFO connection.DBMSConnection  - Adding schema licence_petreg_licence_oper
INFO  DBMSConnection - Adding schema licence_petreg_message
339 [main] INFO connection.DBMSConnection  - Adding schema licence_petreg_message
INFO  DBMSConnection - Adding schema licence_phase_hst
350 [main] INFO connection.DBMSConnection  - Adding schema licence_phase_hst
INFO  DBMSConnection - Adding schema licence_task
359 [main] INFO connection.DBMSConnection  - Adding schema licence_task
INFO  DBMSConnection - Adding schema licence_transfer_hst
369 [main] INFO connection.DBMSConnection  - Adding schema licence_transfer_hst
INFO  DBMSConnection - Adding schema pipLine
382 [main] INFO connection.DBMSConnection  - Adding schema pipLine
INFO  DBMSConnection - Adding schema prlArea
388 [main] INFO connection.DBMSConnection  - Adding schema prlArea
INFO  DBMSConnection - Adding schema prlAreaSplitByBlock
400 [main] INFO connection.DBMSConnection  - Adding schema prlAreaSplitByBlock
INFO  DBMSConnection - Adding schema seaArea
405 [main] INFO connection.DBMSConnection  - Adding schema seaArea
INFO  DBMSConnection - Adding schema seaMultiline
413 [main] INFO connection.DBMSConnection  - Adding schema seaMultiline
INFO  DBMSConnection - Adding schema seis_acquisition
426 [main] INFO connection.DBMSConnection  - Adding schema seis_acquisition
INFO  DBMSConnection - Adding schema seis_acquisition_coordinates_inc_turnarea
436 [main] INFO connection.DBMSConnection  - Adding schema seis_acquisition_coordinates_inc_turnarea
INFO  DBMSConnection - Adding schema seis_acquisition_progress
446 [main] INFO connection.DBMSConnection  - Adding schema seis_acquisition_progress
INFO  DBMSConnection - Adding schema strat_litho_wellbore
453 [main] INFO connection.DBMSConnection  - Adding schema strat_litho_wellbore
INFO  DBMSConnection - Adding schema strat_litho_wellbore_core
457 [main] INFO connection.DBMSConnection  - Adding schema strat_litho_wellbore_core
INFO  DBMSConnection - Adding schema tuf_operator_hst
466 [main] INFO connection.DBMSConnection  - Adding schema tuf_operator_hst
INFO  DBMSConnection - Adding schema tuf_owner_hst
477 [main] INFO connection.DBMSConnection  - Adding schema tuf_owner_hst
INFO  DBMSConnection - Adding schema tuf_petreg_licence
486 [main] INFO connection.DBMSConnection  - Adding schema tuf_petreg_licence
INFO  DBMSConnection - Adding schema tuf_petreg_licence_licencee
496 [main] INFO connection.DBMSConnection  - Adding schema tuf_petreg_licence_licencee
INFO  DBMSConnection - Adding schema tuf_petreg_licence_oper
505 [main] INFO connection.DBMSConnection  - Adding schema tuf_petreg_licence_oper
INFO  DBMSConnection - Adding schema tuf_petreg_message
514 [main] INFO connection.DBMSConnection  - Adding schema tuf_petreg_message
INFO  DBMSConnection - Adding schema wellbore_casing_and_lot
523 [main] INFO connection.DBMSConnection  - Adding schema wellbore_casing_and_lot
INFO  DBMSConnection - Adding schema wellbore_coordinates
536 [main] INFO connection.DBMSConnection  - Adding schema wellbore_coordinates
INFO  DBMSConnection - Adding schema wellbore_core
547 [main] INFO connection.DBMSConnection  - Adding schema wellbore_core
INFO  DBMSConnection - Adding schema wellbore_core_photo
559 [main] INFO connection.DBMSConnection  - Adding schema wellbore_core_photo
INFO  DBMSConnection - Adding schema wellbore_development_all
572 [main] INFO connection.DBMSConnection  - Adding schema wellbore_development_all
INFO  DBMSConnection - Adding schema wellbore_document
587 [main] INFO connection.DBMSConnection  - Adding schema wellbore_document
INFO  DBMSConnection - Adding schema wellbore_dst
602 [main] INFO connection.DBMSConnection  - Adding schema wellbore_dst
INFO  DBMSConnection - Adding schema wellbore_exploration_all
608 [main] INFO connection.DBMSConnection  - Adding schema wellbore_exploration_all
INFO  DBMSConnection - Adding schema wellbore_formation_top
619 [main] INFO connection.DBMSConnection  - Adding schema wellbore_formation_top
INFO  DBMSConnection - Adding schema wellbore_mud
629 [main] INFO connection.DBMSConnection  - Adding schema wellbore_mud
INFO  DBMSConnection - Adding schema wellbore_npdid_overview
644 [main] INFO connection.DBMSConnection  - Adding schema wellbore_npdid_overview
INFO  DBMSConnection - Adding schema wellbore_oil_sample
653 [main] INFO connection.DBMSConnection  - Adding schema wellbore_oil_sample
INFO  DBMSConnection - Adding schema wellbore_shallow_all
664 [main] INFO connection.DBMSConnection  - Adding schema wellbore_shallow_all
INFO  DBMSConnection - Adding schema wlbPoint
674 [main] INFO connection.DBMSConnection  - Adding schema wlbPoint
INFO  DatabasePumperDB - Database pumped in 4 msec.
698 [main] INFO core.main.DatabasePumperDB  - Database pumped in 4 msec.

Add support for Timestamp column type

I'm getting errors on running ./build.sh Please HELP!!!

Please, I am trying to generate more datasets using VIG.

I get this error:

[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 9.531s
[INFO] Finished at: Thu Jun 29 06:34:07 PDT 2017
[INFO] Final Memory: 20M/167M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-javadoc-plugin:2.9.1:jar (attach-javadocs) on project vig-cpsolver: MavenReportException: Error while creating archive:
[ERROR] Exit code: 1 - javadoc: error - invalid flag: -Xdoclint:none
[ERROR]
[ERROR] Command line was: /usr/java/jdk1.7.0_67-cloudera/jre/../bin/javadoc @options @packages
[ERROR]
[ERROR] Refer to the generated Javadoc files in '/home/cloudera/Desktop/vig/vig-cpsolver/target/apidocs' dir.
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn -rf :vig-cpsolver
mkdir: cannot create directory vig-distribution/target/src/': No such file or directory mkdir: cannot create directory vig-distribution/target/src/main': No such file or directory
cp: cannot create directory `vig-distribution/target/src/main/': No such file or directory
[INFO] Scanning for projects...
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building vig-distribution 1.8.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-assembly-plugin:2.2-beta-5:single (default-cli) @ vig-distribution ---
Downloading: http://repo.maven.apache.org/maven2/it/unibz/inf/vig/dataPumper/1.8.0/dataPumper-1.8.0.pom
[WARNING] Missing POM for it.unibz.inf.vig:dataPumper:jar:1.8.0
[WARNING] Missing POM for it.unibz.inf.vig:dataPumper:jar:1.8.0
Downloading: http://repo.maven.apache.org/maven2/it/unibz/inf/vig/dataPumper/1.8.0/dataPumper-1.8.0.jar
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 3.713s
[INFO] Finished at: Thu Jun 29 06:34:12 PDT 2017
[INFO] Final Memory: 12M/106M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-assembly-plugin:2.2-beta-5:single (default-cli) on project vig-distribution: Failed to create assembly: Failed to resolve dependencies for project: it.unibz.inf.vig:vig-distribution:jar:1.8.0: Missing:
[ERROR] ----------
[ERROR] 1) it.unibz.inf.vig:dataPumper:jar:1.8.0
[ERROR]
[ERROR] Try downloading the file manually from the project website.

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.