Comments (10)
Thanks for providing this. Right now the code and documentation we provide is postgreSQL-centric. We did't have SQL Server or Oracle to test those systems.
In order to properly support SQL Server and perhaps Oracle, we would need revised documentation that breaks out the documentation and SQL code into database-specific tracks. Please feel free to do this and initiate a pull request.
Note, there are other repositories that we swiped from to include the SQL code we did, making small modifications to make everything work with OMOP V5.0.0. In the long run it would probably be better to not duplicate across repositories the code to create the database, load the data and vocabulary files, create indices and create constraints. We compromised on this to have most things you needed to get up and running with the synpuf data, but it is probably going to bite us in the long run.
I was dismayed to find that the change from 5.0.0 to 5.0.1 of the OMOP CDM not only changed some fields but deleted and added new tables -- to me that is not a bug-fix release, as it breaks compatibility. In any event, going forward we need a way to maintain compatibility with not only OMOP CDM versions but also database systems (and versions). For instance, unlike with version 9.2, which we used, PostgreSQL 9.5 provides support for bulk-loading gzipped .csv files, removing the inconvenience of having to uncompress these huge files.
from etl-cms.
Thanks @ChristopheLambert. That makes sense. I figured I'd share whatever I've done so far since we are using SQL Server. Btw, do you have the ACHILLES JSON files for this data set?
from etl-cms.
Hi @cukarthik
We do have the ACHILLES JSON files -- are they something helpful to post, or would they be site configuration specific?
from etl-cms.
Hi @ChristopheLambert ,
It would be helpful for us. We are setting up the synpuf 1 percent database for some students. If you have the JSON files, could we download them somewhere? Thanks.
from etl-cms.
We are re-creating to ensure it matches that of the uploaded data. Are you wanting the JSON files for the full dataset or just the first 1/20th subset or both?
from etl-cms.
Just the first 1/20th. Eventually we might want the full set.
Thanks
Sent from my phone
On Aug 27, 2016, at 12:44 AM, Christophe Lambert <[email protected]mailto:[email protected]> wrote:
We are re-creating to ensure it matches that of the uploaded data. Are you wanting the JSON files for the full dataset or just the first 1/20th subset or both?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com//issues/29#issuecomment-242869546, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AMakuU2wW3qjRwEGfCxM-c5f1uKzXGr5ks5qj2xlgaJpZM4JsWs_.
from etl-cms.
I uploaded a zip file containing the JSON files for AchillesWeb for the first 1/20th of the data here: ftp://ftp.ohdsi.org/synpuf/AchillesExport_1.zip
Please let me know if these work for you.
from etl-cms.
Hi @cukarthik,
It would be helpful if you can share "create_CDMv5_drug_era_non_stockpile.sql" and "create_CDMv5_condition_era.sql" sql scripts for SQL server. Thanks.
from etl-cms.
Hi @rsurdikar,
Unfortunately, we do not have those scripts since we did not include them in our database.
from etl-cms.
Thanks for the response.
from etl-cms.
Related Issues (20)
- Column mismatch in create_CDMv5_tables.sql and load_CDMv5_vocabulary.sql HOT 1
- Error on Step 5 of Python ETL process HOT 2
- Person ID as integer, CMS's synthetic data has string IDs HOT 1
- CMS RIF to OMOP ETL? HOT 2
- CMS ACO CCLF --> OMOP V5 HOT 1
- md5 sums don't match files - https://github.com/OHDSI/ETL-CMS/blob/master/python_etl/README.md HOT 4
- Issue while running python code to get the claims data HOT 6
- Memory issue of steps 5 in ETL Script HOT 9
- drug_era, observation_period, cost column mismatch HOT 5
- Update ETL logic to support CDM 6.X HOT 5
- CDMv5.2 is not accessible HOT 2
- KeyError: 'Place of Service' HOT 3
- location_id is null for all care_site records HOT 3
- missing 'DE1_0_2010_Beneficiary_Summary_File_Sample_1.zip' HOT 5
- FTP server down? HOT 1
- Downloading final data HOT 1
- Incorrect URL to one source Synpuf file HOT 5
- Updating to newer CDM versions + upload R script available HOT 1
- key error '40213148'
- Convert CMS SynPUF to OMOP v5.4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from etl-cms.