Comments (4)
Thanks @vbothe23 for filing this issue; are you using the FHIR-search mode or direct DB access when fetching resources? Is it possible that in the source FHIR server, there is also a Patient resource with id 82656
? This behavior is unexpected and the IDs should be preserved.
from fhir-data-pipes.
Hi @bashir2,
I am using JDBC mode to fetch the resources.
In the HAPI FHIR server, resource IDs are automatically generated by the system, even if we explicitly specify an ID during resource creation. These auto-generated IDs are stored in the hfj_resource
table, while explicitly specified IDs are stored in the hfj_forced_id
table. However, the pipeline relies on the IDs from the hfj_resource
table, leading to a discrepancy between the actual resource ID and the ID in the parquet file.
from fhir-data-pipes.
Thanks @vbothe23 for the clarification; yes this is a bug that we should fix. In the meantime you can use the FHIR search mode (i.e., avoid JDBC) and I believe that should return the original resource IDs.
from fhir-data-pipes.
This was fixed by #754 thanks @vbothe23.
from fhir-data-pipes.
Related Issues (20)
- NPE while trying to find StructureDefinition for a resource extensions that is missing.
- Integrate FHIR Bulk export API with data-pipes
- Add config to change the pipeline controller cron schedule timezone HOT 1
- add config to override the default 100 batch size for server queries HOT 1
- Add last run time and purging schedule to the pipeline contoller UI
- Various documentations
- Feature Request: Options to rerun pipelines for selective date ranges HOT 2
- Feature Request: Pipeline Failure Notifications
- Relook at the `recursiveDepth` parameter
- Fix the number of parquet files generation for Direct Runner
- Create a Util Function for testing Resources in the FHIR store
- Add ability to turn on /off parquet file generation in case of syncying fhir to fhir server
- Support BULK_EXPORT mode of fetching FHIR resources for Incremental Run
- Controller maven module unit tests in `Junit 4` does not report coverage correctly
- Make sure all `DoFn`s are idempotent
- Migrate all unit test cases to Junit 5 platform HOT 5
- Change the default for batchSize to 3000
- FhirEtl misses resources HOT 9
- Support Parquet as an option for output flat views
- Extra Documentation for mapping ViewDefinitions to DB tables
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from fhir-data-pipes.