Comments (8)
verganis, I'm just putting my hands again on this project.
Almost all bug were fixed. This is hard to fix because the script doesn't actually parse the values but just dumps what is received from the RESTful request...
I'll work on it.
Any suggestion is welcome.
from couchdb-dump.
Thanks for the work, at the moment I am working on other stuff but if I have some suggestion I will let you know
from couchdb-dump.
I've got the same problem
I will try to figure a way out to fix this
from couchdb-dump.
great @soupdiver, some help is really appreciated.
from couchdb-dump.
I encountered the same issue... Is it going to get fixed soon?
from couchdb-dump.
This is actually transforming the data from couch incorrectly. Here are some notes:
Run CouchDB and connect to it. Create a new database "test". In it, create a new document with the following field:
"value": "This is 1/3" wide"
From the command line, run:
curl -X GET http://localhost:5984/test/_all_docs?include_docs=true
And the output is:
{"total_rows":1,"offset":0,"rows":[
{"id":"95136710703bd4e669379b8a45000030","key":"95136710703bd4e669379b8a45000030","value":{"rev":"1-a522fffb20829f8899bd60c8ef456271"},"doc":{"_id":"95136710703bd4e669379b8a45000030","_rev":"1-a522fffb20829f8899bd60c8ef456271","value":"This is 1/3\" wide"}}
]}
Notice that the string still contains a backslash.
On the otherhand this:
couchdb-dump.sh localhost test
returns this:
{"docs":[
{"_id":"95136710703bd4e669379b8a45000030","_rev":"1-a522fffb20829f8899bd60c8ef456271","value":"This is 1/3" wide"}
]
}
Notice the backslash is now gone.
Here's running the script using bash -x:
$ bash -x couchdb-dump.sh localhost test
+ '[' 2 -lt 2 ']'
+ '[' 2 -gt 2 ']'
+ url=localhost
+ db_name=test
+ i=0
+ read json
+++ curl -X GET 'http://localhost:5984/test/_all_docs?include_docs=true'
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 299 0 299 0 0 51882 0 --:--:-- --:--:-- --:--:-- 59800
++ echo '{"total_rows":1,"offset":0,"rows":[
{"id":"95136710703bd4e669379b8a45000030","key":"95136710703bd4e669379b8a45000030","value":{"rev":"1-a522fffb20829f8899bd60c8ef456271"},"doc":{"_id":"95136710703bd4e669379b8a45000030","_rev":"1-a522fffb20829f8899bd60c8ef456271","value":"This is 1/3\" wide"}}
]}'
+ '[' 0 -eq 0 ']'
+ echo '{"docs":['
{"docs":[
+ echo ''
+ echo ''
+ let 'i += 1'
+ read json
+ '[' 1 -eq 0 ']'
+ rm provino.txt out.txt
+ echo '{"id":"95136710703bd4e669379b8a45000030","key":"95136710703bd4e669379b8a45000030","value":{"rev":"1-a522fffb20829f8899bd60c8ef456271"},"doc":{"_id":"95136710703bd4e669379b8a45000030","_rev":"1-a522fffb2'829f8899bd60c8ef456271","value":"This' is '1/3"' 'wide"}}
+ sed 's/.$//'
+ cat provino.txt
+ sed 's/{\"id\":.*,\"key\".*,\"value\":.*,\"doc\"://'
+ sed 's/},$/,/'
+ sed 's/}$//'
+ cat out.txt
{"_id":"95136710703bd4e669379b8a45000030","_rev":"1-a522fffb20829f8899bd60c8ef456271","value":"This is 1/3" wide"}
+ let 'i += 1'
+ read json
+ '[' 2 -eq 0 ']'
+ rm provino.txt out.txt
+ echo ']}'
+ sed 's/.$//'
+ cat provino.txt
+ sed 's/{\"id\":.*,\"key\".*,\"value\":.*,\"doc\"://'
+ sed 's/},$/,/'
+ sed 's/}$//'
+ cat out.txt
]
+ let 'i += 1'
+ read json
+ echo '}'
}
+ rm provino.txt out.txt
Hope this info helps with debugging this.
from couchdb-dump.
Nicholas thank you for the detailed debugging.
I think I fixed the bug.
The problem was the read command at line #59 which was escaping the 'value' contents.
I added the -r option and now it works with the use case you provided.
I would be grateful if you could do a quick test to confirm me it works.
best
from couchdb-dump.
This is confirmed to be fixed in #8 - can close.
from couchdb-dump.
Related Issues (20)
- Backup / restore all databases? HOT 4
- Stuck at 'Stage 1 - Document filtering' HOT 6
- Taking backup for all revisions HOT 1
- Is it possible to set the password with a environment variable? HOT 4
- ERROR: Curl encountered an issue whilst dumping the database HOT 1
- Backup exits with exitcode 1 in silent mode HOT 1
- can dump all revisions docs HOT 4
- Error when restoring: POST body must include `docs` parameter. HOT 4
- Document update conflict upon restore HOT 3
- couchdb-dump doesn't work with busybox's grep anymore HOT 1
- Backup all databases HOT 9
- Invalid UTF-8 JSON error while restoring large file HOT 5
- Restore backup into non-empty database HOT 1
- Backup does not work with pouchdb-server
- Question: How does the restore handle duplicate data? HOT 1
- compilation_error when attempting to restore database
- CouchDB Reported error, need some advice on how to debug HOT 1
- How can exclude some databases from backup? HOT 1
- Nice to have a 'drop database' option
- Intermittent backup issue HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from couchdb-dump.