Comments (7)
I don't really remember (the use of this extension has been in place for over 3 years)
tbh, does it matter? clustering by JSON type fields is not at all possible in BQ. our two JSON fields (data, old_data) are therefore not part of the defined clustered fields.
the error does not make sense to me. it seems somehow internally the data/old_data fields are used in such a way that is incompatible with JSON type.
what also strikes me as odd, is the fact the errors seems to be randomly appearing, if it really was related to JSON types fields then I'd expect this error to occur for every firestore>bigquery event. but this is not the case.
from extensions.
I'll have a look back at the release commits and see if anything could have caused this to start happening. Thanks for providing all this info by the way!
I'll see if we can get this issue prioritised
from extensions.
This is strange to me, as we don't use the datatype JSON
as far as I know, data is saved in a raw string.
Do you have any more info on your Clustering you're able to provide?
from extensions.
Hi @cabljac,
thanks for your quick reply;
from extensions.
Was this schema solely generated by the extension?
from extensions.
could this error be related to the fact we updated the extension to version 0.1.51?
I'm unsure when we updated this extension however it must have been recently as this version was released on June 19th
from extensions.
wondering if you have an update on this?
from extensions.
Related Issues (20)
- 🐛 Stream Firestore to BigQuery - disable changelog HOT 1
- 🐛 [storage-resize-images] Extension crops the image with default settings. HOT 2
- 🐛 [storage-resize-images] Console error when trying to use the extension HOT 1
- 🐛 [firestore-translate-text] Error on updating Extension
- 🐛 [EXTENSION_NAME_HERE] allow schedule email
- 🐛 [firestore-translate-text] can not translate array field HOT 1
- 🐛 [firestore-bigquery-export] Task size too large errors occuring even with EXCLUDE_OLD_DATA set to yes/true HOT 3
- 🐛 [firestore-bigquery-export] Unhandled error PartialFailureError HOT 2
- [firestore-send-email] Only works on (default) database HOT 1
- 🐛 [firestore-bigquery-export] Explicitly target the firebase functions API HOT 7
- 🐛 [firestore-bigquery-export] Import Script Throws 'Request Entity Too Large'
- 🐛 [firestore-bigquery-export] Server returned 502 when mirroring data to BQ HOT 9
- 🐛 [firestore-bigquery-export] dataloss when reconfiguring extension HOT 3
- 🐛 [firestore-send-email] Workaround for deprecation of Outlook/Hotmail app passwords HOT 1
- 🐛 [Stream Firestore to BigQuery] When will you be supporting multi-db?? HOT 1
- 🐛 [Stream Firestore to BigQuery] Unable to stream Firestore DB to a different project HOT 1
- 🐛 [Stream Firestore to BigQuery] import script: allow to set transformFunction option
- 🐛 [Stream Firestore to BigQuery] gen-schema-view script: create optimal *view_latest query
- 🐛 [Stream Firestore to BigQuery] Limiting or Controlling the number of resources used for extension.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from extensions.