Comments (2)
I'd suggest you upload your data frame in pieces to reduce the possibility of this error happening. Also i'd use some scheduler which has retries like airflow, the error you see is just random HTTPS failures happening while sending the data to Amazon S3, not much we can do from the package side about that i think
from redshifttools.
@sicarul Thanks for the suggestion. I had this idea myself yesterday and it worked, I just looped through the segments of the dataset in stages. I'll close.
from redshifttools.
Related Issues (20)
- rs_upsert_table() connection timeout HOT 1
- ERROR: Column length exceeds maximum allowed (maximum column length is 65535)
- upsert with column list HOT 6
- rs_create_table needs session_token argument on EC2 HOT 5
- Missing connection parameter on README HOT 2
- rs_replace_table error: Forbidden (HTTP 403) HOT 20
- rs_create_table only uploads half of records in dataframe HOT 6
- R: Error when I try to upload a data-frame to a new table in Redshift database HOT 1
- Download Function HOT 3
- load into table successfully, but reported error when deleting data in s3 HOT 2
- AWS session token not found when using rs_create_table HOT 2
- Add error handling? HOT 1
- Error in parse_aws_s3_response(r, Sig, verbose = verbose) : Forbidden (HTTP 403). HOT 6
- S3 Bucket not found HOT 3
- pb_tick HOT 1
- UTF-8 character insert errors
- Archived on CRAN: Use paws R Library as dependency HOT 13
- Installation error: ‘redshiftTools’ is not available (for R version 4.0.0) HOT 2
- rs_create_table/rs_upsert_table error
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from redshifttools.