Comments (3)
I've run into this issues a couple of time, and fixed it by forking the package internally and slightly modifying the uploadToS3
function to make it less stringent in the bucket checks. The items that fixed the issue for me were
- Setting the
check_region
kwarg as FALSE - Splitting the
bucket
arg (which I need to pass abucket/subfolder
string into to get the tool to write files to the proper location) so that it only grabs the bucket part
uploadToS3 = function(data, bucket, split_files, key, secret, session, region){
prefix=paste0(sample(rep(letters, 10),50),collapse = "")
if(!bucket_exists(strsplit(bucket, "/")[[1]][1], key=key, secret=secret, session=session, region=region, check_region=FALSE)){
stop("Bucket does not exist")
}
from redshifttools.
I cannot write also on the main bucket directory.
Would it be possible to specify a subfolder within the bucket? Otherwise will have to use "pandas_redshift" Python Library :(
Thanks! :)
from redshifttools.
Hi everyone,
Ended up using pandas_redshift to solve my issue. Thanks @jtelleriar!
from redshifttools.
Related Issues (20)
- rs_upsert_table() connection timeout HOT 1
- ERROR: Column length exceeds maximum allowed (maximum column length is 65535)
- upsert with column list HOT 6
- rs_create_table needs session_token argument on EC2 HOT 5
- Missing connection parameter on README HOT 2
- rs_replace_table error: Forbidden (HTTP 403) HOT 20
- rs_create_table only uploads half of records in dataframe HOT 6
- R: Error when I try to upload a data-frame to a new table in Redshift database HOT 1
- Download Function HOT 3
- load into table successfully, but reported error when deleting data in s3 HOT 2
- Error with curl? HOT 2
- AWS session token not found when using rs_create_table HOT 2
- Add error handling? HOT 1
- Error in parse_aws_s3_response(r, Sig, verbose = verbose) : Forbidden (HTTP 403). HOT 6
- pb_tick HOT 1
- UTF-8 character insert errors
- Archived on CRAN: Use paws R Library as dependency HOT 13
- Installation error: ‘redshiftTools’ is not available (for R version 4.0.0) HOT 2
- rs_create_table/rs_upsert_table error
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from redshifttools.