S3 connection error with Redshift provider

Redshift related discussions

S3 connection error with Redshift provider

Postby danielbos » Sat Nov 23, 2013 9:59 am

Hi all,

I have created a SSIS package with OLE DB connections which inserts data to a simple table. I wanted to test the speed of the PGNP Redshift connector.

Since PGNP also uses the COPY command I have set the S3 information like:

Bulk insert method: Copy command
Bulk insert buffer size: 1000000
AWS Access Key: myaccesskey
AWS Secret Key: mysecretkey
AWS Bucket: s3:\\mybucketname

When I test the package I'll get an error:
[OLE DB Destination [2]] Error: SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80004005.
An OLE DB record is available. Source: "Redshift OLE DB Provider" Hresult: 0x80004005 Description: "ERROR: S3ServiceException:The specified bucket does not exist,Status 404,Error NoSuchBucket

What am I doing wrong? I have set various versions of the AWS Bucket: for example just mybucketname or s3://mybucketname or s3:\\mybucketname\

Could you help me out?

Daniel
danielbos
 
Posts: 8
Joined: Fri Oct 18, 2013 2:19 pm

Re: S3 connection error with Redshift provider

Postby Moderator » Sun Nov 24, 2013 10:53 am

Hi Daniel,
please do not add any prefix to the bucket name, just keep it as "mybucketname".

Also, I do not recommend using bulk insert size of 1000000. Depending on a row size, it could stress RAM. Start with 10000, and see if it satisfies your performance goal.

Best regards,
Moderator
User avatar
Moderator
Site Admin
 
Posts: 297
Joined: Wed Oct 29, 2008 11:27 pm

Re: S3 connection error with Redshift provider

Postby danielbos » Sun Nov 24, 2013 2:46 pm

That did the trick!

Thanks!
danielbos
 
Posts: 8
Joined: Fri Oct 18, 2013 2:19 pm


Return to Redshift OLE DB Provider

Who is online

Users browsing this forum: No registered users and 1 guest