Character encoding issues with text fields

  • NickDech
  • Topic Author
  • Visitor
  • Visitor
10 years 3 months ago #9904 by NickDech
I'm having a hard time inserting text fields using the driver with SSIS. If I insert rows across the linked server, they insert fine and I have no encoding issues, however when I use SSIS, my text fields aren't being stored properly whenever the source data type is DT_NTEXT. ( If I use DT_WSTR my data gets truncated at 255 characters but the characters are stored correctly).

Text that is supposed to this:
"†As rated by engine manufacturers.
*#07124043 A $109.99 value. Offer valid thru 3/17/12.
††Plus any attachment purchased with tractor will be delivered and set up for free
If you find a tractor, mower or line trimmer at your local Lowe’s or The Home Depot store with a lower price (at least $1.00 lower) and the same features as the comparable Craftsman model (as determined by the Sears Yard Guru tool available at <!-- w --> www.searsyardguru.com <!-- w -->), then Sears will match the price and give you a gift card up to $100 for use on a future purchase. ($50 for eligible items $1,299.99 and below, $100 for eligible items $1,300.00 and above). Customer must purchase the qualifying Craftsman model mower, or tractor to be eligible. See store or sears.com for full details.&quot;

Appears in Postgres as this ( shortened for brevity ):
&quot;&lt;\\000p\\000l\\000u\\000s\\000&gt;\\000A\\000s\\000 \\000r\\000a\\000t\\000e\\000d\\000 \\000b\\000y\\000 \\000e\\000n\\000g\\000i\\000n\\000e\\000 \\000m\\000a\\000n\\000u\\000f\\000a\\000c\\000t\\000u\\000r\\000e\\000r\\000s\\000.\\000\\134\\000\\134\\000r\\000\\134\\000\\134\\000n\\000*\\000#\\0000\\0007\\0001\\0002\\0004\\0000\\0004\\0003\\000 \\000A\\000 \\000$\\0001\\0000\\0009\\000.\\0009\\0009\\000 \\000v\\000a\\000l\\000u\\000e\\000.\\000 \\000O\\000f\\000f\\000e\\000r\\000 \\000v\\000a\\000l\\000i\\000d\\000 \\000t\\000h\\000r\\000u\\000 \\0003\\000/\\0001\\0007\\000/\\0001\\0002\\000.\\000\\134\\000\\134\\000r\\000\\134\\000\\134\\000n\\000&lt;\\000p\\000l\\000u\\000s\\000&gt;\\000&lt;\\000p\\000l\\000u\\000s\\000&gt;\\000P\\000l\\000u\\000s\\000 \\000a\\000n\\000y\\000 \\000a\\000t\\000t\\000a\\000c\\000h\\000m\\000e\\000n\\000t\\000&quot;


Anyone have any ideas?

Please Log in or Create an account to join the conversation.

More
10 years 3 months ago #9906 by Moderator
Replied by Moderator on topic Re: Character encoding issues with text fields
I will try to reproduce it. Could you send any details on table(s) DDL, test package, etc. to Support? It will reduce amount of time for us to reproduce and fix the bug. Thank you!

Please Log in or Create an account to join the conversation.

  • NickDech
  • Topic Author
  • Visitor
  • Visitor
10 years 2 months ago #9912 by NickDech
Replied by NickDech on topic Re: Character encoding issues with text fields
An update to this;

I was unable to get around this encoding issue for any varchar field above 4000 characters. Once my destination data type became larger than nvarchar(4000) ( a text blob ), the encoding issues would come up.

Please Log in or Create an account to join the conversation.

More
10 years 1 month ago #9915 by Moderator
Replied by Moderator on topic Re: Character encoding issues with text fields
We added support for COPY WITH BINARY, and reworked the insertion related code. It affected FastLoad and BULK_METHOD=COPY.

When a Greenplum database is detected, the provider falls back to COPY WITH CSV mode.

Please use build 3142 or later.

Please Log in or Create an account to join the conversation.

Time to create page: 0.142 seconds
Powered by Kunena Forum