garbled e-mail and charset

Discuss your pilot or production implementation with other Zimbra admins or our engineers.
samotrak
Posts: 23
Joined: Fri Sep 12, 2014 10:09 pm

garbled e-mail and charset

Post by samotrak »

Hello all,
Sometimes I receive garbled e-mails, if they contain Japanese characters and charset is “shift-jis”.

Most of Japanese mails have “iso-2022-jp" as charset and they look no problem.
Does anybody have the similar problem and workaround?
Problem occurs if mail header has,

Content-Type: text/plain; charset="shift_jis"

Content-Transfer-Encoding: 8bit
Problem does not occur if mail header has,

Content-Type: text/plain; charset="iso-2022-jp"

Content-Transfer-Encoding: 7bit
Thanks,
dkarp
Elite member
Elite member
Posts: 1410
Joined: Fri Sep 12, 2014 9:52 pm

garbled e-mail and charset

Post by dkarp »

Any chance you might be able to post a sample "shift_jis" message? It'd make it easier to debug...
samotrak
Posts: 23
Joined: Fri Sep 12, 2014 10:09 pm

garbled e-mail and charset

Post by samotrak »

Thank you for reply. Here is a sample message. Regards,
Received: from localhost (localhost.localdomain [127.0.0.1])

by zimbra01.zimbra.alpha.com (Postfix) with ESMTP id E2072367510

for ; Tue, 18 Jul 2006 01:56:42 -0700 (PDT)

Received: from zimbra01.zimbra.alpha.com ([127.0.0.1])

by localhost (zimbra01.zimbra.alpha.com [127.0.0.1]) (amavisd-new, port 10024)

with ESMTP id 03851-03 for ;

Tue, 18 Jul 2006 01:56:40 -0700 (PDT)

Received: from smtp.zeta.com (unknown [192.168.100.3])

by zimbra01.zimbra.alpha.com (Postfix) with ESMTP id C8EE536750F

for ; Tue, 18 Jul 2006 01:56:39 -0700 (PDT)

Received: by smtp.zeta.com from localhost

(router,SLmail V5.1); Tue, 18 Jul 2006 02:04:45 -0700

for

Received: from vsxkg003.ocn.ad.jp [210.232.239.92]

by smtp.zeta.com [192.168.100.3] (SLmail 5.5.0.4433) with ESMTP

id A5B56D21E1CA45A2843EF72EB5ED43AA

for plus 2 more; Tue, 18 Jul 2006 02:04:16 -0700

Received: from sgc001.ocn.ne.jp (vc-kg006.ocn.ad.jp [211.129.15.79])

by vsxkg003.ocn.ad.jp (Postfix) with SMTP

id 8ACD8121; Tue, 18 Jul 2006 18:03:46 +0900 (JST)

Received: from MP00385 (unknown [61.213.51.9])

by sgc001.ocn.ne.jp (Postfix) with SMTP

id DF906FD2; Tue, 18 Jul 2006 18:03:45 +0900 (JST)

From: "Sei Sato"

To: ,

"'Yamaguchi'" ,



Cc: "Fukuoka" ,

"Tanabe" ,

"Campbell"

Subject: RE: One Media

Date: Tue, 18 Jul 2006 18:06:17 +0900

Message-ID:

MIME-Version: 1.0

Content-Type: text/plain;

charset="shift_jis"

Content-Transfer-Encoding: 8bit

X-Priority: 3 (Normal)

X-MSMail-Priority: Normal

X-Mailer: Microsoft Outlook IMO, Build 9.0.2416 (9.0.2911.0)

X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1807

In-reply-to:

Importance: Normal


X-SLUIDL: 70FD78E2-B8D24ADF-B00DADA6-66AEAB4E

X-DSPAM-Result: Innocent

X-DSPAM-Processed: Tue Jul 18 01:56:40 2006

X-DSPAM-Confidence: 0.9997

X-DSPAM-Probability: 0.0000

X-DSPAM-Signature: 44bca24828781804284693

X-DSPAM-Factors: 27,

X-Virus-Scanned: amavisd-new at

X-Spam-Status: No, score=-2.214 tagged_above=-10 required=6.6 autolearn=ham

tests=[AWL=0.350, BAYES_00=-2.599, DSPAM_HAM=-0.1, FORGED_RCVD_HELO=0.135]

X-Spam-Score: -2.214

X-Spam-Level:
?R :?3?q?AMANY?@TKS?B
TO?@?cg2?3?q?ALogitech?F?L?#

??d

r?pOneMedia?I?.?f :?3?"?B


2?!


-----Original Message-----

From: yamashita@beta.co.jp

[mailto:yamashita@beta.co.jp]

Sent: Tuesday, July 18, 2006 4:36 PM

To: 'Sato'; 'Yamaguchi'; ito@beta.co.jp

Subject: One Media


One Media?B?l?I?I?q?m?I?;?!?L? ?i?T?[?r?X?E?7?B

?H :FYI.

http://japan.internet.com/wmnews/2006/4.html?rss
Zimbra7659-10025.doc
dkarp
Elite member
Elite member
Posts: 1410
Joined: Fri Sep 12, 2014 9:52 pm

garbled e-mail and charset

Post by dkarp »

It'd be better if you posted the message as an attachment. Just click on the "Manage Attachments" button in the "Additional Options" section right below where you enter a new posting...
samotrak
Posts: 23
Joined: Fri Sep 12, 2014 10:09 pm

garbled e-mail and charset

Post by samotrak »

Hi, I added the attachment in my previous comment. Thank you!
iwoodnt
Posts: 7
Joined: Fri Sep 12, 2014 10:14 pm

garbled e-mail and charset

Post by iwoodnt »

has this been addressed? I have also noticed that attachment names are encoded in UTF-8 and this causes problems when the attachment name is in Japanese. I have had garbled text in both Thunderbird (Japanese version) and on hotmail.

The body can be viewed by manually changing the character encoding of the viewer (tbird or firefox in my case) but the attachment stays garbled.

I am over the moon that I have zimbra up and running, but this is a real problem for me as most mails that will run on the server will be in Japanese.
Is there a workaround such as changing the default encoding?
dkarp
Elite member
Elite member
Posts: 1410
Joined: Fri Sep 12, 2014 9:52 pm

garbled e-mail and charset

Post by dkarp »

[quote user="samotrak"]Thank you for reply. Here is a sample message.[/QUOTE]

That message isn't valid shift_jis. It looks like something -- probably an MTA -- has stripped off the high bits of your 8-bit content. And the result is not parseable as shift_jis.
iwoodnt
Posts: 7
Joined: Fri Sep 12, 2014 10:14 pm

garbled e-mail and charset

Post by iwoodnt »

thanks for the reply. I suppose I will just have to rename attachments into alphanumerics until the servers can handle the attachments properly.
samotrak
Posts: 23
Joined: Fri Sep 12, 2014 10:09 pm

garbled e-mail and charset

Post by samotrak »

Hi dkarp and iwoodnt,
Thank you for your follow-up.
[QUOTE]That message isn't valid shift_jis. It looks like something -- probably an MTA -- has stripped off the high bits of your 8-bit content. And the result is not parseable as shift_jis.[/QUOTE]
Umm... probably.

But does it mean ZCS must be able to handle "shift-JIS" with 8bit encoding correctly?
samotrak
dkarp
Elite member
Elite member
Posts: 1410
Joined: Fri Sep 12, 2014 9:52 pm

garbled e-mail and charset

Post by dkarp »

[quote user="samotrak"]But does it mean ZCS must be able to handle "shift-JIS" with 8bit encoding correctly?[/QUOTE]

If a message makes it to the Zimbra server with 8bit shift_jis content intact, Zimbra will handle and display it properly.
Post Reply