6.0.0-beta1
7/22/25

[#5262] quoted message part gets cut after Umlauts (solaris)
Summary quoted message part gets cut after Umlauts (solaris)
Queue DIMP
Type Bug
State Not A Bug
Priority 2. Medium
Owners
Requester adrieder (at) sbox (dot) tugraz (dot) at
Created 04/17/2007 (6671 days ago)
Due 04/18/2007 (6670 days ago)
Updated 05/21/2007 (6637 days ago)
Assigned 05/10/2007 (6648 days ago)
Resolved 05/21/2007 (6637 days ago)
Github Issue Link
Github Pull Request
Milestone
Patch No

History
05/21/2007 05:19:17 PM Chuck Hagenbuch Comment #31
Summary ⇒ quoted message part gets cut after Umlauts (solaris)
State ⇒ Not A Bug
Reply to this comment
I think this is going to be something that's just awkward on Solaris, 
like a lot of other gettext stuff, unfortunately.
05/21/2007 05:07:19 PM adrieder (at) sbox (dot) tugraz (dot) at Comment #30 Reply to this comment
Can you be more specific about what you had to install? Why do you
think the locales are unnecessary, and why do you think other users
can't necessarily do what you did?
well, for Solaris 10 I had to install the region packages ceu, weu, 
neu, eeu, sue, sam, cam and nam locale packages using localeadm. Which 
then installs the complete locales including lc_message for that 
regions (weu eg. is western europe). This adds a lot of stuff to the 
system which is not really needed there e.g. LC_MESSAGES for X11 progs 
e.g. evolution, gnome, gimp etc. those programs are not installed on 
the system. So to me the MESSAGES in any language are not necessary.



Users on systems without root access, will have problems to install 
those packages.



For Solaris 9 I installed the following packages:



SUNW1251f SUNW5xmft SUNWarrf SUNWceudt SUNWceuos SUNWceuow SUNWceuox 
SUNWcxmft SUNWeeudt SUNWeeuos SUNWeeuow SUNWeeuox SUNWeu8df SUNWeu8os 
SUNWeu8ox SUNWeudba SUNWeudda SUNWeudhr SUNWeudis SUNWeudiv SUNWeudlg 
SUNWeudmg SUNWeuezt SUNWeuhed SUNWeuluf SUNWeulux SUNWeuodf SUNWeurf 
SUNWeuxwe SUNWi13cs SUNWi13rf SUNWi15cs SUNWi15rf SUNWi1cs SUNWi1of 
SUNWi2cs SUNWi2rf SUNWi4rf SUNWi5cs SUNWi5rf SUNWi7cs SUNWi7rf 
SUNWi8rf SUNWi9cs SUNWi9rf SUNWinttf SUNWislcc SUNWislcx SUNWjxmft 
SUNWkxmft SUNWneudt SUNWneuos SUNWneuow SUNWneuox SUNWplow SUNWplow1 
SUNWseudt SUNWseuos SUNWseuow SUNWseuox SUNWtxfnt SUNWuiu8 SUNWuiu8x 
SUNWulcf SUNWulcfx SUNWulocf SUNWuxlcf SUNWuxlcx SUNWweudt SUNWweuos 
SUNWweuow SUNWweuox



with the same overhead as for Solaris 10.



Didi
05/21/2007 03:29:48 PM Chuck Hagenbuch Comment #29 Reply to this comment
Ok, I was able to solve this problem by installing a lot of
additional (and basically elsewhere unneeded) locales. But I think
this is not always possible for a user.
Can you be more specific about what you had to install? Why do you 
think the locales are unnecessary, and why do you think other users 
can't necessarily do what you did?
05/21/2007 09:00:02 AM Michael Slusarz Comment #28 Reply to this comment
+1 for requiring unicode support.
05/21/2007 07:40:43 AM adrieder (at) sbox (dot) tugraz (dot) at Comment #27 Reply to this comment
Ok, I was able to solve this problem by installing a lot of additional 
(and basically elsewhere unneeded) locales. But I think this is not 
always possible for a user.
05/16/2007 09:13:50 AM adrieder (at) sbox (dot) tugraz (dot) at Comment #26 Reply to this comment
So it exactly what I assumed in the beginning. Your server doesn't
support UTF-8 locales and DIMP doesn't work with non-UTF-8 locales.
And the question still is, do we want to support such systems, like
we still do with other Horde apps, or do we set this as a requirement?
supporting such systems would be nice on one hand, on the other I'd 
like to know how to enable the UTF-8 support on the server (Solaris 9, 
Solaris 10)


05/16/2007 08:44:36 AM Jan Schneider Comment #25 Reply to this comment
So it exactly what I assumed in the beginning. Your server doesn't 
support UTF-8 locales and DIMP doesn't work with non-UTF-8 locales.

And the question still is, do we want to support such systems, like we 
still do with other Horde apps, or do we set this as a requirement?
05/16/2007 08:17:09 AM adrieder (at) sbox (dot) tugraz (dot) at Comment #24 Reply to this comment
And the other apps?
also ISO-8859-1
only the various test.php pages come back in UTF-8
05/14/2007 10:12:53 AM adrieder (at) sbox (dot) tugraz (dot) at Comment #23 Reply to this comment
And the other apps?
also ISO-8859-1
05/14/2007 10:01:35 AM Jan Schneider Comment #22 Reply to this comment
And the other apps?
05/14/2007 09:14:16 AM adrieder (at) sbox (dot) tugraz (dot) at Comment #21 Reply to this comment
But what is the charset that your browsers see if you enter DIMP vs.
other Horde apps?
Hmm... Western ISO-8859-1
05/14/2007 09:00:00 AM Jan Schneider Comment #20 Reply to this comment
But what is the charset that your browsers see if you enter DIMP vs. 
other Horde apps?
05/11/2007 10:55:19 AM adrieder (at) sbox (dot) tugraz (dot) at Comment #19 Reply to this comment
Strange, your Horde login screen comes back in utf-8 just fine. Any
chance that you use some exotic browser? Did you try another?
Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.3) Gecko/20070309
Firefox/2.0.0.3
Opera/9.20 (X11; Linux i686; U; en)
Firefox 1.5.0.7 on Win XP/SP2
Firefox 1.5.0.11 on Win XP/SP2 (Gecko/20070312 Firefox/1.5.0.11)
MS IE 6.0 WinXP/SP2 shows the same behaviour.

I think it's not the Browser....


05/10/2007 09:42:40 PM adrieder (at) sbox (dot) tugraz (dot) at Comment #18 Reply to this comment
Strange, your Horde login screen comes back in utf-8 just fine. Any
chance that you use some exotic browser? Did you try another?
Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.3) Gecko/20070309 
Firefox/2.0.0.3

Opera/9.20 (X11; Linux i686; U; en)

Firefox 1.5.0.7 on Win XP/SP2

Firefox 1.5.0.11 on Win XP/SP2 (Gecko/20070312 Firefox/1.5.0.11)



I hope they are not to exotic :-)


05/10/2007 07:42:50 PM Jan Schneider Comment #17
State ⇒ Feedback
Reply to this comment
Strange, your Horde login screen comes back in utf-8 just fine. Any 
chance that you use some exotic browser? Did you try another?
05/10/2007 05:14:28 PM adrieder (at) sbox (dot) tugraz (dot) at Comment #16 Reply to this comment
I guess the question is, why isn't utf-8 being used? Lack of
iconv/mbstring on the server to convert it?
mbstring is compiled in and enabled:



from php_nfo()



Multibyte Support         enabled

Multibyte string engine         libmbfl

Multibyte (japanese) regex support         enabled

Multibyte regex (oniguruma) version         4.4.4

Multibyte regex (oniguruma) backtrack check         On



mbstring extension makes use of "streamable kanji code filter and 
converter", which is distributed under the GNU Lesser General Public 
License version 2.1.



Directive        Local Value        Master Value

mbstring.detect_order        no value        no value

mbstring.encoding_translation        Off        Off

mbstring.func_overload        0        0

mbstring.http_input        pass        pass

mbstring.http_output        pass        pass

mbstring.internal_encoding        no value        no value

mbstring.language        neutral        neutral

mbstring.strict_detection        Off        Off

mbstring.substitute_character        no value        no value



you can check that also under:  https://webmail.tugraz.at/horde/test.php
05/10/2007 04:33:38 PM Chuck Hagenbuch Comment #15 Reply to this comment
Yes, JSON must be utf-8 (or an ascii subset).
05/10/2007 04:32:23 PM Jan Schneider Comment #14 Reply to this comment
Because the server OS doesn't support it. That's not an issue usually, 
though they will loose all benefits of using Unicode. But there might 
be a problem with JSON that MUST be Unicode. Could be an issue with 
mixing a non-utf interface with utf-8 javascript or some such.
05/10/2007 04:23:56 PM Chuck Hagenbuch Comment #13 Reply to this comment
I guess the question is, why isn't utf-8 being used? Lack of 
iconv/mbstring on the server to convert it?
05/10/2007 03:34:19 PM Jan Schneider Comment #12 Reply to this comment
The important information from your screenshot is, that you your pages 
are not displayed in UTF-8.



I wonder if we should take the hassle of supporting non-utf platforms at all.
05/10/2007 02:56:14 PM adrieder (at) sbox (dot) tugraz (dot) at Comment #11
New Attachment: dimp_umlauts_messageview2.png Download
Reply to this comment
next shot



(sorry for so many messages, but I don't know how to attach more than 
one file at once)
05/10/2007 02:55:05 PM adrieder (at) sbox (dot) tugraz (dot) at Comment #10
New Attachment: dimp_umlauts_messageview.png Download
Reply to this comment
next shot


05/10/2007 02:54:17 PM adrieder (at) sbox (dot) tugraz (dot) at Comment #9
New Attachment: dimp_umlauts_mboxlist2.png Download
Reply to this comment
next shot


05/10/2007 02:52:50 PM adrieder (at) sbox (dot) tugraz (dot) at Comment #8
New Attachment: dimp_umlauts_mboxlist.png Download
Reply to this comment
Here are some screenshots, to illustrate how it looks like.

I discovered that in the message view (double clicking on the subject) 
the text does not get truncated when a German Umlaut is present. It 
happens only in the mboxlist view. Note, that also the fullname gets 
truncated if there is an Umlaut, see dimp_umlauts_mboxlist.png.




05/03/2007 01:09:12 PM adrieder (at) sbox (dot) tugraz (dot) at Comment #7 Reply to this comment
Unless you can trace down exactly in the code where this is
happening, we can't do anything about this since it works fine for
everyone else.
OK, I'll see that I find something...

Thx
05/03/2007 12:16:51 PM Michael Slusarz Comment #6
Taken from Michael Slusarz
State ⇒ No Feedback
Reply to this comment
Unless you can trace down exactly in the code where this is happening, 
we can't do anything about this since it works fine for everyone else.
04/30/2007 02:33:09 PM Jan Schneider Comment #5 Reply to this comment
No, never seen this.
04/30/2007 02:21:31 PM Michael Slusarz Comment #4 Reply to this comment
Still not seeing it here.  Jan, do you see this?
04/24/2007 08:28:37 AM adrieder (at) sbox (dot) tugraz (dot) at Comment #3 Reply to this comment
Can not reproduce.  I replied to the message sent to bugs@ with the
text from below and it worked just fine.
Strange...

I still see it, it got even worse, now (cvs updated April 24 2007) 
messages get also cut in the message view.

- Firefox 2.0.0.3 on Linux.

- Firefox 1.5.0.7 on XP


04/18/2007 03:55:23 PM Michael Slusarz Comment #2
State ⇒ Feedback
Reply to this comment
Can not reproduce.  I replied to the message sent to bugs@ with the 
text from below and it worked just fine.
04/17/2007 03:56:10 PM Chuck Hagenbuch Assigned to Michael Slusarz
State ⇒ Assigned
 
04/17/2007 12:29:32 PM adrieder (at) sbox (dot) tugraz (dot) at Comment #1
State ⇒ Unconfirmed
Priority ⇒ 2. Medium
Type ⇒ Bug
Summary ⇒ quoted message part gets cut after Umlauts
Due ⇒ 04/18/2007
Queue ⇒ DIMP
Reply to this comment
When replying to a message, the quoted message part gets cut after the 
first occurrence of a German Umlaut.



Example:

Das ist der nächste Test

zweite Zeile



gets quoted as:
Das ist der n

Saved Queries