opensuse 12.2 - UTF-8 issue

hello, UTF-8 encoding is not working correctly on my opensuse 12.2 install.
anyone else run into this?

symptom: on oss12.2, quotes not displayed correctly
mkdir: cannot create directory â binâ: File exists

on our oss12.1 host, (and previous versions), it display’s with smart quotes:
mkdir: cannot create directory `bin’: File exists

I’ve tried TERM=vt100, xterm, linux, - no change
if I unset LANG, I get simple quotes:
mkdir: cannot create directory ‘bin’: File exists

I have these versions of terminfo and glibc-locale installed via “zypper update”:
terminfo-base-5.9-12.5.1.x86_64
terminfo-5.9-12.5.1.x86_64
glibc-locale-2.15-22.6.4.x86_64

here’s my locale settings:

LANG=en_US.UTF-8
LC_CTYPE=“en_US.UTF-8”
LC_NUMERIC=“en_US.UTF-8”
LC_TIME=“en_US.UTF-8”
LC_COLLATE=“en_US.UTF-8”
LC_MONETARY=“en_US.UTF-8”
LC_MESSAGES=“en_US.UTF-8”
LC_PAPER=“en_US.UTF-8”
LC_NAME=“en_US.UTF-8”
LC_ADDRESS=“en_US.UTF-8”
LC_TELEPHONE=“en_US.UTF-8”
LC_MEASUREMENT=“en_US.UTF-8”
LC_IDENTIFICATION=“en_US.UTF-8”
LC_ALL=

thanks,

scott

On 2012-12-13 00:36, sandez wrote:
>
> hello, UTF-8 encoding is not working correctly on my opensuse 12.2
> install.
> anyone else run into this?
>
>
> symptom: on oss12.2, quotes not displayed correctly
> mkdir: cannot create directory â binâ: File exists

You have to copy full command sequences, with complete prompt before and
after, so that we can try to reproduce, and do so inside code tags -
this is crucial.

Posting in
Code Tags - A Guide

Also you have to specify what terminal and under what desktop you are
doing this.


Cheers / Saludos,

Carlos E. R.
(from 12.1 x86_64 “Asparagus” at Telcontar)

Hello Carlos - thanks for the pointers.
here’s the error (quotes not displayed correctly) and my locale settings:


oss122-gold:~ # mkdir bin
mkdir: cannot create directory âbinâ: File exists
oss122-gold:~ # locale
LANG=en_US.UTF-8
LC_CTYPE="en_US.UTF-8"
LC_NUMERIC="en_US.UTF-8"
LC_TIME="en_US.UTF-8"
LC_COLLATE="en_US.UTF-8"
LC_MONETARY="en_US.UTF-8"
LC_MESSAGES="en_US.UTF-8"
LC_PAPER="en_US.UTF-8"
LC_NAME="en_US.UTF-8"
LC_ADDRESS="en_US.UTF-8"
LC_TELEPHONE="en_US.UTF-8"
LC_MEASUREMENT="en_US.UTF-8"
LC_IDENTIFICATION="en_US.UTF-8"
LC_ALL=


I am testing with linux,xterm,vt100 terminals. I am connecting from SecureCRT and/or CDE desktop Dtterm (other host).

and here’s my 12.2 version info:


oss122-gold:~ # cat /etc/issue
Welcome to openSUSE 12.2 "Mantis" - Kernel \r (\l).


oss122-gold:~ # uname -a
Linux oss122-gold 3.4.11-2.16-xen #1 SMP Wed Sep 26 17:05:00 UTC 2012 (259fc87) x86_64 x86_64 x86_64 GNU/Linux


thanks,

scott

I would say it is a problem of SecureCRT and/or dtterm. I did not have any UTF-8 issue for a long time either with local terminal programs (konsole, gnome-terminal, Linux console) or PuTTY with correct translation configured.

locale settings affect how programs behave on remote host; what glyphs are actually displayed is controlled by local terminal program.

On 2012-12-13 02:16, sandez wrote:

>
> I am testing with linux,xterm,vt100 terminals. I am connecting from
> SecureCRT and/or CDE desktop Dtterm (other host).

That’s probably the critical part. You have to try locally on the Linux
machine, and I’d bet there is no problem there, and that the problematic
software is that “client” application.


Cheers / Saludos,

Carlos E. R.
(from 12.1 x86_64 “Asparagus” at Telcontar)

To add to this:

  1. This is using the Xen kernel:
3.4.11-2.16-xen

  1. Install is “Minimal Server command line” mode (no desktop)

  2. This issue only occurs with oss12.2. previous versions were fine: 11.3,11.4, 12.1

  3. Multiple users are experiencing the same problem.

  4. I just did a fresh oss12.2 build of a new Xen VM, and have the same problem.

  5. this occurs on Xen Console as well with default settings of “linux” and LANG=POSIX.

thanks,

scott

Yes, linux console historically had issue with extended UTF-8 character sets because font is not complete. You did not see it in the past most likely because plain ASCII characters were used, not fancy quotes. If you do not need them, just set LC_ALL=POSIX, it will revert to simple ‘bin’.