problem sa konverzijom

[ jelena_t @ 07.07.2008. 11:02 ] @

Ovako: potrebno mi je da u bazi drzim neke non-latin stringove (ruski jezik npr) upisane kao utf-16 tj dva bajta po karakteru, kada ih ubacim u bazu kroz php formu, i promenljivu koju upisujem konvertujem u utf-16, trebalo bi da mi vrati da je encoding utf-16, medjutim :

mb_convert_encoding($username,"utf-16"); konvertujem u utf-16
ali, kad pozovem
mb_detect_encoding($username); on mi vraca da je encoding utf-8

Help

[ jelena_t @ 07.07.2008. 11:09 ] @

Zaboravih da dodam, baza je Pervasive v8 mada mislim da to nema veze sa ovim problemom jer on mi izbacuje i pogresni encoding i kad samo odstampam na ekranu promenljivu pre i posle...

[ jelena_t @ 07.07.2008. 11:20 ] @

Ok, shvatila sam u cemu je problem ..mb_convert_encoding ne radi sa utf-16, moze da konvertuje recimo u utf-8, jis i slicno ali nece u utf-16.. :(

[ dr ZiDoo @ 07.07.2008. 11:41 ] @

iconv?

[ jelena_t @ 07.07.2008. 11:56 ] @

I iconv me zeza takodje...npr $us=iconv( mb_detect_encoding($us),'UTF-16',$us); ostaje isti enociding koji vec ima ta promenljuva $us... ne menja ga u utf-16

[ jelena_t @ 07.07.2008. 12:31 ] @

Sad sam tek u konfuziji..izgleda nisam bila u pravu uopste, mb_convert_encoding radi sa utf-16, ali nesto definitivno nije u redu, evo sta sam probavala:

$username='oficialь';

$username=mb_convert_encoding($username,'UTF-16',mb_detect_encoding($username));

echo' Posle konverzije :';
echo mb_detect_encoding($username);
echo $username;

vrati: da je i pre i posle konverzije encoding utf-8 medjutim umesto oficialь vrati da je username:D8F80;L

Pomoc? :(

[ Miroslav Ćurčić @ 07.07.2008. 12:41 ] @

Ovo sam negde iskopao, ne sećam se više gde, a nije ni isprobano.
Dve funkcije za konverziju 1 karaktera između utf8 i uft16.

Code:

    function utf82utf16($utf8) {
        // Konvertuje UTF8 u UTF16
        if(function_exists('mb_convert_encoding')) {
            return mb_convert_encoding($utf8, 'UTF-16', 'UTF-8');
        }
        // sporija zamena za mb_convert_encoding
        switch(strlen($utf8)) {
            case 1:
                // this case should never be reached, because we are in ASCII range
                // see: http://www.cl.cam.ac.uk/~mgk25/unicode.html#utf-8
                return $utf8;
            case 2:
                // return a UTF-16 character from a 2-byte UTF-8 char
                // see: http://www.cl.cam.ac.uk/~mgk25/unicode.html#utf-8
                return chr(0x07 & (ord($utf8{0}) >> 2))
                     . chr((0xC0 & (ord($utf8{0}) << 6))
                         | (0x3F & ord($utf8{1})));
            case 3:
                // return a UTF-16 character from a 3-byte UTF-8 char
                // see: http://www.cl.cam.ac.uk/~mgk25/unicode.html#utf-8
                return chr((0xF0 & (ord($utf8{0}) << 4))
                         | (0x0F & (ord($utf8{1}) >> 2)))
                     . chr((0xC0 & (ord($utf8{1}) << 6))
                         | (0x7F & ord($utf8{2})));
        }
        // ignoring UTF-32 for now, sorry
        return '';
    }

    function utf162utf8($utf16) {
        // konvertuje UTF16 u UTF8
        if(function_exists('mb_convert_encoding')) {
            return mb_convert_encoding($utf16, 'UTF-8', 'UTF-16');
        }
        // sporija zamena za mb_convert_encoding
        $bytes = (ord($utf16{0}) << 8) | ord($utf16{1});
        switch(true) {
            case ((0x7F & $bytes) == $bytes):
                // this case should never be reached, because we are in ASCII range
                // see: http://www.cl.cam.ac.uk/~mgk25/unicode.html#utf-8
                return chr(0x7F & $bytes);

            case (0x07FF & $bytes) == $bytes:
                // return a 2-byte UTF-8 character
                // see: http://www.cl.cam.ac.uk/~mgk25/unicode.html#utf-8
                return chr(0xC0 | (($bytes >> 6) & 0x1F))
                     . chr(0x80 | ($bytes & 0x3F));

            case (0xFFFF & $bytes) == $bytes:
                // return a 3-byte UTF-8 character
                // see: http://www.cl.cam.ac.uk/~mgk25/unicode.html#utf-8
                return chr(0xE0 | (($bytes >> 12) & 0x0F))
                     . chr(0x80 | (($bytes >> 6) & 0x3F))
                     . chr(0x80 | ($bytes & 0x3F));
        }
        // ignoring UTF-32 for now, sorry
        return '';
    }

[ jelena_t @ 07.07.2008. 13:47 ] @

Ok, hvala...u mom slucaju se uvek izvrsi mb_convert_encoding($utf8, 'UTF-16', 'UTF-8'); posto je ispunjen taj if uslov
Sad sam proverila, on stvarno konvertuje u utf-16, recimo string 'ana' (promenim drugi parametar iz utf-8 u mb_detect_encoding($utf8)) posle konverzije je 6 bajtova.. doduse i dalje nece da mi ga ubaci u bazu..