1 Topic by XuMiX (edited by XuMiX 2005-01-08 12:35)

  • XuMiX
  • Senior Member
  • Offline
  • From: Russia.Novosibirsk.ToStreet()
  • Registered: 2004-05-17
  • Posts: 130

Topic: [1.2] Some national characters are stripped out of posts

Strange thing. this happens on my server, but this is not repeated here. So when i post a reply or just a new post with russian character "?", exactly this small character is completely stripped out from post, even when i try to edit it - there are no these characters at all.
but when i preview my post "?" is present there :(.
My server and punbb charset is koi8-r, there were no such problems in 1.1.5 version.

XuMiX's Website

  • From: 127.0.0.1
  • Registered: 2001-11-02
  • Posts: 9,167

Re: [1.2] Some national characters are stripped out of posts

Are you running MySQL or PostgreSQL?

"Programming is like sex: one mistake and you have to support it for the rest of your life."

Rickard's Website

3 Reply by XuMiX (edited by XuMiX 2005-01-08 14:18)

  • XuMiX
  • Senior Member
  • Offline
  • From: Russia.Novosibirsk.ToStreet()
  • Registered: 2004-05-17
  • Posts: 130

Re: [1.2] Some national characters are stripped out of posts

i'm running postgres, punbb database locale is set to koi8
maybe i should change it to unicode or latin1 ? apache  server charset is koi8, server itself locale is set to koi8 also

XuMiX's Website

4 Reply by XuMiX

  • XuMiX
  • Senior Member
  • Offline
  • From: Russia.Novosibirsk.ToStreet()
  • Registered: 2004-05-17
  • Posts: 130

Re: [1.2] Some national characters are stripped out of posts

well, it seems to me, that DB does not affect this bug
i tried SQL_ASCII, UNICODE and KOI8 encodings

XuMiX's Website

  • From: 127.0.0.1
  • Registered: 2001-11-02
  • Posts: 9,167

Re: [1.2] Some national characters are stripped out of posts

Well, if the database encoding differs from that of your XHTML page, I believe there will be problems.

"Programming is like sex: one mistake and you have to support it for the rest of your life."

Rickard's Website

  • From: 127.0.0.1
  • Registered: 2001-11-02
  • Posts: 9,167

Re: [1.2] Some national characters are stripped out of posts

Did you try inserting new posts after you changed the database locale?

"Programming is like sex: one mistake and you have to support it for the rest of your life."

Rickard's Website

7 Reply by XuMiX

  • XuMiX
  • Senior Member
  • Offline
  • From: Russia.Novosibirsk.ToStreet()
  • Registered: 2004-05-17
  • Posts: 130

Re: [1.2] Some national characters are stripped out of posts

function pun_trim($str)
{
    $fishy_chars = array(chr(0x81), chr(0x8D), chr(0x8F), chr(0x90), chr(0x9D), chr(0xA0), chr(0xCA), ' ');

    return trim(str_replace($fishy_chars, ' ', $str));
}

chr(0xCA) - That's it smile

XuMiX's Website

  • From: 127.0.0.1
  • Registered: 2001-11-02
  • Posts: 9,167

Re: [1.2] Some national characters are stripped out of posts

Aha. Weird. That usually isn't a printable character at all. I'll fix it for 1.2.1.

"Programming is like sex: one mistake and you have to support it for the rest of your life."

Rickard's Website

9 Reply by 1899

  • 1899
  • New Member
  • Offline
  • Registered: 2005-01-18
  • Posts: 1

Re: [1.2] Some national characters are stripped out of posts

I have the same problem with the russian letter K . I'm ussing MySQL.

  • From: 127.0.0.1
  • Registered: 2001-11-02
  • Posts: 9,167

Re: [1.2] Some national characters are stripped out of posts

1899: Try replacing your pun_trim() function with this:

function pun_trim($str)
{
        global $lang_common;

        if (strpos($lang_common['lang_encoding'], '8859') !== false)
        {
                $fishy_chars = array(chr(0x81), chr(0x8D), chr(0x8F), chr(0x90), chr(0x9D), chr(0xA0), chr(0xCA));
                return trim(str_replace($fishy_chars, ' ', $str));
        }
        else
                return trim($str);
}
"Programming is like sex: one mistake and you have to support it for the rest of your life."

Rickard's Website