smarty截取中文字符乱码问题的解决支持utf-8编码

时间:2023-01-06 14:28:56

Smarty模板中使用truncate来截取字符,但是它只适合英文用户,对与中文用户来说,使用truncate会出现乱码,而且对于中文英文混合串来说,截取同样个数的字符串,实际显示长度上却不同,视觉上会显得参差不齐,影像美观。这是因为一个中文的长度大致相当与两个英文的长度。此外,truncate也不能同时兼容GB2312, UTF-8等编码。

改良的smartTruncate:

文件名:modifier.smartTruncate.php()

存放于/smarty/plugins目录下

<?php
function smartDetectUTF8($string)
{
    static $result = array();

    if(! array_key_exists($key = md5($string), $result))
    {
        $utf8 = "
            /^(?:
                [/x09/x0A/x0D/x20-/x7E]                            # ASCII
                | [/xC2-/xDF][/x80-/xBF]                             # non-overlong 2-byte
                | /xE0[/xA0-/xBF][/x80-/xBF]                       # excluding overlongs
                | [/xE1-/xEC/xEE/xEF][/x80-/xBF]{2}           # straight 3-byte
                | /xED[/x80-/x9F][/x80-/xBF]                      # excluding surrogates
                | /xF0[/x90-/xBF][/x80-/xBF]{2}                 # planes 1-3
                | [/xF1-/xF3][/x80-/xBF]{3}                          # planes 4-15
                | /xF4[/x80-/x8F][/x80-/xBF]{2}                  # plane 16
            )+$/xs
        ";

        $result[$key] = preg_match(trim($utf8), $string);
    }

    return $result[$key];
}

function smartStrlen($string)
{
    $result = 0;

    $number = smartDetectUTF8($string) ? 3 : 2;

    for($i = 0; $i < strlen($string); $i += $bytes)
    {
        $bytes = ord(substr($string, $i, 1)) > 127 ? $number : 1;

        $result += $bytes > 1 ? 1.0 : 0.5;
    }

    return $result;
}

function smartSubstr($string, $start, $length = null)
{
    $result = '''';

    $number = smartDetectUTF8($string) ? 3 : 2;

    if($start < 0)
    {
        $start = max(smartStrlen($string) + $start, 0);
    }

    for($i = 0; $i < strlen($string); $i += $bytes)
    {
        if($start <= 0)
        {
            break;
        }

        $bytes = ord(substr($string, $i, 1)) > 127 ? $number : 1;

        $start -= $bytes > 1 ? 1.0 : 0.5;
    }

    if(is_null($length))
    {
        $result = substr($string, $i);
    }
    else
    {
        for($j = $i; $j < strlen($string); $j += $bytes)
        {
            if($length <= 0)
            {
                break;
            }

            if(($bytes = ord(substr($string, $j, 1)) > 127 ? $number : 1) > 1)
            {
                if($length < 1.0)
                {
                    break;
                }

                $result .= substr($string, $j, $bytes);
                $length -= 1.0;
            }
            else
            {
                $result .= substr($string, $j, 1);
                $length -= 0.5;
            }
        }
    }

    return $result;
}

function smarty_modifier_smartTruncate($string, $length = 80, $etc = ''...'',
                                       $break_words = false, $middle = false)
{
    if ($length == 0)
        return '''';

    if (smartStrlen($string) > $length) {
        $length -= smartStrlen($etc);
        if (!$break_words && !$middle) {
            $string = preg_replace(''//s+?(/S+)?$/'', '''', smartSubstr($string, 0, $length+1));
        }
        if(!$middle) {
            return smartSubstr($string, 0, $length).$etc;
        } else {
            return smartSubstr($string, 0, $length/2) . $etc . smartSubstr($string, -$length/2);
        }
    } else {
        return $string;
    }
}
?>

以上代码完整实现了truncate的原有功能,而且可以兼容UTF-8编码,在判断字符长度的时候,一个中文字符算1.0,一个英文字符算0.5,所以在截取子字符串的时候不会出现参差不齐的情况.

插件的使用方式没有特别之处,这里简单测试一下:

PHP测试代码如下:

<?php
include_once("./smarty/Smarty.class.php");
include_once("./smarty/plugins/modifier.smartTruncate.php");
$smarty = new Smarty();
$smarty->template_dir = "./templates/";
$smarty->compile_dir = "./templates_c/";
$smarty->config_dir   = "./configs";
$smarty->cache_dir    = ".cache/";
$smarty->left_delimiter = '<{';
$smarty->right_delimiter = '}>';

$smarty->assign("en_content","I am strong man");
$smarty->assign("ch_content","**人民*");
$smarty->assign("en_ch_content","A中B华C人D民E共F和G国H中I央J人K民L政M府");
$smarty->display("smarty_substr.html");
?>

模板代码smarty_substr.html:

<{$en_content|truncate}><br />
<{$en_content|truncate:10}><br />
<{$en_content|truncate:10:""}><br />
<{$en_content|truncate:10:"---"}><br />
<{$en_content|truncate:10:"":true}><br />
<{$en_content|truncate:10:"...":true}><br /><br />

<{$ch_content|smartTruncate}><br />
<{$ch_content|smartTruncate:5}><br />
<{$ch_content|smartTruncate:5:""}><br />
<{$ch_content|smartTruncate:5:"---"}><br />
<{$ch_content|smartTruncate:5:"":true}><br />
<{$ch_content|smartTruncate:5:"...":true}><br /><br />

<{$en_ch_content|smartTruncate}><br />
<{$en_ch_content|smartTruncate:5}><br />
<{$en_ch_content|smartTruncate:5:""}><br />
<{$en_ch_content|smartTruncate:5:"---"}><br />
<{$en_ch_content|smartTruncate:5:"":true}><br />
<{$en_ch_content|smartTruncate:5:"...":true}><br />

显示结果:

I am strong man
I am...
I am
I am---
I am stron
I am st...

**人民*
中华人...
中华人民共
中华人---
中华人民共
中华人...

A中B华C人D民E共F和G国H中I央J人K民L政M府
A中B华C...
A中B华C人D
A中B华C---
A中B华C人D
A中B华C...

(中文符号长度算1.0,英文符号长度算0.5,并且考虑省略符号的长度)