开发者

How to match unicode words with ruby 1.9?

I'm using ruby 1.9 and trying to find out which regex I need t开发者_开发问答o make this true:

Encoding.default_internal = Encoding.default_external = 'utf-8'
"föö".match(/(\w+)/u)[1] == "föö"
# => false


# encoding=utf-8 
p "föö".match(/\p{Word}+/)[0] == "föö"


You can manually turn on Unicode matching using the inside (?u) syntax:

"föö".match(/(?u)(\w+)/)[1] == "föö"
# => true

However, using Unicode Property Syntax (steenslag's answer) or POSIX Brackets Syntax is better style, since they both automatically respect Unicode codepoints:

"föö".match(/(\p{word}+)/)[1] == "föö"
# => true

"föö".match(/([[:word:]]+)/)[1] == "föö"
# => true

See this blog post for more info about matching Unicode characters in Ruby regexes.


http://www.ruby-forum.com/topic/208777

and

http://www.ruby-forum.com/topic/210770

might have clues for you.

You can also use the (documented) \p{L} property, ex:

$ ruby -ve "p '℉üüü' =~ /\p{L}/"
ruby 1.9.2p0 (2010-08-18 revision 29036) [x86_64-linux]
1
0

上一篇:

下一篇:

精彩评论

暂无评论...
验证码 换一张
取 消

最新问答

问答排行榜