novel-pinyin 0.2.x wishlist

As the first version of novel-pinyin has been released, some feedback has been received.
The next version of novel-pinyin will try to finish the following todo tasks:
1. Model Modification. Modify the P(P|W) from k/n to C(P,W)/C(W).
(C(P,W) stands for counter of pinyin and word combination,
C(W) stands for word counter.)

2. Dynamic adjust phrase positions according to bi-gram possibilities.
As in HMM model training process, the frequency adjusted is very small(1 or 6).
To magnify the position changes, replace unigram with bi-gram when possible.

3. Versioned Data File Format.
As data file format will be changed in next release. So I will add a version file in
~/.scim/novel-pinyin, to indicate file format version.
When different version has been detected, the files of old version will be flushed.

Optional:
skim integration.

novel-pinyin 0.1.0 internal test

You can get newest novel-pinyin 0.1.0 from the following url:
http://download.opensuse.org/repositories/home:/wupeng/

The source code in sourceforge.net misses the data file, so it will not run.
Please use the rpm on the above url.

2008 New Year!

我自己的输入法Novel Pinyin终于跑起来了，还有一些bug，不过影响不大。现在我就在用我自己写的输入法，写自己的博客。
下周开始在同事中测试新的输入法。
首先，在这个周末，要把rpm在openSUSE Build Service上做出来。

Finish segment & training part, upload it to sourceforge.

Upload new novel-pinyin code to sourceforge, currently finished segment & training part.

In this place, I use a modified interpolation method to ease implementation.
The parameter optimization part is done in research prototype.
So the code in novel-pinyin is relatively simple, just use parameters computed from prototype.

The word segment use shortest path algorithm to segment words, and prepare the data to training part.

AIGLX on OpenSUSE 10.3

My Notebook has a 945 GM Graphics Card, which support AIGLX.
Default 3D Desktop on openSUSE will use XGL. But I want other OpenGL applications can benefit from
hardware acceleration. So I switched to AIGLX.
Refer to http://en.opensuse.org/AIGLX.

And I use X.org config file from here:

Section "Device"
 Identifier  "** Intel i810 (generic)               [i810]"
 Driver      "i810"
 VideoRam    262144
 Option "DRI"  "true"
 Option "XAANoOffscreenPixmaps" "true"
EndSection

Section "ServerLayout"
 Option "AIGLX" "true"
EndSection

Section "DRI"
 Mode 0666
EndSection

Section "Extensions"
     Option "Composite" "Enable"
EndSection

For Java Application, set AWT_TOOLKIT=MToolkit, from here:
export AWT_TOOLKIT=MToolkit to avoid gray window.

Upload new novel-pinyin source code to sourceforge.net

Finished n-gram storage code, and update code on http://novel-pinyin.cvs.sourceforge.net/novel-pinyin/novel-pinyin/.

On currently implementation, I modified the P(P|W) from ratio which is computed from scim-pinyin, to k/n, k indicates k matched pinyins, n indicates total n pinyins for word W.
I don't know how it will influence the result of HMM correct rate, hopes it will not be bad.

Tested this approach on research prototype, the correct rate is lower. And test with manual input, it don't work too bad.

And counting the computing complexity, it seems that the speed is sufficient.

Novel-Pinyin Ver1 TODO List

Storage:

• N-gram file

Training:

• Training using parameters in prototype system.

Lookup:

• Original Lookup with Candidate Selection.

Self-Learning:

• Learn User Sentence when Commit String.

novel-imengine:

• Special Table support rewrite from scim-pinyin in c.
• Scim UI Config Module.

Federico in Beijing

Now Federico has come to Beijing. He is a great hacker and good man.
Here we together looking at the pango CJK performance issue.
http://www.gnome.org/~federico/news-2007-10.html#pango-cjk-1

And He went to the Great Wall:
http://www.gnome.org/~federico/news-2007-10.html#15

Planet SUSE blog

From now on, I will post my blog in English, Because of the planetsuse.org.

让openSUSE 10.2支持包含中文文件名的U盘

先是在hal的源码中找了半天，最后终于在gnome-volume-manager的代码找到了设置iocharset=utf8的方法。
在gnome-terminal下运行：
gconftool-2 -s /system/storage/default_options/vfat/mount_options -t list --list-type string [shortname=winnt,uid=,iocharset=utf8]
就可以解决问题了。

论文雏形基本搞定

非常努力的工作了半年，看了N多资料。
终于，基于Hidden Markov Model的拼音整句输入法原型，可以正常工作了。
过一阵儿，在Linux下就可以用整句输入法了。
效果很好，不过，离成品还有一段距离。
呵呵，兴奋中。

十一回家休息！！！

终于又回家了。
经过一番修改，我的Blog终于在IE6种正常显示了。
要把模板中的第一句话去掉，并把开头改成如下格式：
<html>
<head>
<meta equiv="content-type" content="text/html; charset=UTF-8">
...
-----------------------------------------------------------------------------------
就可以在IE6中正常显示了。呵呵

要努力工作了。

终于从上一个项目中，撤出来了。
开始做新项目了，有难度。但是很喜欢。呵呵。

最近过得不错，嘻嘻，刚过完感恩节。

前一阵儿，刚和导师及师兄一起去爬凤凰岭了，好久没运动了，舒展舒展筋骨。
在单位，现在比较适应那儿的环境了，虽然有点小麻烦，但是总体上不错。
明年，就该找工作，努力中。
加油啊！
为了明天的成功而努力。
面包会有的，自我安慰一下。

我的Blogger开张了

大家好，我的第一个Blogger开张了。^_^