Screenshots from Japanese CALL-SLT

The system shows a French prompt, "DEMANDER DE_MANIERE_POLIE EAU"

The student speaks a corresponding sentence in Japanese, here "omizu onegai shimasu". The system does speech recognition and understanding, and shows the recognised sentence to the student in both Japanese and Roman orthography.

If the students wishes, they can click the help button, to get an example of a Japanese native speaker saying something that will work.

New treatment of Japanese verbs

I've been discussing Japanese verbs with Yukie - we need new inflectional forms for CALL-SLT, in the particular the volitional (-tai) form, and the old system was getting out of hand. Japanese has extraordinarily regular morphology, with only two irregular verbs and some very straightforward sound-changes, so it seemed to me that we really ought to be able to get by without explicitly listing all the inflections of every verb we needed.

Yukie wrote down a table of inflections, and we discussed ways of splitting up inflected verbs into stems and affixes. Based on our discussion, I've implemented a first version of a new treatment, where you now only need to specify a single root form of the verb, and everything else is done by morphotax rules, where the affixes are treated by Nuance as separate words. I've tested by converting the Japanese Calendar lexicon to the new form, and compiling into a recognizer. Coverage is what it was, and recognition is anecdotally fine with my voice. I will dig out some Japanese Calendar data soon and run proper tests.

If anyone wants to look at the details, the morphotax rules are in $REGULUS/Grammar/Japanese/japanese_verb_morphology.regulus. The new version of the Japanese Calendar lexicon is at $REGULUS/Examples/Calendar/Regulus/japanese_calendar_lex_new.regulus.

Here's an example of a parse:

$ nanji ni owa ri mashita ka
(Parsing with left-corner parser)

Analysis time: 0.09 seconds

Return value: [[question,form(past,[[owaru],[ni,term(null,nanji,[])]])]]

Global value: []

Syn features: []

Parse tree:

.MAIN [JAPANESE_CORE_RULES:112-116]
  top [JAPANESE_CORE_RULES:117-119]
     utterance [JAPANESE_CORE_RULES:120-123]
     /  main_clause [JAPANESE_CORE_RULES:147-151]
     |     s [JAPANESE_CORE_RULES:155-162]
     |     /  comps [JAPANESE_CORE_RULES:190-195]
     |     |  /  pp [JAPANESE_CORE_RULES:414-423]
     |     |  |  /  np [JAPANESE_CORE_RULES:267-273]
     |     |  |  |     n lex(nanji) [JAPANESE_CALENDAR_LEX_NEW:84-84]
     |     |  |  \  p lex(ni) [JAPANESE_CALENDAR_LEX_NEW:274-284]
     |     |  \  comps null [JAPANESE_CORE_RULES:163-166]
     |     |  vbar [JAPANESE_CORE_RULES:249-253]
     |     |     v [JAPANESE_VERB_MORPHOLOGY:13-26]
     |     |     /  v_stem [JAPANESE_VERB_MORPHOLOGY:27-38]
     |     |     |  /  v_stem lex(owa) [JAPANESE_CALENDAR_LEX_NEW:227-237]
     |     |     |  \  stem_affix lex(ri) [JAPANESE_VERB_MORPHOLOGY:138-138]
     |     \     \  affix lex(mashita) [JAPANESE_VERB_MORPHOLOGY:80-83]
     \  lex(ka)

------------------------------- FILES -------------------------------

JAPANESE_CALENDAR_LEX_NEW:
d:/cygwin/home/speech/regulus/examples/calendar/regulus/japanese_calendar_lex_new.regulus
JAPANESE_CORE_RULES:     
d:/cygwin/home/speech/regulus/grammar/japanese/japanese_core_rules.regulus
JAPANESE_VERB_MORPHOLOGY:
d:/cygwin/home/speech/regulus/grammar/japanese/japanese_verb_morphology.regulus

CALL-SLT and Japanese

I have just added a little more coverage to the Japanese version... it now has about a dozen sentences for the student to practice on. I tried it, and so far it still recognizes everything I say. This is probably more because vocabulary is so small than because I have a wonderful Japanese accent :)

Yukie and I should talk about how to proceed here. The first step will be to add material to the Japanese corpus.

CALL-SLT and Japanese

And we now have a skeleton Japanese system too. So far, it can only do one sentence,

   hitori no teeburu wa arimasu ka

which is rendered in the Interlingua as

    POLITE REQUEST TABLE 1 PERSON

Though it is nice that this goes all the way through: I can get the Interlingua as a prompt, speak the sentence, and be informed that I got it right. Not surprisingly, since the grammar doesn't cover anything else, it's very reliable when you say the one thing it knows!

Yukie and I need to get together and add more content. The first step will be for Yukie to flesh out the corpus, which currently only has a dozen or so examples.