4

I'm currently working on an NLP project using toki pona, analysing and generating sentences. I was wondering if there was a structured dictionary available for it, or whether people have attempted to create one.

Let me explain what I mean by "structured dictionary":

There are only 120-odd words in toki pona. The word jan refers to a person. Compounds are used to be more specific, ie jan pona is "friend", jan utala is "fighter", jan alasa is "hunter", etc. This is reminiscent of expressing the meaning of nouns through semantic primitives, a bit like Wilks (1975). So the set of words described by jan would be {"person", "friend", "fighter", "hunter", ...}. There are subsets which are more specific, so jan utala is {"fighter", "soldier", "mercenary", ...}. jan utala pi ma would be {"soldier", "private", "general", ...}

You can envisage it as a tree structure, where the leaves are the word meanings, and the roots (as there would be multiple trees: one for each 'top' primitive) encompasses all of them. As you wander down the tree, the path is an ever longer chain of toki pona words, and the set of meanings covered by those words becomes smaller and smaller.

Another example would be ilo, "tool". ilo toki is a tool for communication: {"telephone", "telegraph", "vhf radio", "loud hailer", ...}; ilo toki uta suli (tool talk mouth big) could be a loud hailer. Another sub-tree would capture wireless communication devices, perhaps ilo toki pi kon.

I know this somewhat goes against the toki pona philosophy of being a simple and small language, but it seems to me to more or less accidentally provide a useful set of semantic primitives that can be used to describe word meanings in general. So before I embark on creating such a structure, has anyone already attempted something similar? Surely there must be dictionaries of mulit-word toki pona expressions? I haven't been able to find a good one yet.

Wilks, Y (1975) An Intelligent Analyzer and Understander of English, Communications of the ACM 18(5):264-274

3

Proving a negative is always difficult, but as far as I can tell there is no obvious candidate for what you're looking for and if you made one yourself it would presumably fill an empty niche in the Toki Pona universe. At least I haven't found any sites written in English yet that seem to fit the bill.

The closest thing I can find to what you are looking for is a Toki Pona corpus search tool, which seems like it would be useful for tracking down examples of usage and might help you find compounds containing a particular word that have already been coined.

Also, I have yet to find two simpler things that would be good stepping stones for a hierarchically organized Toki Pona dictionary.

  • A non-minimal dictionary
  • Toki Pona-English parallel texts

All of the Toki Pona dictionaries I have found so far define just the basic vocabulary and do not provide entries for any multi-morpheme lexemes, even famous ones like jan utala.

Many of the dictionaries out there are more or less copies of the official dictionary, such as this one. Other dictionaries like this Wiktionary appendix do not provide definitions for whole Toki Pona expressions at a time.

Toki Pona-English parallel texts would help distinguish lexeme boundaries within complex phrases, since the presence or absence of pi is not a completely reliable cue as to whether a "real lexeme boundary" was intended.

| improve this answer | |

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.