On development changelog
The latest on-development version can be accessed by building the source code. On this on-development version, things can be broken.
ilo Token can now translate prepositions. This includes preposition before "la" such as "tawa mi la sina pona" and prepositional predicate such as "mi kepeken ilo".
- Implement translation of preposition.
- Implement "nanpa X la" translation.
- Context clauses can now be translated into adverbs e.g. "pona la mi moku" will be translated as "nicely, I ate".
- Fix "nanpa" translation: Before it translated into just "position" instead of e.g. "position 1".
- When telo misikeke is enabled, it won't mark words defined in the custom dictionary.
Released 2 April 2025
- Fix adverbs not showing along with verbs.
- Fix UCSUR translation. Previously, some UCSUR words are translated into wrong words in latin script.
Released 14 March 2025
- Change "Add word" button into "Import word".
Released 9 Mar 2025
- Fix adverb placement within verbs: "sina o lape pona" can now translate into "You should nicely sleep" instead of "You nicely should sleep".
- Fix "token is not defined" bug when telo misikeke error messages is turned on.
Released 9 Mar 2025
ilo Token can now translate "o" imperative sentences such as "o toki" and "mi o lape".
You can now have custom fillers in custom dictionary:
wa:
wow/woow/wooow(f);
With this definition, ilo Token can translate "waaaa" into "woooow". There is no repetition pattern to follow for toki pona words. "wwaaa" is just as valid.
You can also now have custom numerals:
san:
3(num);
- Implement translation of "o" imperative sentences.
- Allow custom fillers.
- Allow custom numerals.
- Numerals are now very permissive. Something like "wan tu" is now allowed. It is also possible for ilo Token to output both numbers using pu system and nasin nanpa pona: "tu ale wan" will be translated into 103 (pu system) and 201 (nasin nanpa pona).
- Support for long "anu" glyph.
- Fix sentence capitalization: If the sentence starts with number, no capitalization will occur.
Released 27 Feb 2025
ilo Token is now a lot faster. In exchange, it now uses more memory.
- Fix custom dictionary error messages.
- Fix custom dictionary not loading when ilo Token is newly loaded.
Released 19 Feb 2025
ilo Token can now translate into verbs! This means it can translate sentences! It still can't do the following however:
- X ala X construction
- Preverb
- Preposition
- "o" imperative sentence
ilo Token now has custom dictionary editor! This allows users to customize the dictionary to their liking. Users can customize existing words and also extend ilo Token with more non-pu words. It comes with limitations however. Read the guidelines for using custom dictionary editor.
Some of the settings may reset. Please reconfigure it again to your preferred settings. Sorry for the inconvenience. We've decided to reset some of the settings after refactoring to make the code easier to work with.
- Implement translation to verbs.
- Implement custom dictionary editor.
- Fixed "la" translation.
- Output translations are now capitalized.
- "X lili" can be translated into "piece of X" or "part of X".
- Consecutive adverbs are now not shown to avoid ambiguity.
- Sentences ending with long string of punctuation such as "…" and "!?" are now recognized.
- Interpunct or middle dot (·) and ideographic period (。) are now recognized as sentence separator.
- Recognize multiline text. Newlines are either ignored or treated as sentence terminator.
- New setting called multiline input mode. This enables users to insert newline on the text box. Ctrl + Enter is used to start translation.
- Fixed UCSUR rendering.
- Fixed ordering issue in Firefox. Thanks akesi Ale!
- Implement advanced parsing settings.
- Long texts (>500) are no longer recognized.
Released 15 Aug 2024
This is a huge update now with better quality translations, configurable settings, UCSUR support, and expanded vocabulary!
- Reimplement the word "a". This were dropped due to parser rewrite.
- The vocabulary has been expanded to nimi ku suli plus nimi su!.
- New "dictionary mode", just enter a single word and ilo Token will output all definition from its own dictionary. This also works for particles. To bypass this and translate the word as if it is the whole sentence, just add a period.
- Implement UCSUR support! It supports:
- Cartouche with nasin sitelen kalama
- Combined glyphs
- Long glyphs
- (Deprecated characters and combiners are not supported)
- Implement nasin nanpa pona.
- Implement settings dialog.
- Changes in error messages:
- All possible errors will now be listed.
- ilo Token now uses telo misikeke for error messages. This can be disabled from the settings.
- Multiline text will no longer be recognized.
- Add icons.
You may not notice this, we take good grammar for granted, but ilo Token now has generally better quality translations thanks to the following:
- It is now aware determiners are separate from adjectives. So you won't see adjectives like "nicely my", since adverbs can't modify determiners.
- It tries to ensure adjectives are in proper order. Yes this matters, it's "big red fruit" and not "red big fruit".
- Just like adjectives, determiners are also ordered, but unlike adjectives, they're also filtered (some combinations are not shown). You won't see "my your animal".
- It is aware of grammatical numbers. So you won't see "2 stick" or "1 sticks".
Inside update (intended for developers):
- Implement lexer and english AST.
- Overhaul dictionary: It is now a separate file with nicer syntax as opposed to written inside the code.
Released 24 Jan 2024
Update missed links.
Released 24 Jan 2024
The project has been renamed to ilo Token. The definition list has been given a huge overhaul.
- Change name to ilo Token.
- Remove unintended commas, these were found when translating "en" with more than 3 phrases.
- Remove copyright and license footer.
- Update definition list:
- It now uses latest Linku definition as the base.
- Include verbs for later use.
- Include interjection for later use.
Released 24 Jan 2024
For this version. The whole code has been rewritten. The translator can now translate few more things! Although it's still not capable of translating full sentences.
- Implement translator for:
- Extended numbering system
- Reduplication
- nanpa particle
- en and anu
- o vocative like "jan Koko o"
- Add button for translating, replacing auto-translate when typing.
- (Downgrade) Drop support for "a" particle.
- (Downgrade) Error messages are now very unreliable.
- (Downgrade) Translator is somewhat slower.
- Remove Discord DM as contact option.
- Update translation list:
- tonsi – change nouns "transgender", "transgenders", "non-binary", and "non-binaries" into "transgender person", "transgender people", "non-binary person", and "non-binary people" (I DIDN'T MEAN TO OBJECTIFY THEM OMFG I'M SO SORRY 😭😭😭)
Inside update (intended for developers):
- Rewritten whole code to use TypeScript, module, and functional programming.
- Rewritten parser to use parser combinator.
- Add language codes to html.
- New wiki for contributors and tinkerers.
- Overhaul
README.md, only including build instruction. Information about the translator is now moved to wiki.
Released 11 Jan 2024
- Update copyright notice.
- Update version number on the page.
- Update contacts to Discord. (from
neverRare#1517tonever_rare)
Released 11 Jan 2024
- Add "(adjective) in (adjective) way" translation.
- Handle complicated phrase as error.
- Rearrange output to make adjective phrase appear first.
- Add basic "la" translation: "given X, Y" and "if X, then Y".
- Fix multiple o error being triggered when there's only one o.
- Update translation list:
- ante – change "other" into "different", "different" have broader meaning than "other".
Released 23 Dec 2022
For this version. Major bugs related to phrase translation has been fixed. The translation lists has been updated as well.
You may need to force restart the webpage: shift + click the restart button; or ctrl + shift + R.
- Translator can now put emphasis on whole phrases.
- Fix "(content word) a" not being parsed properly.
- Fix "a (words)" not being parsed properly.
- Proper name now can't modify adjective translations – translations like "good named Nimi" are now removed.
- Untranslatable phrases now handled as untranslatable error.
- New kind of error where the sentence can't be translated but it should be
- Replaced "whoops" error with untranslatable error.
- Having at most one modifier after "pi" is now considered unrecognized error.
- Multiple "pi" is now considered unrecognized error.
- Fix adverbs and adjective not being translated properly.
- Handle multiple proper word as error – phrases like "jan Sonja pona Lang" will be unrecognizable.
- Simplify translation lists:
- toki – merge adjectives "speaking" and "writing" as "communicating".
- mun – merge "moon", "moons", "star", "stars", "planet" and "planets" into "celestial object" and "celestial objects".
- pilin – remove "feeling" and "feelings", "emotion" and "emotions" seems enough
- sona – remove "knowledgeably", doesn't seems to match the definition of sona.
- Replace translation words:
- ante – replace nouns "change" and "changes" with noun "changing".
- jan – replace "humanly" with "person-like".
- kama – replace "arrival" and "arrivals" with noun "arriving".
- pona – replace "properly" with "nicely".
- toki – replace "speech" and "speeches" with "communication" and "communications".
- selo – replace "shape" and "shapes" with "outer form", "boundary", and "boundaries".
- sewi – replace "up" with "above".
- Add translation words:
- anpa – add "under".
- lape – add adjective "sleeping".
- lawa – add adjective "controlling".
- lete – add "uncooked".
- mama – add "creators".
- musi – add "entertainingly".
- moli – add "deadly".
- nasa – add "strangely".
- pini – add adjective "ended".
- suwi – add "cuteness", "cute", and "sweetly".
- tan – add "origin".
- Minor fixes and changes.
Released 19 Dec 2022
For this version, the word list and translations have been updated. Few words that have been missed has been added. Translation lists has been updated. This includes simplifying translation lists such as deduplicating translation words that have mostly the same meaning, as well as adding more translation words.
The webpage has been updated as well. The color contrast has been updated to be accessible. The discord link has been updated so it points to the dedicated channel.
- Start versioning
- Add Nimi Ku Suli custom dictionary for Code Spell Checker user
- Change color of hyperlinks and error message to conform to WCAG 2.0 AAA
- Update discord links
- Add footnote
- Add missed words:
- ali – "everything", "all", and "completely"
- pali – "work" and adjective "working"
- palisa – "long hard thing", "long hard things", and "long hard"
- poki – "container"
- seme – "what" and "which"
- uta – "mouth"
- Simplify translation list of words:
- ante – remove "different", "other" seems enough
- jan – remove "persons", "people" seems enough
- kon – remove "essences", "essence" seems enough
- kule – remove "colour" and "colours", "color" and "colors" are kept
- linja – deduplicate "long flexible"
- mama – remove "caring" as noun
- ni – remove "these" and "those", "this" and "that" seems enough
- pana – remove "emission" and "emissions", these doesn't makes sense (smh my head, why did I added these)
- pimeja – remove "grey", "gray" is kept
- sama – remove "likeness", "similarity" seems enough
- sewi – remove "divinities", "divinity" seems enough
- sona – remove "knowledges", "knowledge" seems enough
- utala – remove "fight", "conflict" seems enough
- utala – remove "fighting", conflicting" seems enough
- wan – remove "lonliness". remove "single" as adjective, "one" seems enough
- Change translations:
- wan – change noun "single" to "one"
- pona – change "goodly" to "properly"
- Add translation words:
- awen – add "staying" as adjective
- ante – add "differently"
- jaki – add "disgustingly"
- kala – add "fish-like"
- kalama – add "sounding" as adjective
- kama – add "arriving" as adjective
- ken – add "possibility" and "possibilities"
- kasi – add "plant-like"
- lili – add "slightly"
- lipu – add "paper"
- lon – add "true"
- mama – add "creator"
- mu – add "mooing" as adjective
- pana – add "giving" as noun
- pimeja – add "brownness" and "grayness"
- pipi – add "bug-like" and "insect-like"
- sama – add "equally"
- sike – add "cycle" and "repeatedly"
- soweli – add "animal-like"
- toki – add "speaking" and "writing" as adjectives
- waso – add "bird-like"
- weka – add "leaving" as adjective
- Fix typos:
- Fix "femminine" to "feminine"
- Fix "femminity" to "feminity"
- Fix "siliness" to "silliness"
- Fix "trangender" to "transgender"
- Fix "writting" to "writing"
- Fix "writtings" to "writings"
- Minor fixes