tcsuite

Suite for gathering, processing and serving textual content

TODO

Method and interface comments
zh-TW tokenizer
Unify object instantiation and implementation interfaces for sub-components (lexicon/zhtwlexicon, fetcher/libertyfetcher, tokenizer/zhtwtokenizer, etc)
Add callback to Fetchers (for immediate tokenization)
Add tokenization tables to DB
Improve efficiency in conversion from original_content to tokenized_content

Name		Name	Last commit message	Last commit date
Latest commit History 42 Commits
assets/lexica		assets/lexica
content		content
entities		entities
fetcher		fetcher
lexicon		lexicon
repository		repository
test		test
tokenizer		tokenizer
.gitignore		.gitignore
LICENSE		LICENSE
README.md		README.md
main.go		main.go