Sentence piece wants a string, not <class 'pathlib.PosixPath'>

[xaviergonzalez]

Hi, I've downloaded your code and pip installed your requirements.txt

However, when I try to run python one_file_ref.py, I get an error stemming from this line in tokenizer.py

self._model = SentencePieceProcessor(model_file=model_path)

It seems that model_path has type <class 'pathlib.PosixPath'>, whereas SentencePieceProcessor wants a string.

What version of python were you using? It seems like this is a versioning problem that we'd like to get around?

This issue may be relevant: omry/omegaconf#934

[AakashKumarNain]

This is weird. I don't remember the exact version, but it should either be 31.0 or 3.11 (more probably this one). Anyway, thanks for notifying this. I will fix this