logging fails with unicode chars

[ttaghavi]

Error traceback (last part):

File "/data/webadmin/.virtualenvs/ui/lib/python2.7/site-packages/nodeenv.py", line 144, in emit
self.stream.write(fs % msg)
UnicodeEncodeError: 'ascii' codec can't encode character u'\u2018' in position 42: ordinal not in range(128)

Since the encode/decode functions always confused me since I started using python, not sure what the best way would be to fix this.

What worked for me was:

self.stream.write(fs % msg.encode('utf8'))

But this will fail if msg is of type 'str'

[jhermann]

A helper like this is relatively robust and fixes the problem most of the time…

https://github.com/jhermann/waif/blob/master/python/to_uft8.py

[ekalinin]

@ttaghavi, Thanks for the report!
@jhermann, Thanks for the link! Seems it will be very useful here.

And seems this bug is correlated with #49

[ralcini]

+1

[ralcini]

stream seems support only ascii strings, non ascii chars can be ignored or replaced with placeholder. What do you think?

--- lib/python2.6/site-packages/nodeenv.py  2015-07-16 17:07:09.000000000 +0200
+++ lib/python2.6/site-packages/nodeenv.py  2015-07-16 17:08:07.344132749 +0200
@@ -152,7 +152,7 @@
     def emit(self, record):
         msg = self.format(record)
         fs = "%s" if getattr(record, "continued", False) else "%s\n"
-        self.stream.write(fs % msg)
+        self.stream.write(fs % msg.encode('ascii', 'ignore'))
         self.flush()
     logging.StreamHandler.emit = emit