Skip to content

eyalr/unicode_mayo

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

18 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

unicode_mayo

unicode_mayo is the mayo in your unicode sandwich. In your development environment, use it as a wrapper around unicode and byte strings to see if they're accidentally coming in to contact with byte strings. This can help catch unicode encode/decode errors before they happen in production!

unicode_mayo includes two classes: UnicodeSafetyWrapper and BytestringSafetyWrapper. The former is meant to envelope unicode strings, and warns when they come into contact with byte strings; the latter is meant for byte strings, and warns when it comes into contact with unicode. Place these in strategic places (likely in development environments only), like gettext() or all strings from your database.

Installation

Installation via pip:

pip install unicode_mayo

Usage

Something like:

>>> import unicode_mayo
>>> wrapped = unicode_mayo.UnicodeSafetyWrapper(u'safety at last!')
>>> wrapped.encode('utf-8')
'safety at last!'
>>> wrapped + u' woohoo!'
u'safety at last! woohoo!'
>>> wrapped + 'evil bytestring'
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/Users/eyalr/personal_work/unicode_mayo/src/unicode_mayo/__init__.py", line 55, in __add__
    _fail_on_bytes(other)
  File "/Users/eyalr/personal_work/unicode_mayo/src/unicode_mayo/__init__.py", line 90, in _fail_on_bytes
    _fail_on_bytes_helper(other)
  File "/Users/eyalr/personal_work/unicode_mayo/src/unicode_mayo/__init__.py", line 81, in _fail_on_bytes_helper
    'Attempted string formatting without decoding utf-8'
TypeError: Attempted string formatting without decoding utf-8

About

The mayo on your unicode sandwich

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages