mwmbl/test/test_indexdb.py

from mwmbl.tokenizer import clean_unicode


def test_clean_unicode():
    result = clean_unicode('Bad extract text \ud83c')
    assert result == 'Bad extract text '
Clean unicode when formatting result 2023-05-20 21:11:51 +00:00			`from mwmbl.tokenizer import clean_unicode`
Fix unicode encoding error 2022-07-16 09:54:25 +00:00

			`def test_clean_unicode():`
			`result = clean_unicode('Bad extract text \ud83c')`
			`assert result == 'Bad extract text '`