Sometimes I edit English text that includes Unicode characters. For some reason, on my PC, Notepad++ converts Unicode characters to ???'s thereby corrupting the text and losing all that data. I'm looking for a way to edit such text, while preserving Unicode characters. I'm using [Consolas][2] as my Font. If the font doesn't have all those characters, why should I lose the data when I copy the text out of Notepad++ (via Windows' clipboard)?

link|improve this question

If those are question marks in boxes, then it's in fact the font's glyph for missing glyphs and your data is not lost. – Joey Aug 13 '09 at 19:11
No its not in boxes, instead its the plain '?' character. Confirmed. – Jenko Mar 5 '10 at 23:15
you may need to change the font. see superuser.com/questions/16831/… – RamyenHead Jul 22 '10 at 19:37
feedback

5 Answers

up vote 6 down vote accepted

If the file is actually encoded in Unicode, NP++ should detect it automatically. The Consolas font works well for me. You can try one of these two menu options:

  • Format > Encode in UTF-8
  • Format > Convert to UTF-8

I'm pretty sure the first one will do what you want.

link|improve this answer
feedback

There are good news and bad news.

Good news: Notepad++ supports Unicode (at least from what I can gather).

Bad news: Apparently Unicode support is only on Windows XP.

I actually do not have a Windows machine in front of me. From what I remember, there is an Encoding menu under the Format menu somewhere. The encoding for Unicode is actually most commonly UTF-8.

Here is a 'pretty' picture of Unicode support in Notepad++,

enter image description here

link|improve this answer
feedback

Unicode works perfectly on Windows 7. The only issue that comes up is that you have to retype the characters that have been changed. It's happened to me. I'm writing with Scandinavian letters so ä -> E4, ö -> F6. It's a pain in the butt to replace them all, but it's worth it.

If you encode a page from ANSI -> UTF-8 then there will be some character problems.

I would suggest that you first create a new page in UTF-8 and then copy/paste your information over. There won't/shouldn't be any trouble then.

link|improve this answer
feedback

Could it be your using a plugin that doesn't support Unicode?

link|improve this answer
feedback

The problem described in the question happens when an empty/new document is set to "ANSI" and Unicode characters are pasted into it.

There is no auto-detection when used with an empty/new document, at least not in the version of Notepad++ I tested it on. "ANSI" is the default in Notepad++ for a new document unless set in menu Settings/Preferences/tab "New Document/Open Save Directory".

Solution

The solution is to set the encoding to UTF-8 before pasting, menu Format/Encode in UTF-8:

Menu command "menu Format/Encode in UTF-8" about to be executed

Example

I copied some text to a new Notepad++ document, Russian (русский язык, russkiy yazyk,, from Firefox showing the Wikipedia page Russian language.

If the encoding is not changed from "ANSI" this is the result:

Result of pasting the Unicode string "Russian (русский язык, russkiy yazyk" into a new Notepad++ document without changing the encoding from the default "ANSI"

If the encoding is changed this is the result:

Result of pasting the Unicode string "Russian (русский язык, russkiy yazyk" into a new Notepad++ document after changing the encoding from the default "ANSI" to "UTF-8"

As can be seen in the figure below (the Cyrillic part is highlighted), Notepad++ actually converts the Unicode characters into ASCII 63 (hex 3F), question marks. That is why the Unicode characters are lost (in "ANSI" mode) when copying the text out through the clipboard (it is not a font issue - information is lost).

enter image description here

Tested on: Notepad++ v5.4.5 (UNICODE).

link|improve this answer
feedback

Your Answer

 
or
required, but never shown

Not the answer you're looking for? Browse other questions tagged or ask your own question.