For discussions about UCS Transformation Format with 8 bits(UTF8). It is a encoding table that represent all characters in the Unicode character set.

learn more… | top users | synonyms (1)

6
votes
2answers
541 views

Why does VIM show the Unicode code point and not the UTF-8 code value?

Consider this supposed line of code that I found in a PHP blog, note the quotes: throw new Exception(“That's not a server name!”); Those quotes are RIGHT DOUBLE QUOTATION MARK (Unicode code point: ...
0
votes
1answer
23 views

Input accents in iTerm with international keyboard

I have an international keyboard where accents are inserted doing ALT+` e ==> è ALT+e e ==> é In Terminal.app this works correctly, in iTerm2 it doesn't. I get a bell sound when I ...
0
votes
2answers
82 views

Why do some Unicode characters appear as boxes?

Some Unicode characters cannot be shown in my browser. I generated valid Unicode (utf8) characters but many of them are unable to be displayed. If they don't have representation, then why are they ...
0
votes
1answer
31 views

How can I set the terminal encoding when running a crontab job?

I have a crontab job which executes a Ruby script on Arch Linux. It works basically, but when I call "googlecl" to post to my blog, it always shows a "safeDecodeError" exception (eg.: ...
1
vote
1answer
45 views

pscp and UTF-8 characters

I'm having trouble copying files with UTF-8 characters using pscp on Windows. I'm using command line for that and following command: chcp 65001 pscp -scp -p -pw {pass} -batch ...
0
votes
0answers
24 views

Convert pdf contains utf-8 to word or text files?

I have a pdf file that contain arabic text I need to convert this pdf to word for editing but when it converted the characters displayed in unreadable format any suggestion that can help me will be ...
1
vote
0answers
29 views

Strange Unicode behavior in xterm

I recently switched my system from ISO-8859-15 to UTF-8 (I know I am a little late), works fine so far, I am just having a little issue with xterm and zsh. When entering German - Umlaute (ä,ö,ü) and ...
3
votes
2answers
72 views

How to go to the n'th character, not byte, of a file?

In vim one can get to the 5th byte of the file with the following command: :goto 5 However, in a UTF-8 text this could be the 5th, 4th, or even 2nd character in the file. How to go to the 5th ...
7
votes
1answer
789 views

ANSI to UTF-8 in Notepad++

I have a text encoded in ANSI: When I tried to convert it into UTF-8 (using the Notepad++ menu Encoding > UTF-8), I get some weird characters: I thought that UTF-8 was a superset of ANSI and ...
0
votes
1answer
67 views

Adding/displaying special characters in Vim

I currently work on a project where I need to write the Unicode characters ɛ and ħ, which I just added to my keyboard. It works great almost everywhere, even in the command prompt, except for Vim ...
1
vote
1answer
40 views

Create folder with special characters in truecrypt on fedora 20

I have a problem to create folders and files containing special characters (eg é, è , ù , ç .... ) Volume: Volume Type : Normal Size: 10M Encryption : AES Hash : RIPEMD -160 File System : FAT I ride ...
2
votes
2answers
69 views

How can I display utf8 in powershell?

So this really has me knocking my head against the wall. I have some XML: <trans-unit id="4" translate="yes" xml:space="preserve"> <source xml:lang="en-US">Customize Forecast ...
3
votes
1answer
207 views

How to display text in UTF8 from mysql /phpmyadmin?

I have a database with multiple tables. The database and table and every row of table is set to utf8_romanian_ci. Every name which I import that contains diacritics will not be displayed correctly. ...
3
votes
1answer
48 views

English numbers in non-English subtitle

I wrote my subtitle in a word document & saved it as a txt file with UTF-8 encoding. Then I changed its format from txt to srt manually. my subtitle language is Persian. I put it in the same ...
0
votes
1answer
33 views

How to unzip the Portuguese file

I have a zip file containing data in Portuguese. When I try to unzip the file $ unzip abc.zip It creates a file "abc.csv" but when I try to look into data, I get "?" instead of characters like ...
0
votes
1answer
168 views

How to find special characters in Linux Vim

I want to find special characters in a text file. It is known that the UTF-8 encoded file contains Chinese characters , "-", "^A"(control-A, which is one of special characters), numbers, ...
0
votes
0answers
388 views

how to get encode type of text file using vba

I would like to check encode type of text file is UTF-8 without bom or SHIFT-JIS. Because I change to SHIFT-JIS if encode type is UTF-8 without bom. So I want to get encode type of text file. What is ...
0
votes
1answer
230 views

How to convert UTF-8 to SHIFT-JIS using vba

I am developing an application that reads from a text file and writes to a CSV file. Since characters in the text file are UTF-8, the CSV file also contain the same characters. Because of UTF-8, ...
1
vote
2answers
254 views

Batch convert to UTF-8 a directory having both UTF-8 and CP-1251 files

I have a directory containing files, some of them are UTF-8, some are CP-1251. I want to convert the ones that are CP-1251 to be UTF-8, but without corrupting the UTF-8 files. I tried using iconv -f ...
0
votes
0answers
75 views

Wide characters cause visual artifacts on weechat

I have some wide characters (◀▬▬ / ▬▬▶) set up as the join/part indicators in weechat. However, they tend to bleed over when I switch windows. How do I prevent this from happening? Above is how ...
0
votes
0answers
106 views

Cannot type non-ASCII character in console using UTF-8 (65001) codepage?

First, I type > chcp 950 to change console codepage 437 into codepage 950 I can type both non-ASCII character (TradChinese character) and ASCII. But, if I type > chcp 65001 I can only ...
3
votes
1answer
165 views

How do I get MinTTY working with UTF8

I am using msys mintty on vista. My font is Deja Vu Sans Mono, which has excellent unicode coverage. The simplest test is to just cat this file: ...
0
votes
1answer
186 views

Files saved in utf-8 shown broken in browsers

Now every time I save a file with utf-8 (default, like I did it the last 8 years) my browsers (Chrome, Firefox) can't read it properly any longer. If I use encoding utf-16 it works fine, but I don't ...
0
votes
1answer
394 views

Convert .txt. file from windows-1251 to utf-8

I'm trying to read the cyrillic text that is stored in .txt format. Once I open it with OpenOffice, it is OK. Once I open it with Notepad++, it shows unreadable symbols. Setting Windows-1251 prior ...
1
vote
1answer
399 views

Can't install gems with Ruby: “invalid byte sequence in UTF-8”

I'm using Mountain Lion. I've installed Ruby first with RVM, then with rbenv. I can assure it's running the latest one with which ruby, it correctly points to the one installed with rbenv. gem won't ...
1
vote
1answer
644 views

Is there a Linux command to file out if a file is UTF-8?

The Joomla .ini files require to be saved as UTF-8. After editing I'm not sure if the files are UTF-8 or not. Is there a linux command like 'file' or a few commands that would tell if a file is indeed ...
0
votes
1answer
583 views

How to automatically detect text file charset and convert it to UTF-8

Is there any way to auto-detect character encoding of a text file and convert it to UTF-8? I'm using Windows 7.
0
votes
1answer
101 views

Converting iTunes m3u file to be readable by mpd (special characters and encoding issue)

I have generated a iTunes m3u file because it is easier to create specific playlist (with intelligent playlists). It needed a little conversion to replace ^M characters to newline, but now I have ...
2
votes
0answers
135 views

How can I use a password with special characters in desktop programs?

At the moment I am concerned about the security of my Facebook account. I have taken advantage of Facebook's ability to accept very long passwords with special characters, and created a password that ...
0
votes
1answer
92 views

UTF-8 pages appear as garbage

On many occasions, when my browser (either Explorer or Chrome) on my Windows 7 Pro machine hit a UTF-8 page, what I get is garbage that looks like this one: ...
2
votes
2answers
280 views

ssh backspace deletes one character instead of two (utf-8 symbols)

Im accessing a remote computer using ssh and running a bash command to input symbols using standard input stream: read test;echo $test It's ok to input english letters and use backspace to ...
1
vote
1answer
110 views

Change default text encoding in EditPad

How can I set UTF-8 as default characters encoding for new files in EditPad?
4
votes
1answer
279 views

How can I get zsh to display international characters properly?

I just started using zsh, and love it. However, I've stumbled upon an annoyance when it comes to international characters: ➜ ~ touch åäö.txt ➜ ~ ls ...
0
votes
1answer
416 views

How does excel manage to correctly decode this file contents?

I start with an excel file with the contents in each row: TEST çığ öğö çüş Then I export this file as a CSV file and save it as ANSI format (which from what I have read is same as US-ASCII). When I ...
3
votes
2answers
479 views

Program to check/look up UTF-8/Unicode characters in string on command line?

I've just realized I have a file on my system; it lists normally: $ ls -la TΕSТER.txt -rw-r--r-- 1 user user 8 2013-04-11 18:07 TΕSТER.txt $ cat TΕSТER.txt testing ... yet, it crashes a piece of ...
7
votes
2answers
8k views

Notepad++ inserting special Unicode characters in UTF-8

What's the best ways to enter special Unicode characters into a Notepad++ document? Do I have to rely on the operating system (Windows)? Looking for a see-and-click solution. I can bring up the ...
2
votes
1answer
665 views

Mime format message

How to read mime encoded files? We have converted .msg file to .mhtml for better reading without MS Outlook. But we cannot read encoded text in bounced mails. message is as Content-Type: text/html; ...
0
votes
2answers
82 views

Changing the format of cells

I have an Excel worksheet where one of the cells has the string "\xab\xcd\xef" etc. It seems as if Excel is taking this as the ASCII string "\xab\xcd\xef". How do I make Excel treat it as a binary ...
7
votes
1answer
206 views

Is there a way to force all file transactions with a filesystem to be UTF8 or UTF16 compliant?

What I want is to specify that for a directory, every file creation/modification within said directory will be checked by the kernel and if the filename has unsupported characters the offending ...
1
vote
1answer
3k views

Convert ANSI text file(s) to UTF8 on Windows command line

I would like to convert (an) ANSI-encoded text file(s) (Win 1252) to UTF8 without BOM, ideally via a command-line call. My use-case: I export .tex files from Stata which I want to compile with ...
2
votes
1answer
5k views

Changing the default ANSI to UTF-8 in Notepad

I got an e-book reader a few months ago, and I finally figured out why it doesn't display .txt files correctly. It doesn't like ANSI. It has no problem with the other 3 types of coding notepad ...
0
votes
2answers
242 views

7za.exe 9.20 cannot create archive with non english letters filename (utf-8)

I'm struggling to have 7za.exe create an archive including non latin characters. The encoding is utf-8, characters are cyrillic. I have a folder with the 4 files: 7za.exe privet.txt Кириллица.txt ...
0
votes
0answers
249 views

Excel csv encoding default

Ok here's the deal I exported a csv in UTF-16 format via PHP and open it in excel...All the encoding works perfectly. My question is, suppose I edit this csv and then just hit save in excel and ...
3
votes
2answers
486 views

utf-8 characters in emacs (only in term/ansi-term/multi-term) do not appear

I cannot for the life of me get utf-8 characters to appear correctly in emacs term mode on osx. They either appear as empty spaces or "<00e3><0081><00af>". I can view them in text buffers ...
3
votes
0answers
326 views

Fix encoding of German umlauts in directories and filenames (ü = u╠ê and so on)

I have many zip-files where there are encoding errors for the German umlauts (äüöÄÜÖß). They show up in both the filename.zip as well as in the included directories and files like this: Fünf = ...
2
votes
1answer
415 views

tmux: trying to bind utf8 key

I'm using tmux 1.6 with konsole on Fedora 17 i686. I have an azerty keyboard (with accentued chars), and I want ton bind 'ù' key. I made the following ~/.tmux.conf: setw -g utf8 on bind-key ù ...
3
votes
2answers
2k views

UTF-8 locale portability (and ssh)

I spend a lot of my time sshed into various machines, all of which are different (some are embedded, some run Linux, some run BSD, &c.). On my own local machines, however, i use OS X, which of ...
1
vote
0answers
263 views

FFmpeg encoding for meta data wrong – need it in UTF8

When I run this command ffmpeg.exe -i test.mp3 -metadata title="The Title You Want" -metadata artist="ÄÄÄßß!`n Artist Name" -metadata album="Name Fö#'ddp+!of the Album" -c:a copy -id3v2_version 3 ...
4
votes
1answer
877 views

file-name encoding problems

I googled over this topic but couldn't find what I was looking for... the following "happend" to me: I had my files stored on a NTFS-USB Harddisk, because of space problems I moved them to an ext3 ...
6
votes
1answer
232 views

Unadvisable to use UTF-8 for mails?

Thunderbird (in German) uses the charset ISO-8859-15 (or -1, can't check right now) by default for outgoing and incoming mails. (If you want to change the default, see Change Thunderbird default ...