Tagged Questions

For discussions about UCS Transformation Format with 8 bits(UTF8). It is a encoding table that represent all characters in the Unicode character set.

learn more… | top users | synonyms (1)

0
votes
1answer
36 views

How do I change the file encoding in Sublime Text 2?

Using all those techniques like: { "Default_encoding": "UTF-8", "font_size": 9, "ignored_packages": [ "Vintage" ] } and even when I save with UTF-8 encoding, always ...
0
votes
1answer
31 views

how to mass convert .xml files in a directory to UTF-8 while retaining the same filename

I have many .xml files that are encoded in ISO-8859-1, and I want them all in UTF-8. I figured out the code to convert them individually which is : iconv -f ISO-8859-1 -t UTF-8 filename.xml > ...
0
votes
1answer
48 views

Can I run a script every time the cmd program is run? [duplicate]

I want to show unicode character on my windows console. For this I changed the cmd's font to lucida console and I'm using chcp 65001 before every session I will open a program which will display ...
0
votes
0answers
23 views

utf-8 characters comes automatically

With great respect to all I am asking this question.Kindly help to solve for which I will remain most grateful and thankful. Few days ago I set Oriya language from the control panel to view webpages ...
2
votes
0answers
49 views

How to customize default CSV format in LibreOffice?

Every time I export my data to CSV (and I do it often) I have tick the "Edit filter settings" checkbox, choose UTF-8 for the encoding, and semicolon for the fields separator manually. I do this ...
0
votes
0answers
42 views

Enforce UTF-8 charset for outgoing attachments in Thunderbird

There are a few questions here about setting the charsets of outgoing messages in Thunderbird (1, 2), and some on setting content transfer encoding for attachments (3), but I haven't seen anything ...
0
votes
1answer
60 views

Hyphen converted to 'unknown character' when pasted to programs such as Putty, Notepad is OK

When a UTF-8-encoded hyphen (U+2010) is copied from a browser (I tried Firefox and IE) and then pasted to programs such as Putty and Vim (the Windows variants), all hyphens are showed as 'unknown ...
6
votes
2answers
652 views

Why does VIM show the Unicode code point and not the UTF-8 code value?

Consider this supposed line of code that I found in a PHP blog, note the quotes: throw new Exception(“That's not a server name!”); Those quotes are RIGHT DOUBLE QUOTATION MARK (Unicode code point: ...
0
votes
1answer
40 views

Input accents in iTerm with international keyboard

I have an international keyboard where accents are inserted doing ALT+` e ==> è ALT+e e ==> é In Terminal.app this works correctly, in iTerm2 it doesn't. I get a bell sound when I ...
0
votes
2answers
145 views

Why do some Unicode characters appear as boxes?

Some Unicode characters cannot be shown in my browser. I generated valid Unicode (utf8) characters but many of them are unable to be displayed. If they don't have representation, then why are they ...
0
votes
1answer
170 views

How can I set the terminal encoding when running a crontab job?

I have a crontab job which executes a Ruby script on Arch Linux. It works basically, but when I call "googlecl" to post to my blog, it always shows a "safeDecodeError" exception (eg.: ...
1
vote
1answer
103 views

pscp and UTF-8 characters

I'm having trouble copying files with UTF-8 characters using pscp on Windows. I'm using command line for that and following command: chcp 65001 pscp -scp -p -pw {pass} -batch ...
0
votes
0answers
108 views

Convert pdf contains utf-8 to word or text files?

I have a pdf file that contain arabic text I need to convert this pdf to word for editing but when it converted the characters displayed in unreadable format any suggestion that can help me will be ...
1
vote
0answers
59 views

Strange Unicode behavior in xterm

I recently switched my system from ISO-8859-15 to UTF-8 (I know I am a little late), works fine so far, I am just having a little issue with xterm and zsh. When entering German - Umlaute (ä,ö,ü) and ...
3
votes
2answers
81 views

How to go to the n'th character, not byte, of a file?

In vim one can get to the 5th byte of the file with the following command: :goto 5 However, in a UTF-8 text this could be the 5th, 4th, or even 2nd character in the file. How to go to the 5th ...
8
votes
1answer
5k views

ANSI to UTF-8 in Notepad++

I have a text encoded in ANSI: When I tried to convert it into UTF-8 (using the Notepad++ menu Encoding > UTF-8), I get some weird characters: I thought that UTF-8 was a superset of ANSI and ...
0
votes
1answer
141 views

Adding/displaying special characters in Vim

I currently work on a project where I need to write the Unicode characters ɛ and ħ, which I just added to my keyboard. It works great almost everywhere, even in the command prompt, except for Vim ...
1
vote
1answer
57 views

Create folder with special characters in truecrypt on fedora 20

I have a problem to create folders and files containing special characters (eg é, è , ù , ç .... ) Volume: Volume Type : Normal Size: 10M Encryption : AES Hash : RIPEMD -160 File System : FAT I ride ...
2
votes
2answers
112 views

How can I display utf8 in powershell?

So this really has me knocking my head against the wall. I have some XML: <trans-unit id="4" translate="yes" xml:space="preserve"> <source xml:lang="en-US">Customize Forecast ...
3
votes
1answer
747 views

How to display text in UTF8 from mysql /phpmyadmin?

I have a database with multiple tables. The database and table and every row of table is set to utf8_romanian_ci. Every name which I import that contains diacritics will not be displayed correctly. ...
4
votes
1answer
68 views

English numbers in non-English subtitle

I wrote my subtitle in a word document & saved it as a txt file with UTF-8 encoding. Then I changed its format from txt to srt manually. my subtitle language is Persian. I put it in the same ...
0
votes
1answer
46 views

How to unzip the Portuguese file

I have a zip file containing data in Portuguese. When I try to unzip the file $ unzip abc.zip It creates a file "abc.csv" but when I try to look into data, I get "?" instead of characters like ...
0
votes
1answer
218 views

How to find special characters in Linux Vim

I want to find special characters in a text file. It is known that the UTF-8 encoded file contains Chinese characters , "-", "^A"(control-A, which is one of special characters), numbers, ...
0
votes
0answers
471 views

how to get encode type of text file using vba

I would like to check encode type of text file is UTF-8 without bom or SHIFT-JIS. Because I change to SHIFT-JIS if encode type is UTF-8 without bom. So I want to get encode type of text file. What is ...
0
votes
1answer
247 views

How to convert UTF-8 to SHIFT-JIS using vba

I am developing an application that reads from a text file and writes to a CSV file. Since characters in the text file are UTF-8, the CSV file also contain the same characters. Because of UTF-8, ...
1
vote
2answers
370 views

Batch convert to UTF-8 a directory having both UTF-8 and CP-1251 files

I have a directory containing files, some of them are UTF-8, some are CP-1251. I want to convert the ones that are CP-1251 to be UTF-8, but without corrupting the UTF-8 files. I tried using iconv -f ...
0
votes
0answers
88 views

Wide characters cause visual artifacts on weechat

I have some wide characters (◀▬▬ / ▬▬▶) set up as the join/part indicators in weechat. However, they tend to bleed over when I switch windows. How do I prevent this from happening? Above is how ...
0
votes
0answers
131 views

Cannot type non-ASCII character in console using UTF-8 (65001) codepage?

First, I type > chcp 950 to change console codepage 437 into codepage 950 I can type both non-ASCII character (TradChinese character) and ASCII. But, if I type > chcp 65001 I can only ...
3
votes
1answer
239 views

How do I get MinTTY working with UTF8

I am using msys mintty on vista. My font is Deja Vu Sans Mono, which has excellent unicode coverage. The simplest test is to just cat this file: ...
0
votes
1answer
227 views

Files saved in utf-8 shown broken in browsers

Now every time I save a file with utf-8 (default, like I did it the last 8 years) my browsers (Chrome, Firefox) can't read it properly any longer. If I use encoding utf-16 it works fine, but I don't ...
0
votes
1answer
513 views

Convert .txt. file from windows-1251 to utf-8

I'm trying to read the cyrillic text that is stored in .txt format. Once I open it with OpenOffice, it is OK. Once I open it with Notepad++, it shows unreadable symbols. Setting Windows-1251 prior ...
1
vote
2answers
648 views

Can't install gems with Ruby: “invalid byte sequence in UTF-8”

I'm using Mountain Lion. I've installed Ruby first with RVM, then with rbenv. I can assure it's running the latest one with which ruby, it correctly points to the one installed with rbenv. gem won't ...
2
votes
1answer
1k views

Is there a Linux command to file out if a file is UTF-8?

The Joomla .ini files require to be saved as UTF-8. After editing I'm not sure if the files are UTF-8 or not. Is there a linux command like 'file' or a few commands that would tell if a file is indeed ...
0
votes
1answer
1k views

How to automatically detect text file charset and convert it to UTF-8

Is there any way to auto-detect character encoding of a text file and convert it to UTF-8? I'm using Windows 7.
0
votes
1answer
113 views

Converting iTunes m3u file to be readable by mpd (special characters and encoding issue)

I have generated a iTunes m3u file because it is easier to create specific playlist (with intelligent playlists). It needed a little conversion to replace ^M characters to newline, but now I have ...
2
votes
0answers
500 views

How can I use a password with special characters in desktop programs?

At the moment I am concerned about the security of my Facebook account. I have taken advantage of Facebook's ability to accept very long passwords with special characters, and created a password that ...
0
votes
1answer
105 views

UTF-8 pages appear as garbage

On many occasions, when my browser (either Explorer or Chrome) on my Windows 7 Pro machine hit a UTF-8 page, what I get is garbage that looks like this one: ...
2
votes
2answers
317 views

ssh backspace deletes one character instead of two (utf-8 symbols)

Im accessing a remote computer using ssh and running a bash command to input symbols using standard input stream: read test;echo $test It's ok to input english letters and use backspace to ...
1
vote
1answer
126 views

Change default text encoding in EditPad

How can I set UTF-8 as default characters encoding for new files in EditPad?
4
votes
1answer
399 views

How can I get zsh to display international characters properly?

I just started using zsh, and love it. However, I've stumbled upon an annoyance when it comes to international characters: ➜ ~ touch åäö.txt ➜ ~ ls ...
0
votes
1answer
522 views

How does excel manage to correctly decode this file contents?

I start with an excel file with the contents in each row: TEST çığ öğö çüş Then I export this file as a CSV file and save it as ANSI format (which from what I have read is same as US-ASCII). When I ...
3
votes
2answers
632 views

Program to check/look up UTF-8/Unicode characters in string on command line?

I've just realized I have a file on my system; it lists normally: $ ls -la TΕSТER.txt -rw-r--r-- 1 user user 8 2013-04-11 18:07 TΕSТER.txt $ cat TΕSТER.txt testing ... yet, it crashes a piece of ...
7
votes
2answers
10k views

Notepad++ inserting special Unicode characters in UTF-8

What's the best ways to enter special Unicode characters into a Notepad++ document? Do I have to rely on the operating system (Windows)? Looking for a see-and-click solution. I can bring up the ...
2
votes
1answer
908 views

Mime format message

How to read mime encoded files? We have converted .msg file to .mhtml for better reading without MS Outlook. But we cannot read encoded text in bounced mails. message is as Content-Type: text/html; ...
0
votes
2answers
83 views

Changing the format of cells

I have an Excel worksheet where one of the cells has the string "\xab\xcd\xef" etc. It seems as if Excel is taking this as the ASCII string "\xab\xcd\xef". How do I make Excel treat it as a binary ...
7
votes
1answer
208 views

Is there a way to force all file transactions with a filesystem to be UTF8 or UTF16 compliant?

What I want is to specify that for a directory, every file creation/modification within said directory will be checked by the kernel and if the filename has unsupported characters the offending ...
1
vote
1answer
3k views

Convert ANSI text file(s) to UTF8 on Windows command line

I would like to convert (an) ANSI-encoded text file(s) (Win 1252) to UTF8 without BOM, ideally via a command-line call. My use-case: I export .tex files from Stata which I want to compile with ...
3
votes
2answers
7k views

Changing the default ANSI to UTF-8 in Notepad

I got an e-book reader a few months ago, and I finally figured out why it doesn't display .txt files correctly. It doesn't like ANSI. It has no problem with the other 3 types of coding notepad ...
0
votes
2answers
272 views

7za.exe 9.20 cannot create archive with non english letters filename (utf-8)

I'm struggling to have 7za.exe create an archive including non latin characters. The encoding is utf-8, characters are cyrillic. I have a folder with the 4 files: 7za.exe privet.txt Кириллица.txt ...
0
votes
0answers
301 views

Excel csv encoding default

Ok here's the deal I exported a csv in UTF-16 format via PHP and open it in excel...All the encoding works perfectly. My question is, suppose I edit this csv and then just hit save in excel and ...