Questions tagged [utf-8]
For discussions about UCS Transformation Format with 8 bits (UTF8). It is an encoding table that represents all characters in the Unicode character set.
270
questions
9
votes
2
answers
2k
views
Why does VIM show the Unicode code point and not the UTF-8 code value?
Consider this supposed line of code that I found in a PHP blog, note the quotes:
throw new Exception(“That's not a server name!”);
Those quotes are RIGHT DOUBLE QUOTATION MARK (Unicode code point: U+...
- 11.5k
3
votes
1
answer
2k
views
Input accents in iTerm with international keyboard
I have an international keyboard where accents are inserted doing
ALT+` e ==> è
ALT+e e ==> é
In Terminal.app this works correctly, in iTerm2 it doesn't. I get a bell sound when I press ...
- 1,773
0
votes
3
answers
4k
views
Why do some Unicode characters appear as boxes?
Some Unicode characters cannot be shown in my browser.
I generated valid Unicode (utf8) characters but many of them are unable to be displayed. If they don't have representation, then why are they ...
- 135
0
votes
1
answer
2k
views
How can I set the terminal encoding when running a crontab job?
I have a crontab job which executes a Ruby script on Arch Linux. It works basically, but when I call "googlecl" to post to my blog, it always shows a "safeDecodeError" exception (eg.: googlecl....
- 673
3
votes
1
answer
3k
views
pscp and UTF-8 characters
I'm having trouble copying files with UTF-8 characters using pscp on Windows. I'm using command line for that and following command:
chcp 65001
pscp -scp -p -pw {pass} -batch "user@remote_host:/...
- 708
0
votes
0
answers
2k
views
Convert pdf contains utf-8 to word or text files?
I have a pdf file that contain arabic text I need to convert this pdf to word for editing
but when it converted the characters displayed in unreadable format
any suggestion that can help me will be ...
- 101
1
vote
0
answers
500
views
Strange Unicode behavior in xterm
I recently switched my system from ISO-8859-15 to UTF-8 (I know I am a little late), works fine so far, I am just having a little issue with xterm and zsh.
When entering German - Umlaute (ä,ö,ü) and ...
9
votes
2
answers
3k
views
How to go to the n'th character, not byte, of a file?
In vim one can get to the 5th byte of the file with the following command:
:goto 5
However, in a UTF-8 text this could be the 5th, 4th, or even 2nd character in the file. How to go to the 5th ...
- 11.5k
35
votes
1
answer
149k
views
ANSI to UTF-8 in Notepad++
I have a text encoded in ANSI:
When I tried to convert it into UTF-8 (using the Notepad++ menu Encoding > UTF-8), I get some weird characters:
I thought that UTF-8 was a superset of ANSI and that I ...
- 355
0
votes
2
answers
2k
views
Adding/displaying special characters in Vim
I currently work on a project where I need to write the Unicode characters ɛ and ħ, which I just added to my keyboard.
It works great almost everywhere, even in the command prompt, except for Vim ...
- 547
1
vote
1
answer
162
views
Create folder with special characters in truecrypt on fedora 20
I have a problem to create folders and files containing special characters (eg é, è , ù , ç .... )
Volume:
Volume Type : Normal
Size: 10M
Encryption : AES
Hash : RIPEMD -160
File System : FAT
I ride ...
- 11
2
votes
2
answers
3k
views
How can I display utf8 in powershell?
So this really has me knocking my head against the wall. I have some XML:
<trans-unit id="4" translate="yes" xml:space="preserve">
<source xml:lang="en-US">Customize Forecast (...
- 140
5
votes
1
answer
23k
views
How to display text in UTF8 from mysql /phpmyadmin?
I have a database with multiple tables. The database and table and every row of table is set to utf8_romanian_ci.
Every name which I import that contains diacritics will not be displayed correctly.
...
- 51
5
votes
1
answer
281
views
English numbers in non-English subtitle
I wrote my subtitle in a word document & saved it as a txt file with UTF-8 encoding. Then I changed its format from txt to srt manually. my subtitle language is Persian.
I put it in the same ...
- 1,086
0
votes
1
answer
448
views
How to unzip the Portuguese file
I have a zip file containing data in Portuguese. When I try to unzip the file
$ unzip abc.zip
It creates a file "abc.csv" but when I try to look into data, I get "?" instead of characters like "á". ...
- 101
0
votes
1
answer
2k
views
How to find special characters in Linux Vim
I want to find special characters in a text file. It is known that the UTF-8 encoded file contains
Chinese characters ,
"-",
"^A"(control-A, which is one of special characters),
numbers,
...
- 491
0
votes
1
answer
2k
views
How to convert UTF-8 to SHIFT-JIS using vba
I am developing an application that reads from a text file and writes to a CSV file.
Since characters in the text file are UTF-8, the CSV file also contain the same characters.
Because of UTF-8, ...
- 63
1
vote
2
answers
2k
views
Batch convert to UTF-8 a directory having both UTF-8 and CP-1251 files
I have a directory containing files, some of them are UTF-8, some are CP-1251. I want to convert the ones that are CP-1251 to be UTF-8, but without corrupting the UTF-8 files.
I tried using iconv -f ...
- 4,031
0
votes
0
answers
390
views
Wide characters cause visual artifacts on weechat
I have some wide characters (◀▬▬ / ▬▬▶) set up as the join/part indicators in weechat. However, they tend to bleed over when I switch windows. How do I prevent this from happening?
Above is how ...
- 499
4
votes
1
answer
3k
views
How do I get MinTTY working with UTF8
I am using msys mintty on vista.
My font is Deja Vu Sans Mono, which has excellent unicode coverage.
The simplest test is to just cat this file: http://www.cl.cam.ac.uk/~mgk25/ucs/examples/UTF-8-...
- 161
14
votes
2
answers
42k
views
What encoding to get Å Ä Ö to work
I'm writing a small application in VB.NET that will enable me to
easily create a user "Windows 7 account" with a password, instead of
going through the control panel.
The problem I'm having ...
- 183
0
votes
1
answer
1k
views
Files saved in utf-8 shown broken in browsers
Now every time I save a file with utf-8 (default, like I did it the last 8 years) my browsers (Chrome, Firefox) can't read it properly any longer. If I use encoding utf-16 it works fine, but I don't ...
- 534
1
vote
1
answer
8k
views
Convert .txt. file from windows-1251 to utf-8
I'm trying to read the cyrillic text that is stored in .txt format. Once I open it with OpenOffice, it is OK. Once I open it with Notepad++, it shows unreadable symbols. Setting Windows-1251 prior ...
- 195
2
votes
2
answers
3k
views
Can't install gems with Ruby: “invalid byte sequence in UTF-8”
I'm using Mountain Lion. I've installed Ruby first with RVM, then with rbenv. I can assure it's running the latest one with which ruby, it correctly points to the one installed with rbenv.
gem won't ...
- 81
31
votes
4
answers
71k
views
Is there a Linux command to find out if a file is UTF-8?
The Joomla .ini files require to be saved as UTF-8.
After editing I'm not sure if the files are UTF-8 or not.
Is there a Linux command like file or a few commands that would tell if a file is ...
- 509
2
votes
1
answer
17k
views
How to automatically detect text file charset and convert it to UTF-8
Is there any way to auto-detect character encoding of a text file and convert it to UTF-8? I'm using Windows 7.
- 23
0
votes
1
answer
444
views
Converting iTunes m3u file to be readable by mpd (special characters and encoding issue)
I have generated a iTunes m3u file because it is easier to create specific playlist (with intelligent playlists). It needed a little conversion to replace ^M characters to newline, but now I have ...
- 13
2
votes
0
answers
1k
views
How can I use a password with special characters in desktop programs?
At the moment I am concerned about the security of my Facebook account. I have taken advantage of Facebook's ability to accept very long passwords with special characters, and created a password that ...
- 21
0
votes
1
answer
277
views
UTF-8 pages appear as garbage
On many occasions, when my browser (either Explorer or Chrome) on my Windows 7 Pro machine hit a UTF-8 page, what I get is garbage that looks like this one: http://24.media.tumblr.com/...
3
votes
2
answers
1k
views
ssh backspace deletes one character instead of two (utf-8 symbols)
Im accessing a remote computer using ssh and running a bash command to input symbols using standard input stream:
read test;echo $test
It's ok to input english letters and use backspace to delete ...
3
votes
1
answer
2k
views
Change default text encoding in EditPad
How can I set UTF-8 as default characters encoding for new files in EditPad?
- 4,998
13
votes
4
answers
19k
views
How can I get zsh to display international characters properly?
I just started using zsh, and love it. However, I've stumbled upon an annoyance when it comes to international characters:
➜ ~ touch åäö.txt
➜ ~ ls
...
- 821
0
votes
1
answer
1k
views
How does excel manage to correctly decode this file contents?
I start with an excel file with the contents in each row:
TEST
çığ
öğö
çüş
Then I export this file as a CSV file and save it as ANSI format (which from what I have read is same as US-ASCII). When I ...
- 143
19
votes
3
answers
17k
views
Program to check/look up UTF-8/Unicode characters in string on command line?
I've just realized I have a file on my system; it lists normally:
$ ls -la TΕSТER.txt
-rw-r--r-- 1 user user 8 2013-04-11 18:07 TΕSТER.txt
$ cat TΕSТER.txt
testing
... yet, it crashes a piece of ...
- 5,608
53
votes
5
answers
195k
views
Notepad++ inserting special Unicode characters in UTF-8
What's the best ways to enter special Unicode characters into a Notepad++ document? Do I have to rely on the operating system (Windows)?
Looking for a see-and-click solution.
I can bring up the ASCII ...
- 1,421
2
votes
1
answer
4k
views
Mime format message
How to read mime encoded files? We have converted .msg file to .mhtml for better reading without MS Outlook. But we cannot read encoded text in bounced mails. message is as
Content-Type: text/html; ...
- 813
0
votes
2
answers
97
views
Changing the format of cells
I have an Excel worksheet where one of the cells has the string "\xab\xcd\xef" etc. It seems as if Excel is taking this as the ASCII string "\xab\xcd\xef". How do I make Excel treat it as a binary ...
- 603
7
votes
1
answer
303
views
Is there a way to force all file transactions with a filesystem to be UTF8 or UTF16 compliant?
What I want is to specify that for a directory, every file creation/modification within said directory will be checked by the kernel and if the filename has unsupported characters the offending ...
- 71
2
votes
1
answer
11k
views
Convert ANSI text file(s) to UTF8 on Windows command line
I would like to convert (an) ANSI-encoded text file(s) (Win 1252) to UTF8 without BOM, ideally via a command-line call. My use-case: I export .tex files from Stata which I want to compile with ...
- 121
23
votes
2
answers
121k
views
Changing the default ANSI to UTF-8 in Notepad
I got an e-book reader a few months ago, and I finally figured out why it doesn't display .txt files correctly. It doesn't like ANSI. It has no problem with the other 3 types of coding notepad ...
- 231
0
votes
2
answers
1k
views
7za.exe 9.20 cannot create archive with non english letters filename (utf-8)
I'm struggling to have 7za.exe create an archive including non latin characters.
The encoding is utf-8, characters are cyrillic.
I have a folder with the 4 files:
7za.exe privet.txt Кириллица.txt ...
- 135
3
votes
1
answer
2k
views
utf-8 characters in emacs (only in term/ansi-term/multi-term) do not appear
I cannot for the life of me get utf-8 characters to appear correctly in emacs term mode on osx. They either appear as empty spaces or "<00e3><0081><00af>". I can view them in text buffers ...
- 131
13
votes
4
answers
12k
views
Fix encoding of German umlauts in directories and filenames (ü = u╠ê and so on)
I have many zip-files where there are encoding errors for the German umlauts (äüöÄÜÖß). They show up in both the filename.zip as well as in the included directories and files like this:
Fünf = Fu╠ênf
...
- 131
5
votes
2
answers
2k
views
tmux: trying to bind utf8 key
I'm using tmux 1.6 with konsole on Fedora 17 i686.
I have an azerty keyboard (with accentued chars), and I want ton bind 'ù' key.
I made the following ~/.tmux.conf:
setw -g utf8 on
bind-key ù split-...
- 165
10
votes
2
answers
6k
views
Trying to understand UTF-8 locale portability (and SSH) on various Linux systems including OS X
I spend a lot of my time sshed into various machines, all of which are different (some are embedded, some run Linux, some run BSD, &c.). On my own local machines, However, I use OS X, which of ...
- 1,829
2
votes
2
answers
3k
views
FFmpeg encoding for meta data wrong – need it in UTF8
When I run this command
ffmpeg.exe -i test.mp3 -metadata title="The Title You Want" -metadata artist="ÄÄÄßß!`n Artist Name" -metadata album="Name Fö#'ddp+!of the Album" -c:a copy -id3v2_version 3 ...
- 1,434
5
votes
1
answer
2k
views
file-name encoding problems
I googled over this topic but couldn't find what I was looking for... the following "happend" to me:
I had my files stored on a NTFS-USB Harddisk, because of space problems I moved them to an ext3 ...
- 173
6
votes
1
answer
605
views
Unadvisable to use UTF-8 for mails?
Thunderbird (in German) uses the charset ISO-8859-15 (or -1, can't check right now) by default for outgoing and incoming mails. (If you want to change the default, see How can I change the default ...
- 3,096
1
vote
2
answers
5k
views
How to use Putty in Japanese?
I am trying to use Putty to connect to a Linux server that has a file system that contains unicode characters (specifically Japanese)
My goal is to make it work the way it worked on Mac OS X Terminal ...
- 1,613
3
votes
1
answer
4k
views
WinMerge & Encoding
I have a problem with WinMerge (or more specific: WinMergeU). I have several php files that have the same content up to the chosen encoding.
How can I tell WinMerge to ignore the encoding?
If this is ...
- 345