Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [character-encoding]

A character encoding system consists of a code that pairs each character from a given repertoire with something else — such as a bit pattern, sequence of natural numbers, octets, or electrical pulses — in order to facilitate the transmission of data (generally numbers or text) through telecommunication networks or for data storage.

0
votes
2answers
899 views

The font has chinese characters but I can't type it out?

I am using a font, Kievit for a design project. It is an English font however it says it supports Chinese characters. By using Character Maps, I can see there is Chinese characters in it. But every ...
2
votes
1answer
1k views

FFmpeg encoding for meta data wrong – need it in UTF8

When I run this command ffmpeg.exe -i test.mp3 -metadata title="The Title You Want" -metadata artist="ÄÄÄßß!`n Artist Name" -metadata album="Name Fö#'ddp+!of the Album" -c:a copy -id3v2_version 3 ...
0
votes
1answer
2k views

How can I check the encoding of the tag in Mp3 file?

I want to ensure that the tag inside is using unicode, otherwise it may display incorrectly in media player. For example, many mp3 in my pc is japanese so they are having janpanese character tag. If ...
1
vote
5answers
1k views

Scrutiny all visible or invisible characters of a text file [closed]

Is there any software that can be used to scrutinize all visible or invisible characters in a text file (characters like BOM, direction mark, line feed ...)? Showing the Unicode name of characters ...
3
votes
2answers
5k views

Character sets needed to properly display “zalgo”

The following answer on Stack Overflow is famous for its convincing argument against using regex to parse HTML: https://stackoverflow.com/a/1732454/505154 The content of the post becomes increasingly ...
0
votes
1answer
857 views

Cannot open text files with Turkish characters

I am learning Turkish and I would like to be able to open Turkish text files. I am running Windows 7 and I have even installed the Turkish display language for Windows. But I am still not able to ...
3
votes
1answer
2k views

WinMerge & Encoding

I have a problem with WinMerge (or more specific: WinMergeU). I have several php files that have the same content up to the chosen encoding. How can I tell WinMerge to ignore the encoding? If this is ...
2
votes
2answers
2k views

Windows codepage is broken

My Windows installation has Latin and Cyrillic inputs enabled, but uses the English layout. And I suddenly realized that non-unicode programs can not display Cyrillic symbols. They are displayed as ...
0
votes
2answers
1k views

ANSI file with charSet with latin character

I´m with a doubt about encoding/charset. I make a test. Typing the string "TEST Á" without the quotes in Notepad++ with encode in ANSI. "The ANSI charsets are all the same for ASCII characters such ...
0
votes
1answer
1k views

How to add CP-1252 to CentOS

We are processing files that our clients generated on their local Windows machines which use the CP-1252 character set. Occasionally, while processing one of these files in our backend (running on ...
1
vote
1answer
250 views

Automated script to change page encoding after page has been downloaded in Google Chrome

guys! My Chrome doesn't properly recognize page encoding of our local TWIKI site. So, every time i enter the site i have to set suitable encoding manually (Settings -> Tools -> Encoding -> Cyrillic (...
0
votes
1answer
9k views

how to display chinese character in BASH shell

I need to launch a binary in bash and the output of the binary consist of some Chinese character. so my question is how to let bash display Chinese character correctly. by the way, I use Centos.
0
votes
1answer
6k views

How do I change the character set of an excel file?

I have an excel file that I need to change to UTF-16. is this possible?
27
votes
1answer
14k views

What is this '°͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌' strange character?

I saw this °͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌ strange character online. I also noted that: It needs 26 backspaces to delete but behaves like one character when selecting. It is drawn vertically covering ...
4
votes
6answers
10k views

What could cause the file command in Linux to report a text file as data?

I have a couple of C++ source files (one .cpp and one .h) that are being reported as type data by the file command in Linux. When I run the file -bi command against these files, I'm given this output (...
0
votes
1answer
872 views

Character encoding mismatch on certain web pages

I use recent release of Firefox for viewing web pages. When I visit some sites – this one and this – Firefox displays a diamond shaped character in the web page in places where punctation characters ...
0
votes
1answer
215 views

Chinese characters now show up as boxes

My folders on Windows 7 with Chinese characters in the names have now started showing up as boxes. I can still read Chinese characters off a webpage, but the rest are boxes.
0
votes
1answer
2k views

Why are these weird characters displayed in embedded YouTube videos, GitHub client and a few other places?

Edit: If you're experiencing similar strangeness as in the screenshots, try resetting your font cache. There's a brilliant free app called FontNuke which will do it automatically and worked for me ...
2
votes
3answers
12k views

Cyrillic export from Excel to CSV

I have an application where I upload some content in CSV format, however the main document where I have my data is an Excel document. I use Save As » CSV in order to make a CSV file, but it is not ...
13
votes
7answers
16k views

What could cause strange characters in Vim?

I'm have this really strange problem in Vim using the NERD tree plugin, where, as you can see in the picture, the characters are showing up very strange. Where there is the ahat, ~V 3/4 it should be |-...
1
vote
2answers
1k views

Filename becomes gibberish

Using JDownloader to download some files makes the filename looks like ".æ­·å²è¬åï¼çç æ¸¯ä¸é" on my file system. The original filename is in Chinese. Is this a encoding issue? (original encoding not ...
2
votes
1answer
556 views

How to convert mounted filesystem between codepages?

I have an external drive formatted in ext3 (basically) that previously was connected to a Linksys NLSU2 NAS device. Now the NSLU2 is broken and I have struggled to restore the files on the disk ...
2
votes
2answers
2k views

Cutting & Pasting Vietnamese characters from a PDF

I'm trying to copy/paste a bunch of Vietnamese text from a PDF document to Notepad++ (or anything, nothing works). The pasted text is different than the source text. What would be the best way to go ...
0
votes
1answer
164 views

The text contains characters that cannot be saved in the current encoding. Possibility wanted to highlight those

After copying text from PDF-Viewer it sometimes happens that fi are copied as one character. When trying to save this document, there is the error message "The text contains characters that cannot be ...
1
vote
1answer
4k views

Why can't bash display symbols like æ, ø and å?

I have a file I've called æøå.js (just an example), and when I run ls in the directory where it's stored I get root@chu:~/projects/someproject/server# ls src a.js b.js ??????.js So it seems such ...
6
votes
1answer
7k views

Why don't ANSI symbols work in PuTTY/Debian?

The awesome application tree, which I installed in Debian with apt-get install tree, has the option of drawing its output using ANSI graphics. Its output looks like this now: . tqq node_modules x ...
6
votes
1answer
28k views

MS Office 2010 Word change character encoding

I have a document that is not written in English but in other European language and when I open it in MS Word 2010 there are several characters displayed not properly. How can I change the encoding of ...
2
votes
1answer
2k views

View Big5 File in Text Editor

I have a file encoded in Chinese Big5. Is there a text editor that I can use to view the file in Chinese? I'm on Windows. If I view the file in Notepad++ I see it decoded with my 8bit locale.
10
votes
3answers
2k views

How are character encodings related to fonts?

I mean, does a font have to support every character encoding? Or does a character encoding have to support every font? What do Unicode fonts mean? are they fonts that support only Unicode, and they ...
3
votes
1answer
2k views

Chrome is displaying international characters instead of English; how can I fix this?

I've run into a problem with Google Chrome on my laptop (my desktop machine, apparently an identical Windows 7 installation doesn't have the problem). On some sites, Chrome fails to render text ...
3
votes
1answer
3k views

Computer not displaying unicode characters

My computer recently displayed Unicode characters fine. However; it recently stopped displaying them, I can successfully display the characters in notepad on another computer, running the same Win 7 ...
1
vote
1answer
3k views

Why choose ISO-8859-1 character set instead of using UTF8 in PuTTY?

I have tried to do some research and I have to admit that I am clueless on this. If my question does not even make sense, I offer you my sincere apology for my ignorance. PuTTY seems to use ISO-8859-...
4
votes
2answers
12k views

Convert File Names into UTF

I have a folder full of sub folders and files which are named using Hebrew encoding (Windows XP - Windows-1255). I now use Windows 7 and I want to convert all file names into UTF (Native Windows 7 ...
30
votes
2answers
21k views

Default PowerShell to emitting UTF-8 instead of UTF-16?

By default, PowerShell in Windows seems to be outputting UTF-16 (e.g., if I do a simple echo hello > hi.txt, then hi.txt ends up in UTF-16). I know that I can force this to my desired text ...
0
votes
1answer
460 views

Switching terminal character encoding while using TotalTerminal

I'm using the TotalTerminal 1.1.3 terminal.app plugin on Lion (10.7.1) for a visor-style terminal. TotalTerminal uses/creates a special profile which is used for every new tab opened in terminal.app. ...
4
votes
1answer
5k views

Gedit - how to set default encoding opening?

I would like to somehow make Gedit on my sister's laptop to open text files in Windows1250 (CP1250-Winlatin2) encoding by default. She has a plenty of ebooks in txt format and opening them in ...
3
votes
2answers
21k views

character encoding in linux systems

I have web page its charset is 8859-9 and it was prepared in windows with char encoding ascii. from ftp access, I am opening it via gedit in ubuntu then turkish chars changes like (turkish ı became ý)....
7
votes
2answers
3k views

Search special characters or short mathematical symbols in pdf files

I have Adobe Reader, Okular and Document Viewer as pdf readers. The papers I read are often texts with mathematical formulae, generated by LaTeX. But it seems that searching special characters or ...
6
votes
3answers
5k views

White Question Mark in Black Diamond

We are all familiar with the white question mark inside of a black diamond (�) when there is an encoding issue. Does this 'character' have an offical name? Or is it only referred to as the 'white ...
1
vote
1answer
203 views

Differences between “mime-encoding” and “character encoding”

I was wondering what the differences are between "mime-encoding" and "character encoding"? Are they both for encoding used in text files? I picked up "mime-encoding" from here.
19
votes
2answers
3k views

Do text files store their encoding method for later decoding?

I was wondering if some text files store their encoding method along their text content for later decoding? Or is it the text viewer's job to guess the encoding method for a given text file, and the ...
1
vote
1answer
1k views

Character encoding after shebang in shell scripts?

I came across some Ruby scripts on Github. The first line is the normal shebang (#!/usr/bin/ruby), but the second line is the following: # -*- coding: utf-8 -*- I didn't know this method of ...
3
votes
1answer
516 views

Chinese language support in Windows, installed language packs but some apps still show gibberish text

I'm using Windows 7 Ultimate and I've installed both the Traditional and Simplified Chinese language packs. A lot of software works with Chinese text now and I'm also able to use Chinese input. Some ...
17
votes
2answers
47k views

How can I enforce so Notepad++ uses UTF-8 every time I create a new file?

I want to use the character encoding UTF-8 (without BOM) on my files. I can change the encoding from the "Format" menu, but it is reset every time I create a new file or open a file. How can I do so ...
5
votes
3answers
12k views

How to convert character encodings on Windows?

I'm trying to work out how to convert a file to UTF-8 but I really can't find much useful info on google other than to use iconv.... I downloaded that but when I went to run it via the CLI it told me ...
0
votes
1answer
3k views

How to determine if zip is encrypted by AES

I have to determine encryption method of ZIP files I'm receiving. Mostly I'm interested to know if AES was used or not... Any idea ?
76
votes
5answers
340k views

How to set character encoding when opening Excel

Is it possible to set the default encoding for Excel (any version, e.g. 2010) when opening files like csv files (like you can in Open Office Calc)? I When I try to open a csv file encoded in Japanese ...
0
votes
2answers
794 views

Vim encoding issue with danish characters æøå

When trying to input danish characters æøå into vim, I suddenly get "æ ø å " and then the questionmark blocks on reopening. The same goes for files saved in other editors and reopened in vim. I have ...
2
votes
3answers
1k views

Why does gnome-terminal display ���?

I am using Ubuntu 10.04 with GNOME Terminal 2.30.2, but when I ssh into a RedHat server, my terminal does not display correctly. For example, the help pages for R look like this: Objects of class �...
2
votes
4answers
2k views

Alt + Number key combination in notebooks

If you do Alt + 64 in a PC you will get "@" and so on for most characters. I could not find out way yet to use this very helpful resource in notebooks. Can this be done? I would like if possible an ...