Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [character-encoding]

A character encoding system consists of a code that pairs each character from a given repertoire with something else — such as a bit pattern, sequence of natural numbers, octets, or electrical pulses — in order to facilitate the transmission of data (generally numbers or text) through telecommunication networks or for data storage.

3
votes
1answer
2k views

Proper encoding for file names in zip archives created in Windows and unpacked in linux

I have problems with different charsets in Windows and Linux (Centos). I have files with special characters in their filenames from many different languages. The zip archive is generated under Win7 ...
3
votes
1answer
154 views

Windows 10 Calculator showing in pseudo-local

I'm pretty new to windows 10, but my calculator app is showing in pseuedo-locale How to I turn this off and have it display in normal English ?
3
votes
1answer
189 views

Converting my iTunes library to romaji

I have just added to my iTunes library a bunch of new Japanese songs. When I say a bunch, I mean it. A lot of them. And their titles are mostly in their original Japanese form, which is in kanji, ...
2
votes
1answer
1k views

FFmpeg encoding for meta data wrong – need it in UTF8

When I run this command ffmpeg.exe -i test.mp3 -metadata title="The Title You Want" -metadata artist="ÄÄÄßß!`n Artist Name" -metadata album="Name Fö#'ddp+!of the Album" -c:a copy -id3v2_version 3 ...
1
vote
1answer
215 views

PDF displayed with Shifted Characters in Google Chrome

Observe this PDF located here, in Google Chrome specifically: http://www.saab.org/actuary/exam3/3-sample.pdf Notice how many of the characters appear to be shifted (this is most noticeable toward the ...
1
vote
1answer
678 views

Why does LibreOffice Calc change CSV file Character Set?

I have a .csv file export (actually printed to csv file) made on a Windows 10 machine. Working in Libreoffice Calc on Archlinux, Why can Calc open a file using settings Character Set: Western Europe (...
1
vote
1answer
806 views

OneNote backslash character codes?

Where do I find a reference page for oneNote which lists all the character codes for symbols you can type using back slash on one note? E.g. you can type \in and you get the set notation symbol ∈. ...
1
vote
1answer
628 views

How to determine character set, code page, or encoding in windows?

I have a list of files with names written in what seems to be a written in VISCII or some East Asian format (I know the language is Vietnamese). I want to use iconv to convert the filenames to UTF-8 ...
1
vote
1answer
469 views

How to browse a font by characters from a given codepage?

Most of the font manager tools display characters of a font grouped by subsets of the Unicode character set. Is there a tool that displays the characters grouped by the particular code page that a ...
1
vote
1answer
58 views

Homebrew CLI Emacs inserting ¯ when I press M-<

When I try to navigate to the start of a buffer with M-<, Emacs instead inserts a weird character ¯. How should I correct Emacs or Terminal.app to fix this? $ specs emacs brew bash os Specs: ...
1
vote
1answer
769 views

Adobe Acrobat Copy and Paste Font messed up

How does one copy and paste in Acrobat when fonts are embedded in PDF and not machine? I am opening an Adobe PDF and I copy the font from the PDF and then paste it to word and the characters are all ...
1
vote
1answer
250 views

Automated script to change page encoding after page has been downloaded in Google Chrome

guys! My Chrome doesn't properly recognize page encoding of our local TWIKI site. So, every time i enter the site i have to set suitable encoding manually (Settings -> Tools -> Encoding -> Cyrillic (...
1
vote
1answer
687 views

How is character encoding inside Sakura done?

In the Sakura editor, you can have a .txt file with UTF-8 encoding, which contains 2 characters that are not available in EUC charset. When I saved a .txt from UTF-8 to EUC in the editor, it all ...
0
votes
1answer
82 views

Exporting from Excel to CSV replaces Japanese characters with ??? even though Windows, Office locale is Japan/Japanese

I am exporting an excel file (Excel 2016) containing Japanese characters into CSV. (Note : I am not exporting to CSV UTF-8 provided). In the process, all Japanese characters are replaced with '?' My ...
0
votes
1answer
517 views

MS Access won't display line breaks of existing data

I am creating an MS Access front end for data from somewhere else. In this case, it's a linked SQL Server table. The data is actually imported from a shared-hosting LAMP web server. It's the ...
0
votes
1answer
48 views

Keyboard layout and displayed characters

What does happen when one switch keyboard layout (alt+shift in Windows) for e.g. from en to pl. Does it change the charset from english to polish or maybe encoding? Why when for e.g. setting it to en ...
0
votes
1answer
5k views

Internet Explorer 11 not displaying UTF-8 encoded pages correctly

Some pages in IE 11, that seem to be UTF-8, are not displaying correctly. The same page displays correctly in Mozilla Firefox. I first noticed this in Amazon.com on the Orders page (pretty much any of ...
0
votes
1answer
134 views

small omega in notepad/ notepad++ for autohotkey

I am trying to write an Autohotkey using notepad++ (also tried with notepad) but turned out it was not possible in default settings. I looked on internet and learned that ISO 8859-7:2003 and UNICODE ...
0
votes
1answer
28 views

Linux debian 8, unable to get some characters working

I'm using Debian8 64bit. Today something weird happened.. I don't know why or how, but some characters doesn't work anymore. I'm unable to make some special characters (example: @ and | ) I need ...
2
votes
0answers
44 views

Execute sh file with Russian or Chines Chars - Saved as UTF-8 or Unicode

I have a file which has some russian chars in. Below is the content of by sh file. #!/bin/sh sed -i "s/\bVAR1\b/Привет, как ты/g" file1.txt When i save this file i had to save this as UTF-8 or ...
2
votes
0answers
45 views

Arduino IDE app menus are gibberish

The menus of the Arduino IDE are full of gibberish on this system. This only affects the menus at the top and all context menus. When I manage to weasel my way through and open, for example, the ...
2
votes
0answers
288 views

How is web form content encoded in Safari's cache?

A friend of mine just accidentally navigated off a web page where she entered a rather lengthy text into a web form. When navigating back to the page, the text was lost. (Spoiler: The page had an ...
2
votes
0answers
141 views

Have to copy twice to correctly copy Chinese characters

I'm using Windows 7, I can view Chinese characters fine on webpages, but when I copy and paste them somewhere, they show up as ???'s. This is probably because I don't have Eastern Asian languages ...
1
vote
0answers
24 views

Windows 10 OpenSSH - Character Encoding

Is there any setting on client-side such that I get the German Umlaut display correctly when connecting from my Win10, 64b, English to Linux servers by using Windows 10 OpenSSH client? While I like ...
1
vote
0answers
380 views

Strange character render issue browsing Google/Youtube through Firefox/Chrome

I am having issues in both Firefox and Chrome browser on Windows 10. When you browse to www.google.com it just render something like this (I took that img from Google Image not an actual screenshot ...
1
vote
0answers
101 views

Conflict between encoding charsets when generating irc stats from ZNC logs with PISG

I'm using PISG to generate stats for an IRC channel. Log files are from ZNC log module. Logs are in this folder: ~/.znc/moddata/log/ The problem is that when i'm generating stats with PISG, my stats....
1
vote
0answers
143 views

Typing Arrow Pointing Leftwards Then Curving Upwards

It seems that the Arrow Pointing Leftwards Then Curving Upwards character doesn't exist. The Arrow Pointing Rightwards Then Curving Upwards already exists. I've searched for how to write that ...
1
vote
0answers
500 views

File names garbled in rar archive, possibly double utf8 encoded? Can't figure out how to reverse

I'm trying to restore the uploads folder of a wordpress installation. The folder went through some combination of ftp or sftp transfer and got compressed by rar. (I don't know the exact process, it ...
1
vote
0answers
1k views

WLMail displays messages correctly on screen, but prints  where there is =C2=A0 for some messages

There are many questions online related to this. And I understand that =C2=A0 stands for non-breaking space when it appears within a mime part with type: Content-Type: text/html; charset=UTF-8 My ...
1
vote
0answers
662 views

Thunderbird character-encoding problem

In folder properties, if I choose iso-8859-9 or windows-1254, messages with utf-8 headers does not show Turkish characters correct and if I choose utf-8, messages with iso-8859-9 and windows-1254 does ...
0
votes
0answers
24 views

How to type directly with keyboard U+200C character

How to type directly with keyboard U+200C character in Notepad or other places... in Windows 8.1? (without depending to a certain font) I don't want to copy and paste ways. I don't want any ...
0
votes
0answers
33 views

Interpret text file with some hex codes?

I have a file with contents looking like PK\u0003\u0004\u0014\u0000\u0006\u0000\b\u0000\u0000\u0000!\u0000À¸<91><91>¢\u0001. However, I have a different version of the same file looking ...
0
votes
0answers
51 views

Docker container in Windows Bash ignores non-ASCII characters, work's in PowerShell

I'm running a Python Docker container on my Windows 10 computer. If I add Norwegian specific characters in my Python code, such as print("båt"), and run the container in Windows Bash, the output is bt....
0
votes
0answers
22 views

mlterm not showing Korean Hangul alphabet

On this Lubuntu 16.04, LXTerminal can print any Latin and Hangul symbol, but mlterm shows Latin characters only. How can this terminal (version 3.5.0) be parameterized to display also Hangul? (I mean, ...
0
votes
0answers
18 views

Issue with character set after installing two os

I had Windows 10, there I had text file with cyrillic characters. Recently I reinstalled Win 10 as well as installed Ubuntu 16.04. Now when I open that file on both systems, I see some unreadable ...
0
votes
0answers
43 views

What encoding is needed to read this HTML file containing Spanish characters?

I downloaded this HTML file from archive.org, which is a digitilised book, written in Spanish. As such, it has plenty of accents and other unique symbols (e.g. ñ). Now, when I open the html file in a ...
0
votes
0answers
30 views

Special characters in filenames were replaced by underscores CentOS

I've trouble with special characters in filenames of foreign languages. When I generate a filename with special characters, such as 'araç temizliği', the special character is replaced by an underscore ...
0
votes
0answers
331 views

Windows RDP accent and special characters

Windows 10 RDP behaviour seems to have changed post April update. Same hardware, same mouse, same OS, same everything. I'm connected to a remote session (Windows Server 2012 R2) and am experiencing ...
0
votes
0answers
17 views

Can't open content records with Turkish characters

I am learning Turkish and I might want to have the capacity to open Turkish content documents. I am running Windows 7 and I have even introduced the Turkish show dialect for Windows. In any case, I ...
0
votes
0answers
40 views

Strange/weird characters in file

I got a file where there are a lot of strange characters. I'm trying to find out how to "decode" or change it to plain text, but am stuck and can't find a way to do it. One line could look like this:...
0
votes
0answers
119 views

character encoding - importing HTML into Microsoft Excel

I exported my Google Chrome (browser) bookmarks as an HTML file and then imported that file into Microsoft Excel. After importing, the text looks bad in Excel. E.g., the word "don't" in the HTML ...
0
votes
0answers
304 views

How can I make `file -i` command return ISO-8859-9?

Let's say I have a text file with content şşş and in vi/vim I have set fileencoding as :set fileencoding=ISO-8859-9. Later when I check the encoding with file -i <myFile> it gives text/...
0
votes
0answers
25 views

Is there a way to pre-define a character set (like utf-8) for a .txt file you're opening w/ ooo calc, instead of having to select it?

I have a php script that spits out .txt files, and I was wondering if I could add something to define the character set that ooo calc would read/see when opening so that ooo calc will know ...
0
votes
0answers
420 views

Libreoffice special character appears as question marks

I'm trying to use a .csv sent to me by another individual. When I look inside at the data, special characters such as quotation marks, hyphens and apostrophes appear as question marks or special ...
0
votes
0answers
99 views

The font 'AppleColorEmoji' contains bad / Widths

I'm trying to add an emoji in my email signature. I've copy/pasted if from a site listing all emojis. It displays fine in all the clients I've tried to open my emails with: But, when I try to save my ...
0
votes
0answers
653 views

Convert two-byte hex string to char in perl

I have a string of two-byte hex characters and I'd like to convert them to an ascii or unicode string. The string can have a variable length. Input: $hex_string="003400300030" Desired output: $...
0
votes
0answers
149 views

Wrong accented characters due to missing charset info?

I just received the following e-mails where all "é" are turned into "Ž", eg. "prŽcŽdent" instead of "précédent". Am I correct in understanding that it's due to the originating e-mail client running ...
0
votes
0answers
398 views

Improper Encoding in Chrome

I started to get this weird issue with chrome (latest) where specific characters would be displayed as other characters. Here is one example so instead of < and > it displays W (with the ...
0
votes
0answers
31 views

Debian Squeeze character encoding issue

I'm running Debian 6.0.7 (Squeeze). Normally, to get the euro symbol, I would type altgr-$ and this works fine on Ubuntu but with Squeeze when I hit those keys the cursor jumps back to the beginning ...
0
votes
0answers
255 views

Vim scripting with Tcl: encoding mismatch

I am trying to write a plugin for Vim using Tcl as the backend language. I have written and tested most of the code and it seems to work fine except for one hurdle I can't seem to get over: encoding. ...