The fine art of converting letters into numbers. ASCII, ISO Latin-1, Unicode, EBCDIC… There are dozens of currently used encodings and converting between them is now a witch craft.

learn more… | top users | synonyms

79
votes
7answers
6k views

Why are special characters such as “carriage return” represented as “^M”?

Why is ^M used to represent a carriage return in VIM and other contexts? My guess is that M is the 13th letter of the Latin alphabet and a carriage return is \x0D or decimal 13. Is this the reason? ...
0
votes
1answer
288 views

iconv supports too few encoding

iconv -l outputs too few encodings on CentOS 6.5: $ iconv -l 10646-1:1993, 10646-1:1993/UCS4, ANSI_X3.4-1968, ANSI_X3.4-1986, ANSI_X3.4, ASCII, CP367, CSASCII, CSUCS4, IBM367, ISO-10646, ...
1
vote
0answers
223 views

WLMail displays messages correctly on screen, but prints  where there is =C2=A0 for some messages

There are many questions online related to this. And I understand that =C2=A0 stands for non-breaking space when it appears within a mime part with type: Content-Type: text/html; charset=UTF-8 My ...
0
votes
1answer
138 views

Search for non-characters (character replacement indicators)

I have a text file (actually a .csv exported from .xlsx in LibreOffice) with lines that have gibberish when opened in LibreOffice Calc. In VIM they appear as the following: Joe User, joe@user.com, ...
3
votes
2answers
284 views

Preventing OSX from using “smart” curly quotes

Is there a way to prevent OSX from using curly double and single quotes by default? I use Evernote to store SQL commands for reference and instead of getting " and ' when typing I end up with ‘ and ”. ...
0
votes
0answers
33 views

Text Encoding Wrong In Some Applications

Recently, I opened VLC and discovered that all the text was unreadable. It seems as if the endianness is wrong, or something else relating to encoding is failing. I found that multiple apps have the ...
5
votes
1answer
842 views

Why do Cyrillic letter in URL domain appears so strange?

Short explanation: Why does russian characters in domain name in URL перезагрузкаопмо.рф get mapped to some randomness like this: http://xn--80aaigamcyttbbjfe2c.xn--p1ai. Please note, I am not ...
0
votes
0answers
838 views

How to Embed Subtitle to MP4 Without Re-Encoding or ( Is it possible to show Softcoded Subtitle in Web Flash Player )

I have mp4 videos. I need mp4 videos for my website so i dont want to re-encode my mp4 videos to mp4 to add subtitle. I can add subtitle to my videos with MP4Box (with CMD) but it is softcoded. ...
2
votes
2answers
105 views

Can iconv convert the 'symbol' encoding?

I need to convert some files in greek that are encoded to be used with 'Symbol' font to Unicode. Can I use iconv for this? And if so, what is the name of encoding that is used in 'Symbol'?
0
votes
2answers
898 views

Display multiple language subtitles in WMP using an SMI file

I have an SMI file that contains subtitle translations for 9 languages. The original file is using UTF-8 encoding, so viewing the text file in Notepad displays fine. I have the SMI file and a WMV ...
1
vote
0answers
76 views

H.264 Pro Recorder Files not closed properly

I have several files that were recorded using a BlackMagic Design H.264 Pro Recorder. It would appear that somewhere in the process, the recorder did not close out the file properly when the ...
0
votes
0answers
32 views

FFmpeg on Linux Video Size in Preset

Hi everyone I am trying to create a preset to encode my videos with ffmpeg through this file: #video options s=716x402 vcodec=libx264 minrate=900k maxrate=1100k bufsize=1500k vprofile=high level=4 ...
0
votes
0answers
173 views

ffmpeg -sample_fmt error under Windows

I was tasked to convert a simple audio track on windows using the following command: ffmpeg -i mySound.mp3 -acodec libmp3lame -ar 48000 -ab 128k -ac 2 -sample_fmt s16 out.mp3 However it fails ...
2
votes
1answer
79 views

How do I open files sent to me in a 'document envelope'?

I just got an email whose X-Mailer is "X-Mailer: Microsoft CDO for Windows 2000". It has as an attachment a .sgn file, whose content is an XML with one field apparently being a base64-encoded PDF: ...
0
votes
1answer
296 views

How to encode a text string into QP?

I would like to encode some basic text strings into QP. I have tested several online encoders on the web, and none of them worked. One of them can be found at Webatic. I can use it to decode QP into ...
0
votes
0answers
69 views

Firefox encodes some characters as squares filled with numbers

Since a couple of days I'm experiencing this problem: Firefox (and Light too) displays a lot of strange characters in different websites. Something like: 🎂   And so on. I realized that those ...
3
votes
2answers
319 views

What are these strange characters? [duplicate]

I couldn't put them in the title because they actually seem to have many bytes: I took some screenshots:
0
votes
0answers
693 views

How to change character set of text in Excel 2013

I have the following issue with Excel 2013, which is still surprisingly lacking proper multilanguage support despite it being, you know, XXI century. I have a text in Excel 2013 which is displayed as ...
0
votes
1answer
16 views

What encoding is Banned Suffix List?

Mozilla maintains a effective TLD or banned suffix list at Public Suffix List and its wiki Public Suffix List. Most entries are straight forward, but some are confusing to me since I don't work with ...
2
votes
1answer
323 views

Ffmpeg Sync when extracting parts of video

This question can be seen as an extension of this question. I am using the ffmpeg 2.0.1 . The following commands is useful when you want to extract parts of one big video file given time makers. ...
1
vote
0answers
45 views

GNU screen lost encoding settings after detached and reattached

I set the defencoding and encoding in the .screenrc, defencoding GBK encoding GBK GBK After I detached and reattached the session, the encoding settings don't work. screen -r -d -S session How ...
1
vote
2answers
506 views

Batch convert to UTF-8 a directory having both UTF-8 and CP-1251 files

I have a directory containing files, some of them are UTF-8, some are CP-1251. I want to convert the ones that are CP-1251 to be UTF-8, but without corrupting the UTF-8 files. I tried using iconv -f ...
2
votes
1answer
2k views

Add watermark to ffmpeg MP4 encoding process in Windows?

Want to apologize off the bat as I am by no means familiar with working with ffmpeg and after trying countless times unsuccessfully to accomplish adding a PNG image watermark to my videos I'm hoping ...
1
vote
0answers
164 views

Can't extract file with non-ascii name from zip archive

I am using Linux Slackware 14, downloaded a zip archive with a file, containing Russian characters in it's name. Now when I try to unzip it in console, it prints an error and doesn't unzip: bash-4.2$ ...
0
votes
3answers
1k views

Displaying Korean characters properly on a computer with English Windows XP

I have Windows XP Professional Version 2002 SP 3 English version I have installed the required input methods in Regional and Language Settings and as far as I know all the other options provided there ...
2
votes
1answer
342 views

ffmpeg stripping out third stream not working

I have files with a third stream which could be some metadata from FCP. This is the output of ffprobe: ffprobe 00700.mov ffprobe version 2.0.1 Copyright (c) 2007-2013 the FFmpeg developers ...
3
votes
0answers
911 views

ffmpeg minimal requirements configuration for encoding and decoding h264 files

I'm trying to compile ffmpeg with minimal requirements in order to encode/decode with h264. So far my command line configuration is : ./configure --disable-yasm --disable-everything ...
8
votes
2answers
4k views

What encoding to get Å Ä Ö to work

I'm writing a small application in VB.net that will enable me to easy create a user "Windows 7 account" with a password, instead of going though the control panel. The problem I'm having is that when ...
0
votes
1answer
275 views

Files saved in utf-8 shown broken in browsers

Now every time I save a file with utf-8 (default, like I did it the last 8 years) my browsers (Chrome, Firefox) can't read it properly any longer. If I use encoding utf-16 it works fine, but I don't ...
0
votes
1answer
72 views

encoding that is compatible with both latin1 and uft-8?

I use vim to edit files and I can make it display Korean only if I set the "Current language for non-Unicode program" to "Korean". I can accept that thtat is the way it supposed to be. But then if I ...
1
vote
3answers
354 views

unicode double latin letters (ligatures)

What unicode characters are there where two latin letters are joined together in a ligature to form a single unicode character? similar to this type of character: ㎐ or æ I looked in the unicode ...
0
votes
1answer
603 views

Convert .txt. file from windows-1251 to utf-8

I'm trying to read the cyrillic text that is stored in .txt format. Once I open it with OpenOffice, it is OK. Once I open it with Notepad++, it shows unreadable symbols. Setting Windows-1251 prior ...
0
votes
1answer
435 views

Can I see/change text encoding in Word 2003?

I received a Word document with Bulgarian text. When I copy-paste it to our web based CMS some letters change (possibly to Russian??). If I copy and paste special (from Word 2003 to Word 2003 as ...
1
vote
2answers
948 views

Can't install gems with Ruby: “invalid byte sequence in UTF-8”

I'm using Mountain Lion. I've installed Ruby first with RVM, then with rbenv. I can assure it's running the latest one with which ruby, it correctly points to the one installed with rbenv. gem won't ...
1
vote
1answer
500 views

subtitle encoding issue with mkvtoolnix

so I've attached a few subtitles to a MKV with mkvtoolnix, but it appears that after muxing the character encoding is messed up. The input subtitles were UTF-8 encoded. I don't know what's the ...
1
vote
1answer
437 views

How to multiplex two videos with ffmpeg

I'm converting videos using the -s option for multiple resulutions and I want to include a short intro at the begining of the video. but for some reason it skips the second -i so i'm only getting the ...
0
votes
1answer
363 views

Can Intel Xeon Phi improve ffmpeg performance?

I'm building a server for video encoding and I'm planning to use the latest Xenon e5-2697 v2. Can Xeon Phi help me improve ffmpeg encoding performance? a bit confused by this new "processor" ...
1
vote
1answer
340 views

How to add watermark when converting to more than one video with -s option?

I have a problem adding watermark to my video. I'm converting a video into 5 different resolutions using the -s option. what I've tried: waterMark="\"movie=/watermark.png [watermark]; ...
3
votes
3answers
6k views

Notepad++ doesn't show Russian letters

I'm trying to setup the translation file (.php) but can't get Notepad++ to display the Russian text. The file was created on a PC with Russian Windows 7 (Windows Notepad) and everything looks fine ...
3
votes
1answer
252 views

Special characters in Emacs dired and attachment paths on Windows 7: “\374” instead of “ü” displayed

I want to use dired+ in Emacs for browsing directory paths on Windows 7. I'm having problems with special characters like äöü in dired mode and in attachment paths: dired When I'm trying to ...
0
votes
1answer
131 views

Converting iTunes m3u file to be readable by mpd (special characters and encoding issue)

I have generated a iTunes m3u file because it is easier to create specific playlist (with intelligent playlists). It needed a little conversion to replace ^M characters to newline, but now I have ...
-1
votes
2answers
345 views

Hex to base64 on *nix [duplicate]

Note: I have marked this question as a duplicate of another question. But I am keeping it nonetheless as it has an example and a clearly explained answer, so hopefully it should help others. ...
1
vote
1answer
812 views

How was this value of ObjectGUID encoded?

An application stores the objectGUID of a user's MSAD entry internally as: msad://OBJECTGUID=\5c\78\33\6d\77\d8\df\44\80\07\d2\77\da\d5\c5\69?USER Below are the Uids I see when I pull the user's ...
0
votes
1answer
104 views

How those undocumented ANSI codes work

I found gnu head ANSI art (that show up in alsmot grayscale on Cygwin terminal) and it have undocumented ANSI CSI SGR numbers like: [38;5;243m Wikipedia say that the numbers are up to 109. What ...
0
votes
0answers
129 views

Vim scripting with Tcl: encoding mismatch

I am trying to write a plugin for Vim using Tcl as the backend language. I have written and tested most of the code and it seems to work fine except for one hurdle I can't seem to get over: encoding. ...
2
votes
1answer
648 views

How do these characters (%25u, %25U) in a URL, pose a security risk?

I was reviewing some SiteMinder APACHE 2.2 WebAgent configuration files when I came across '%25u,%25U' in the list of ASCII/URL-encoded characters in the attribute badurlchars as below: [Wed Jun 19 ...
2
votes
1answer
568 views

What character encoding does ODT use?

Whenever I open an ODT file saved by LibreOffice with default settings, and open it in a plain text editor, I get a bunch of nonsense. Not a single trace of the text I typed. In what character ...
0
votes
0answers
125 views

Tight Encoding on android vnc [closed]

I'm customize my own VNC client and server with TightVNC open source. I remove all of its interactions of RFB protocol. So there is noway to negotiation encoding types or any other options. I choose ...
1
vote
1answer
623 views

Under Windows 7 cmd.exe, why do both utf8(65001) and gbk(936) display Chinese filename correctly?

Under Win7 cmd.exe, running the following commands will reproduce the situation I faced today: (to clarify, my D: partition is formatted as NTFS.) D:\...\_play\notes> chcp Active code page: 65001 ...
2
votes
1answer
641 views

Linux VLC subtitles - qestionmarks instead of several characters

While watching movie using VLC with czech subtitles, qestionmarks appears instead of some (ěščřž etc.) characters. Steps that I have tried so far: Converting subtitles from windows-1250 to utf-8 ...