The fine art of converting letters into numbers. ASCII, ISO Latin-1, Unicode, EBCDIC… There are dozens of currently used encodings and converting between them is now a witch craft.

learn more… | top users | synonyms

1
vote
0answers
224 views

WLMail displays messages correctly on screen, but prints  where there is =C2=A0 for some messages

There are many questions online related to this. And I understand that =C2=A0 stands for non-breaking space when it appears within a mime part with type: Content-Type: text/html; charset=UTF-8 My ...
0
votes
1answer
232 views

Streaming / Transcoding failed

I installed VLC, and works well apparently, on Suse Linux Enterprise Desktop 11 SP3, but when I streamed some video (.flv format) I get this error.- Streaming / Transcoding failed VLC could not open ...
2
votes
3answers
3k views

How to create video file from DVD

I want to take the DVD video slideshow that I got from my wedding photographer, and put the video on youtube (I have permission, I made sure to get the non-exclusive rights to use anything she created ...
1
vote
0answers
18 views

How can I find out the encoding of this corrupted Chinese text, which an online tool fixes correctly?

I have a text in Simplified Chinese, which, when read as UTF-8 begins with ´ÓºÜ¾ÃÒÔÇ°¿ªÊ¼, which the online tool from MandarinTools (first search result for Repair Corrupted Chinese Email) fixes to ...
2
votes
1answer
4k views

Convert ANSI text file(s) to UTF8 on Windows command line

I would like to convert (an) ANSI-encoded text file(s) (Win 1252) to UTF8 without BOM, ideally via a command-line call. My use-case: I export .tex files from Stata which I want to compile with ...
62
votes
11answers
34k views

OS X: Base64 encode via command line

Is there a terminal command in Mac OS X which will base64 encode a file or stdin?
1
vote
1answer
21 views

How can I configure ffmpeg to encode h.264 video with a specific log2_max_frame_num_minus4 value?

I am working on a project where we are splicing HLS video segments. The HLS standard conveniently includes an #EXT-X-DISCONTINUITY directive to signal that the player should be ready for video that ...
2
votes
2answers
72 views

Most universal method of storing raw text? [closed]

What’s the most universal method of storing raw text? What I mean is, if I have some text, lets say “ABC,” and I stick that text into Microsoft Notepad it will encode the text using ANSI by default. ...
0
votes
0answers
20 views

Markdown files corrupted after syncing in Dropbox

I like to take notes in Markdown format and save them to Dropbox. Today I tried to open one of my note files and discovered that the file extension had been changed to ".MD.blfwiqj". When I attempted ...
0
votes
1answer
29 views

remove <200b> character from text file

I have a huge text file containing this string/character <200b> that I want to delete. I tried with sed but it didn't work. sed 's/<200b>//g' file The character never shows when I open the ...
2
votes
1answer
85 views

Can't convert encoding from us-ascii to utf-8. What am screwing up?

I'm trying to debug garbage characters that my webpages are rendering in foreign languages. I want my createpage.php in utf-8. me@host:/www/webroot$ file -bi createpage.php text/x-php; ...
0
votes
1answer
47 views

Avoid ffmpeg re encode using complex filter

I have a list of ts files that will be concatenated to being trim later and encode it in mp4. All of it is working ok... however the problem I have right now is the file is re-encoded... and that is ...
0
votes
0answers
7 views

mlmmj: convert all e-mails to UTF-8

How to convert all e-mails coming to the mailing list into UTF-8 using mlmmj? The major reason for me to do that is that I need to use the predefined UTF-8 footer, which may not be compatible to the ...
0
votes
1answer
61 views

Skipping a frame without re-encoding H.264 video

I have an mp4/h.264 video which only contains I-Frames. I want to skip one of those I-frame without re-encoding the entire video. I tried this: ffmpeg -i "file.mp4" -vf select='not(eq(n\,10))' ...
28
votes
8answers
50k views

How to auto detect text file encoding?

There are many plain text files which were encoded in variant charsets. I want to convert them all to UTF-8, but before running iconv, I need to know its original encoding. Most browsers have an ...
2
votes
1answer
251 views

How does the Java VM determine its default file.encoding?

I'm running a Java program on Mac OS X 10.8 (from the Terminal), and the Java VM's file.encoding is defaulting to "SJIS". I even tried a tiny Java program that does nothing but print out the system ...
0
votes
0answers
26 views

Lowest possible CPU/GPU use for screensaver encode for mac (with handbreak or other free / cheap video encoders)

Similar to What video codec puts the CPU/GPU under the least possible load while decoding? I want to know what is the best option for a 2014 15 retina mac pro. I tried MPEG 2 and it won't go as a S/S ...
3
votes
2answers
4k views

Set CSV import default to UTF-8 in Calc

Every time I open a CSV (comma separated values) document in OpenOffice.org Calc I get a dialog with CSV preferences. The current default character set is "Eastern Europe (ISO-8859-2)". I would ...
1
vote
1answer
42 views

Ffmpeg chain references to other parts of the command for dynamic watermark size

I have been reading the ffmpeg documents for a while now. But I can't seem to wrap my mind around how the filters, naming and backreferences work. Or whether what I want is even possible. I am ...
3
votes
3answers
324 views

CTRL-[keys] and arrows not functionning in terminal / ipython

I'm using ipython Inside the python shell, when I press up instead of showing the last command, it prints ^[[A also CTRL-[keys] are fubar. CTRL-p prints ^P Everything is normal under ...
0
votes
1answer
16 views

Understanding terminal locales

I am looking into terminal customisation, and in particular text encodings. I understand the differences between the UTF-* encodings, and the differences between different encoding types, generally ...
0
votes
3answers
41 views

Accented character issue

I have a bunch of websites encoded in UTF-8. They contain accents and those weird n's with the squiggles over them and all kinds of fun stuff. When I try and open them in any text editor, even ...
1
vote
1answer
30 views

decompress ZIP with given encoding

I got ZIP file(s), which contains files, which filenames are in some encoding. Let's say I know encoding of those filenames, but I still dont know how to properly decompress them. Here is example ...
0
votes
0answers
21 views

Improper Encoding in Chrome

I started to get this weird issue with chrome (latest) where specific characters would be displayed as other characters. Here is one example so instead of < and > it displays W (with the ...
0
votes
2answers
22 views

Determine The Encoding of a specific character in Word 2010

I'm having a problem with a generated document (coming from crystal reports engine). Initially hyphens are visible but if the text is copied and pasted with "keep text only" option or "remove ...
28
votes
2answers
51k views

Change default code page of Windows console to UTF-8

Currently I'm running Windows 7 x64 and usually I want all console tools to work with UTF-8 rather than with default code page 850. Running chcp 65001 in the command prompt prior to use of any tools ...
8
votes
2answers
19k views

Is it possible to change the default encoding in notepad? [duplicate]

On windows 7 (x64), the default option, for saving text files in notepad is ANSI. One can select other encoding from the combo box, however, I'd like this option to be the default.
0
votes
1answer
31 views

How can I tell what the character encoding of a string of text is?

Troubleshooting an irritating password issue. There's an application we are using that requires a login; I type in the password, it tells me it's wrong. If I open a password manager and copy and ...
0
votes
1answer
580 views

How to convert .it file to .mp3? [closed]

I tried numerous googlings, but found only software that isn't free. I did this once, but I forgot how! What is the free app to do this?
4
votes
3answers
4k views

Video encoding: How much does the video file size increase with fps?

Given that the next blockbusters of e.g. Peter Jackson (The Hobbit) and James Cameron (Avatar 2) are going to be shot with a frame rate of 48 fps (or even more) - i.e. more than the usual 24 fps - I ...
0
votes
2answers
2k views

View properly file names inside a ZIP file in windows 1251(cyrillic) encoding

I have a zip file where directory and file names ( thousands of files ) are encoded in Windows 1251, according to its creator. I.e. the filenames contain Russian or Cyrillic letters. My Windows XP SP3 ...
5
votes
3answers
5k views

How to bulk-rename files with invalid encoding or bulk-replace invalid encoded characters?

I have a debian server and I'm hosting music for an internet radio station. I have trouble with file names and paths because a lot of files got an invalid encoding, for example: ./music/Bändname - ...
1
vote
0answers
72 views

filename encoding for windows and linux

My laptop has dual boot systems, one is win7, another is Arch linux, they share a disk. And I downloaded some files into the shared disk in Arch Linux, whose filenames contain Chinese, Korean and ...
1
vote
0answers
57 views

File names garbled in rar archive, possibly double utf8 encoded? Can't figure out how to reverse

I'm trying to restore the uploads folder of a wordpress installation. The folder went through some combination of ftp or sftp transfer and got compressed by rar. (I don't know the exact process, it ...
8
votes
2answers
5k views

How to encode audio with Opus codec?

The Opus audio codec looks like the best thing ever for compressing audio. It has recently become supported in the latest ffmpeg and VLC players. However, there is no documentation I can find on how ...
0
votes
4answers
2k views

.Bat xcopy - special characters

this is the code of my .bat file: @echo off xcopy "C:\Users\Administrator\věc" "C:\věc" /e /i /h echo Done pause However it says:File not found - výc. See ě char changed into ý Why is it so? ...
0
votes
0answers
165 views

ffmpeg error when encoding h264 mp4 video

I'm trying to do a simple encoding of an mp4 in h264 to mp4 but I keep getting the error: Error while opening encoder for output stream #0:0 - maybe incorrect parameters such as bit_rate, rate, width ...
0
votes
0answers
20 views

Error: Unknown Error Encoding File

After recording my screen with Expression Screen Recorder, I have tried to encode it with Expression Encoder so that I can use the videos with Adobe Premiere Pro. I try to encode them, but when each ...
1
vote
5answers
954 views

What is the best way to reencode a video with Xvid?

What is the best way to reencode a video with Xvid? I used FFmpeg in the past (I havent tried using FFmpeg with Xvid however - does FFmpeg keep up with Xvid releases?). With FFmpeg I either need to ...
1
vote
3answers
303 views

Computer Hardware Theory: Why binary bits?

Since this isn't a research-level question (seeing as I am not in a graduate program) I decided to plop on over here from the other CS Q&A site. Why do we use binary to encode information in ...
1
vote
1answer
67 views

Excel 2010 PowerPivot: How do I avoid apostrophes being displayed as ’?

When I import a text file to PowerPivot containing apostrophes, they are automatically converted to ’. I've been manually correcting the few that I find in the PowerPivot window, however when I do ...
1
vote
1answer
879 views

View Big5 File in Text Editor

I have a file encoded in Chinese Big5. Is there a text editor that I can use to view the file in Chinese? I'm on Windows. If I view the file in Notepad++ I see it decoded with my 8bit locale.
2
votes
1answer
156 views

ffmpeg - h264 - multiple resolutions without scaling

I have an MP4 which contains an H264/AVC stream, which contains multiple resolutions. Below is the output of mediainfo on this file: General Complete name : known.mp4 ...
5
votes
3answers
3k views

́╗┐' is not recognized as an internal or external command

When executing certain files (mainly batch) using PsExec I get these weird ́╗┐' symbols before my command. My initial thought was, that I were using wrong encoding, but after checking, I realized that ...
0
votes
2answers
31 views

Why do browsers need to be told the encoding of a file?

According to this documentation (among many other places, I'm sure), it's very important to declare the character encoding used in a given file for the browser. Most text editors (and programs like ...
0
votes
0answers
64 views

Windows chcp not work for 1251

OS: Windows 7. For some reason I need 1251 encoding in console window. But get this G:\Scripts\DAA>chcp 65001 Active code page: 65001 G:\Scripts\DAA>chcp 866 Текущая кодовая страница: 866 ...
0
votes
3answers
2k views

Is it possible to rename files in a zip archive before extracting?

I pulled a zip file from the web which was packed on a system where filenames were encoded in a format my unzip program fails to read. Perhaps the file-system does not support those weird characters, ...
1
vote
2answers
59 views

Relationship between unicode and UTF-8 / 16 / 32

I don't understand the relationship between UTF-8 and its other variants and am getting anomalous results at the terminal. For example, right arrow is: 0xE2 0x86 0x92 in UTF-8 but it is 0x2192 in ...
0
votes
1answer
69 views

Filename was OK, becomes garbage

The system is Ubuntu 14.04 LTS, has been running for a long time without problems. Recently I found that the file names (Chinese characters) become garbage (wrong encoding). To be exact: I ssh from ...
14
votes
1answer
1k views

What is this '°͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌' strange character?

I saw this °͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌ strange character online. I also noted that: It needs 26 backspaces to delete but behaves like one character when selecting. It is drawn vertically covering ...