Questions tagged [character-encoding]

A character encoding system consists of a code that pairs each character from a given repertoire with something else — such as a bit pattern, sequence of natural numbers, octets, or electrical pulses — in order to facilitate the transmission of data (generally numbers or text) through telecommunication networks or for data storage.

Filter by
Sorted by
Tagged with
1
vote
0answers
19 views

Word 365 character encoding annoying

When I open some text files with Microsoft Word 365 (v2001 build 12430.20184 - 16.0.12430.20172) it asks me to choose the characters encoding. My question is: How to clean the original file to let ...
0
votes
0answers
33 views

Is URL encoding guarranteed to output printable characters only?

I refer to the URL encoding used in Burp and in the browsers Is URL encoding guaranteed to output printable characters only?
0
votes
2answers
180 views

Windows 10 Missing Left Double Quotation Mark Glyph in Character Map

This is so weird. I am simply trying to type an open double quotes symbol in Windows 10 that should look like this: Actually, I'm trying to replace wrongly interpolated quotes symbols in an ANSI ...
0
votes
0answers
71 views

How to restore Default System Text Encoding in Windows 7?

After checking with PowerShell script "[System.Text.Encoding]::Default" I discovered that my system (windows 7 pro x64) has Cyrillic (Windows-1251) as default character encoding, but it should have ...
0
votes
0answers
48 views

Wireshark - Don't mask non-printable characters (Windows)

Is there any way to have Wireshark running under Windows not mask non-printable characters in the packet view on the bottom? Currently, any characters < 0x20 and >= 0x7f are shown as . This ...
0
votes
1answer
40 views

BER decode SubjectAltName and CHOICE?

I'm having trouble working out the syntax when decoding a SubjectAltName in a TLS self-signed certificate. I believe the certificate is well formed. The trouble is, I don't understand how to decode ...
1
vote
0answers
72 views

Can I tinker with the encoding when using pdftotext to convert PDF to text?

Sometimes when I do pdftotext it results in perfect text. I assume this is because the actual unicode text data is embedded directly in the PDF itself, and simply read out. But other times (around ...
0
votes
0answers
102 views

Readable text when copy-pasted from PDF becomes completely unreadable

What is this that when I select a completely readable, Latin (no language-specific characters, actually a company name and street address) text in PDF document and then copy and paste it to any ...
0
votes
0answers
285 views

Some Unicode characters not displaying in konsole

I am running Plasma 5 on Arch Linux with the konsole terminal emulator and fish shell, with the oh my fish extention and slavic cat theme. This theme displays git status as the cat's arms, which for ...
1
vote
4answers
200 views

Which ANSI standard is Joel referring to?

I was rereading Joel Spolsky's classic blog post The Absolute Minimum Every Software Developer Absolutely, Positively Must Know About Unicode and Character Sets (No Excuses!) and noticed this passage: ...
0
votes
1answer
60 views

In cmd.exe with codepage 437, why are characters whose “number” is greater than 127 prepended with a ┬ when using type?

I have a file that contains some characters whose "number" is greater than 127. If I use type file.txt to display the content of the file in a cmd.exe console whose code page (chcp) is set to 437, ...
2
votes
0answers
166 views

How to make Chrome URL display spaces instead of %20

Browsers like Firefox display URLs containing spaces (including nbsp's) with an actual space (); Chrome always displays spaces as %20 (and nbsp's as %C2%A0) in the address bar. (ie, Firefox displays ...
0
votes
1answer
68 views

NetTerm shows characters instead of lines

My issue is almost the same as Why does YaST now show lines as lqqqqqqqqqqqqqqq? , but instead of PuTTY and YaST, I'm using NetTerm and MLS (= WMS). My lines are also shown in characters as you can ...
1
vote
1answer
249 views

How to fix the character encoding problems after using filezilla?

I have the following problem: I used the filezilla application to get the files of a page through FTP to backup them in case it needs to be restored later. If it were to restore the site with the ...
2
votes
1answer
54 views

How to send an e‑mail to an address with Latin9/iso‑8859‑15 characters inside the username part of the address?

As part of finding a job, I need to send an e‑mail to an address which contains latin letters with accents inside the username. I know this is not standard, but they did it and there’s less than 1000 ...
0
votes
0answers
38 views

CodeLite replacing accent by special characters

I'm using CodeLite to develop my PHP applications, but this one has the annoying tendency to replace all my accents with special characters (this one: � or others like é). But UTF-8 encoding is ...
0
votes
0answers
16 views

Xcode's reinterpretation of codes doesn't change anything

Xcode has a function reinterpreting codes to another encoding with a follow procedure. 1. Open file inspector 2. Choice one of the list of Text Encording 3. Push the Reinterpet button. But, I have ...
0
votes
0answers
72 views

Wrong encoding in my Java project at Eclipse

I just received the source of one of our company's system, we needed to edit one little thing, so I did that and compiled the source code to .class and it compiled cleanly. I replaced the fixed file ...
0
votes
0answers
190 views

NFS mounted to drive fails with Hebrew file names

I have an NFS mounted to a drive on windows. With English filenames all is working as expected. Whit Hebrew I get this error: “The file name(s) would be too long for the destination folder. You can ...
0
votes
1answer
2k views

Arabic characters do not display correctly when saving and reopening text file

When I save a text file with arabic letters from Notepad, they do not show correctly after reopening. Instead it shows ??????. Example, this is my file in Notepad: Then after saving, closing and ...
0
votes
1answer
170 views

How does notepad.exe determine character encoding?

I have a .txt file saved in UTF-8 format without a BOM. It contains an 'é' character. How does notepad.exe determine that it is UTF-8 encoded? Other .txt files containing only < 0x80 characters ...
0
votes
0answers
311 views

How do you create custom zalgo text?

I know what zalgo text is and that there are a few websites that can make it for you. But I'm looking for how I can make it however I want." HͥAͣQͫ" is an example, how can I make it so I can choose ...
2
votes
1answer
657 views

Windows 10 All alt codes and accentuated characters replaced by �

Since this morning, all alt codes I type in (like alt 256, alt 26, alt 144, ...), are replaced by the "�" character. It also happens sometimes in Windows with accentuated characters (like é à ï ...). ...
0
votes
3answers
744 views

How to type directly with keyboard the U+200C character?

How to type directly with keyboard the U+200C character in Notepad or other places... in Windows 8.1? (without depending on a certain font) I don't want to copy and paste ways. I don't want any ...
0
votes
1answer
80 views

Which type of character encoding consumes the most memory?

I will store a long (45132 character) string in a Postrgres database whilst preserving every character (including really rare ones). Postgres can store strings up to 1GB (see here). In terms of the ...
2
votes
1answer
903 views

What text encoding is used in “Zip archive data, at least v?[0x314] to extract”?

I tried multiple search terms on the usual suspect search engines as well as on stack overflow and superuser, but can't find anything on this. Normally a Zip archive magic pattern is "at least v1.0" ...
1
vote
2answers
769 views

FTP File transfer With Chinese Characters

When I'm trying to send files with Chinese characters over ftp, I am getting: 500 ERROR (Internal Server ERROR) through my backend code; It's working fine for english characters but not for ...
0
votes
2answers
2k views

Exporting from Excel to CSV replaces Japanese characters with ??? even though Windows, Office locale is Japan/Japanese

I am exporting an excel file (Excel 2016) containing Japanese characters into CSV. (Note : I am not exporting to CSV UTF-8 provided). In the process, all Japanese characters are replaced with '?' My ...
1
vote
1answer
319 views

Windows 10 OpenSSH - Character Encoding

Is there any setting on client-side such that I get the German Umlaut display correctly when connecting from my Win10, 64b, English to Linux servers by using Windows 10 OpenSSH client? While I like ...
0
votes
1answer
182 views

PuTTY not showing character | and _ correctly in pstree and tree command output

On Linux, tree and pstree commands show tree-like hierarchy of directories and processes respectively. Their output usually includes the characters | and _ which are used to draw the tree structure. ...
0
votes
0answers
154 views

Interpret text file with some hex codes?

I have a file with contents looking like PK\u0003\u0004\u0014\u0000\u0006\u0000\b\u0000\u0000\u0000!\u0000À¸<91><91>¢\u0001. However, I have a different version of the same file looking ...
2
votes
0answers
199 views

Execute sh file with Russian or Chines Chars - Saved as UTF-8 or Unicode

I have a file which has some russian chars in. Below is the content of by sh file. #!/bin/sh sed -i "s/\bVAR1\b/Привет, как ты/g" file1.txt When i save this file i had to save this as UTF-8 or ...
1
vote
0answers
149 views

Docker container in Windows Bash ignores non-ASCII characters, work's in PowerShell

I'm running a Python Docker container on my Windows 10 computer. If I add Norwegian specific characters in my Python code, such as print("båt"), and run the container in Windows Bash, the output is bt....
0
votes
2answers
8k views

TXT files: how to switch from weird characters back to normal?

So, I have on a flash drive a txt file generated in Cyrillic (my own work, own pen drive), a few years old. Now I needed to open it, only to see this kind of mess. I wonder why is this happening and ...
0
votes
2answers
247 views

What is causing these two apparently identical files to have different hashes?

I am unable to figure out why the following two files are yielding different hashes (SHA1, CRC32, SHA384, whatever): https://cdn.jsdelivr.net/npm/jsonify-error@1.2.1/dist/jsonify-error.js https://...
0
votes
0answers
162 views

What encoding is needed to read this HTML file containing Spanish characters?

I downloaded this HTML file from archive.org, which is a digitilised book, written in Spanish. As such, it has plenty of accents and other unique symbols (e.g. ñ). Now, when I open the html file in a ...
7
votes
3answers
2k views

Why when copying a non-English URL from address bar it's URL encoded and not as the text I see (decoded)?

When I copy a link from the address bar that has characters that needs to be encoded usually, the copied link will contain the encoded text and not the decoded (which is what's visually seen). But if ...
0
votes
0answers
669 views

Windows RDP accent and special characters

Windows 10 RDP behaviour seems to have changed post April update. Same hardware, same mouse, same OS, same everything. I'm connected to a remote session (Windows Server 2012 R2) and am experiencing ...
3
votes
4answers
6k views

Proper encoding for file names in zip archives created in Windows and unpacked in linux

I have problems with different charsets in Windows and Linux (Centos). I have files with special characters in their filenames from many different languages. The zip archive is generated under Win7 ...
1
vote
1answer
242 views

Command output not working after changing codepage

I've found a rather weird issue while investigating the twisted world of character encoding. In Windows, if I type 'tree' the command works as expected but if I then type 'chcp 65001' (which is UTF-8) ...
2
votes
1answer
690 views

How to convert this string to Japanese using GNU/Linux tools?

Here is a string from a text file: @™TdaŽ®Æ‚êƒ~ƒNƒXƒgƒŒ[ƒgEƒrƒLƒjver1.11d1.d2iƒrƒLƒjƒ‚ƒfƒ‹ver.1.1³Ž®”z•z”Åj It includes many nonprinting characters and is copied here: https://pastebin.com/...
0
votes
0answers
97 views

Strange/weird characters in file

I got a file where there are a lot of strange characters. I'm trying to find out how to "decode" or change it to plain text, but am stuck and can't find a way to do it. One line could look like this:...
1
vote
1answer
347 views

PDF displayed with Shifted Characters in Google Chrome

Observe this PDF located here, in Google Chrome specifically: http://www.saab.org/actuary/exam3/3-sample.pdf Notice how many of the characters appear to be shifted (this is most noticeable toward the ...
1
vote
2answers
2k views

Why does LibreOffice Calc change CSV file Character Set?

I have a .csv file export (actually printed to csv file) made on a Windows 10 machine. Working in Libreoffice Calc on Archlinux, Why can Calc open a file using settings Character Set: Western Europe (...
0
votes
1answer
116 views

Symbols are lost after conversion from UTF-8 to ISO8859-1 and back to UTF-8

I have a file with properties in French. I would like to convert it to ISO8859-1. But after conversion, some symbols are lost. What is wrong? > cat fr.properties VAR2="élément n’a" > cat fr....
1
vote
1answer
577 views

Resetting Unicode mappings in PDF text

PDFs often contain fonts without explicit mappings to Unicode, preventing us from extracting correct text from them -- curse you, Adobe! I need to process PDFs in a batch fashion on a Linux system. I ...
0
votes
1answer
1k views

MS Access won't display line breaks of existing data

I am creating an MS Access front end for data from somewhere else. In this case, it's a linked SQL Server table. The data is actually imported from a shared-hosting LAMP web server. It's the ...
0
votes
1answer
56 views

Keyboard layout and displayed characters

What does happen when one switch keyboard layout (alt+shift in Windows) for e.g. from en to pl. Does it change the charset from english to polish or maybe encoding? Why when for e.g. setting it to en ...
0
votes
1answer
649 views

Keyboard layout and charset encoding

How does keyboard layout (switched in Windows for e.g. by Alt+Shift) relates to character encoding? How to determine what charset encoding is currently used in Windows? How to know what charset ...
1
vote
1answer
739 views

Encoding problems when copy pasting from a remote desktop session

I connect to a distant machine to copy some arabic text to my machine. When connecting through teamviewer, I get the text nice and clean when pasted on my machine, like this : تدخر جهدا في سبيك ...

1
2 3 4 5 6