Questions tagged [character-encoding]

A character encoding system consists of a code that pairs each character from a given repertoire with something else — such as a bit pattern, sequence of natural numbers, octets, or electrical pulses — in order to facilitate the transmission of data (generally numbers or text) through telecommunication networks or for data storage.

Filter by
Sorted by
Tagged with
0
votes
0answers
19 views

How does Word “fix” badly encoded hyperlink field on click or copy-pasting?

In a Microsoft Word document, Hyperlinks are stored within a {HYPERKLINK} field {HYPERLINK "\\\\movies\\court%20métrages\\big_buck_bunny"} {HYPERLINK "file:///\\\\movies\\court%...
1
vote
0answers
12 views

How to fix accentuation encoding with cmd.exe running inside bash?

I installed https://www.msys2.org/ and setup an ssh server for it. With this I can connect to my machine and work remotely. The problem is that some application as Visual Studio tools or windows ...
0
votes
2answers
20 views

Does clipboard change character encoding?

I am having a UTF8-related issue in a piece of software - it complains some text containing special characters isn't valid UTF8. But whenever I copy-paste it into an online validation tool or into an ...
0
votes
0answers
13 views

Fix umlaut characters for moneyplex on WIndows

I am using Moneyplex 20.0 Pro Build 24793 on Windows 10 20H2 Build 19042.876. It has problems with umlaut characters like so: I read that this can be fixed for Linux using stuff like dpkg-reconfigure ...
0
votes
1answer
59 views

Why does copying text between Notepad++ files create files with different bytes?

I've created a simple pdf [hi.pdf] with the word hi and when I open it in Notepad++, its encoding is ANSI, which I assume is Notepad++'s best guess, with it opening successfully when I Save as ...
0
votes
1answer
40 views

convert character set (German)

I have a text file that uses various characters in the 128+ range in currently non-standard ways. The file command just says Non-ISO extended-ASCII. From the context I can recognise these: Octal 201: ...
1
vote
2answers
64 views

Incorrect display of Chr() function return

I have got a new work PC (it has a higher build of Windows 10, the same highest version of O365), configured it pretty much the same as my previous one (exactly like that in terms of region and ...
0
votes
0answers
65 views

What is this for a file name encoding and how to fix it?

On my Linux machine I found old files (at least from 2004 if not older), so possibly Win9x days. Maybe they came over some old FAT drive on my disk or some old Samba share. Umlaute are very weirdly ...
1
vote
1answer
14 views

How to prevent Safari from implicitly converting character in XHR request?

I picked this character 〉 as a separator for my combo-key-field for my DynamoDb database. That character surfaces in the browser as part of a next-page-query token. (in an endless scroll list view) ...
0
votes
0answers
60 views

ffmpeg: Character encodings used by container

I am trying to understand what are the character encodings used by different containers. For instance compare: % echo $LANG en_US.UTF-8 % ffmpeg -y -i input.mp4 -c:v copy -c:a copy -metadata title=&...
0
votes
0answers
118 views

Windows Explorer File Encoding Column for Details view

How do I add a file encoding to display the character encoding of files in Windows Explorer? In example some files may be encoded as "ANSI" or UTF8; I'd like to see that in addition to Name, ...
0
votes
1answer
51 views

WinSCP Displays Weird Characters in script output file

I'm viewing the outputs of a bash script that logs into juniper devices and runs commands. When I view the output of the script via the unix server using cat <filename> it appears just fine. ...
0
votes
0answers
38 views

How to resize characters in Private Character Editor?

I Have created a character in Private Character Editor, which I expects to cover the entire character space. But when I paste it into the command prompt, it ends up shorter, and fatter then the ...
0
votes
2answers
291 views

How to display special non-ASCII Unicode characters in Notepad++? (regardless if file saved and reopened)

When bookmarking a URL like: https://addons.mozilla.org/firefox/addon/youcare-search/ You get this bookmark title: YouCare - The charitable search engine – Get this Extension for 🦊 Firefox Then, if ...
0
votes
2answers
79 views

Finding the encoding of a text file containing weird characters

I recently received a file, of Turkish origin, where the file has some English words which I can easily read, and some weird characters. I wonder if this file is encoded, encrypted or sth else. I ...
1
vote
0answers
33 views

Word 365 character encoding annoying

When I open some text files with Microsoft Word 365 (v2001 build 12430.20184 - 16.0.12430.20172) it asks me to choose the characters encoding. My question is: How to clean the original file to let ...
0
votes
0answers
36 views

Is URL encoding guarranteed to output printable characters only?

I refer to the URL encoding used in Burp and in the browsers Is URL encoding guaranteed to output printable characters only?
1
vote
2answers
597 views

Windows 10 Missing Left Double Quotation Mark Glyph in Character Map

This is so weird. I am simply trying to type an open double quotes symbol in Windows 10 that should look like this: Actually, I'm trying to replace wrongly interpolated quotes symbols in an ANSI ...
0
votes
0answers
86 views

Wireshark - Don't mask non-printable characters (Windows)

Is there any way to have Wireshark running under Windows not mask non-printable characters in the packet view on the bottom? Currently, any characters < 0x20 and >= 0x7f are shown as . This ...
0
votes
1answer
64 views

BER decode SubjectAltName and CHOICE?

I'm having trouble working out the syntax when decoding a SubjectAltName in a TLS self-signed certificate. I believe the certificate is well formed. The trouble is, I don't understand how to decode ...
3
votes
0answers
203 views

Can I tinker with the encoding when using pdftotext to convert PDF to text?

Sometimes when I do pdftotext it results in perfect text. I assume this is because the actual unicode text data is embedded directly in the PDF itself, and simply read out. But other times (around ...
0
votes
0answers
143 views

Readable text when copy-pasted from PDF becomes completely unreadable

What is this that when I select a completely readable, Latin (no language-specific characters, actually a company name and street address) text in PDF document and then copy and paste it to any ...
1
vote
4answers
211 views

Which ANSI standard is Joel referring to?

I was rereading Joel Spolsky's classic blog post The Absolute Minimum Every Software Developer Absolutely, Positively Must Know About Unicode and Character Sets (No Excuses!) and noticed this passage: ...
0
votes
1answer
144 views

In cmd.exe with codepage 437, why are characters whose “number” is greater than 127 prepended with a ┬ when using type?

I have a file that contains some characters whose "number" is greater than 127. If I use type file.txt to display the content of the file in a cmd.exe console whose code page (chcp) is set to 437, ...
3
votes
0answers
321 views

How to make Chrome URL display spaces instead of %20

Browsers like Firefox display URLs containing spaces (including nbsp's) with an actual space (); Chrome always displays spaces as %20 (and nbsp's as %C2%A0) in the address bar. (ie, Firefox displays ...
0
votes
1answer
112 views

NetTerm shows characters instead of lines

My issue is almost the same as Why does YaST now show lines as lqqqqqqqqqqqqqqq? , but instead of PuTTY and YaST, I'm using NetTerm and MLS (= WMS). My lines are also shown in characters as you can ...
1
vote
1answer
632 views

How to fix the character encoding problems after using filezilla?

I have the following problem: I used the filezilla application to get the files of a page through FTP to backup them in case it needs to be restored later. If it were to restore the site with the ...
2
votes
1answer
58 views

How to send an e‑mail to an address with Latin9/iso‑8859‑15 characters inside the username part of the address?

As part of finding a job, I need to send an e‑mail to an address which contains latin letters with accents inside the username. I know this is not standard, but they did it and there’s less than 1000 ...
0
votes
0answers
52 views

CodeLite replacing accent by special characters

I'm using CodeLite to develop my PHP applications, but this one has the annoying tendency to replace all my accents with special characters (this one: � or others like é). But UTF-8 encoding is ...
1
vote
0answers
337 views

NFS mounted to drive fails with Hebrew file names

I have an NFS mounted to a drive on windows. With English filenames all is working as expected. Whit Hebrew I get this error: “The file name(s) would be too long for the destination folder. You can ...
0
votes
1answer
4k views

Arabic characters do not display correctly when saving and reopening text file

When I save a text file with arabic letters from Notepad, they do not show correctly after reopening. Instead it shows ??????. Example, this is my file in Notepad: Then after saving, closing and ...
0
votes
1answer
339 views

How does notepad.exe determine character encoding?

I have a .txt file saved in UTF-8 format without a BOM. It contains an 'é' character. How does notepad.exe determine that it is UTF-8 encoded? Other .txt files containing only < 0x80 characters ...
0
votes
0answers
560 views

How do you create custom zalgo text?

I know what zalgo text is and that there are a few websites that can make it for you. But I'm looking for how I can make it however I want." HͥAͣQͫ" is an example, how can I make it so I can choose ...
3
votes
1answer
1k views

Windows 10 All alt codes and accentuated characters replaced by �

Since this morning, all alt codes I type in (like alt 256, alt 26, alt 144, ...), are replaced by the "�" character. It also happens sometimes in Windows with accentuated characters (like é à ï ...). ...
1
vote
3answers
3k views

How to type directly with keyboard the U+200C character?

How to type directly with keyboard the U+200C character in Notepad or other places... in Windows 8.1? (without depending on a certain font) I don't want to copy and paste ways. I don't want any ...
0
votes
1answer
286 views

Which type of character encoding consumes the most memory?

I will store a long (45132 character) string in a Postrgres database whilst preserving every character (including really rare ones). Postgres can store strings up to 1GB (see here). In terms of the ...
2
votes
1answer
2k views

What text encoding is used in “Zip archive data, at least v?[0x314] to extract”?

I tried multiple search terms on the usual suspect search engines as well as on stack overflow and superuser, but can't find anything on this. Normally a Zip archive magic pattern is "at least v1.0" ...
1
vote
2answers
1k views

FTP File transfer With Chinese Characters

When I'm trying to send files with Chinese characters over ftp, I am getting: 500 ERROR (Internal Server ERROR) through my backend code; It's working fine for english characters but not for ...
0
votes
2answers
3k views

Exporting from Excel to CSV replaces Japanese characters with ??? even though Windows, Office locale is Japan/Japanese

I am exporting an excel file (Excel 2016) containing Japanese characters into CSV. (Note : I am not exporting to CSV UTF-8 provided). In the process, all Japanese characters are replaced with '?' My ...
1
vote
1answer
923 views

Windows 10 OpenSSH - Character Encoding

Is there any setting on client-side such that I get the German Umlaut display correctly when connecting from my Win10, 64b, English to Linux servers by using Windows 10 OpenSSH client? While I like ...
0
votes
1answer
334 views

PuTTY not showing character | and _ correctly in pstree and tree command output

On Linux, tree and pstree commands show tree-like hierarchy of directories and processes respectively. Their output usually includes the characters | and _ which are used to draw the tree structure. ...
0
votes
0answers
262 views

Interpret text file with some hex codes?

I have a file with contents looking like PK\u0003\u0004\u0014\u0000\u0006\u0000\b\u0000\u0000\u0000!\u0000À¸<91><91>¢\u0001. However, I have a different version of the same file looking ...
2
votes
0answers
229 views

Execute sh file with Russian or Chines Chars - Saved as UTF-8 or Unicode

I have a file which has some russian chars in. Below is the content of by sh file. #!/bin/sh sed -i "s/\bVAR1\b/Привет, как ты/g" file1.txt When i save this file i had to save this as UTF-8 or ...
1
vote
0answers
192 views

Docker container in Windows Bash ignores non-ASCII characters, work's in PowerShell

I'm running a Python Docker container on my Windows 10 computer. If I add Norwegian specific characters in my Python code, such as print("båt"), and run the container in Windows Bash, the output is bt....
0
votes
2answers
17k views

TXT files: how to switch from weird characters back to normal?

So, I have on a flash drive a txt file generated in Cyrillic (my own work, own pen drive), a few years old. Now I needed to open it, only to see this kind of mess. I wonder why is this happening and ...
0
votes
2answers
452 views

What is causing these two apparently identical files to have different hashes?

I am unable to figure out why the following two files are yielding different hashes (SHA1, CRC32, SHA384, whatever): https://cdn.jsdelivr.net/npm/jsonify-error@1.2.1/dist/jsonify-error.js https://...
0
votes
0answers
235 views

What encoding is needed to read this HTML file containing Spanish characters?

I downloaded this HTML file from archive.org, which is a digitilised book, written in Spanish. As such, it has plenty of accents and other unique symbols (e.g. ñ). Now, when I open the html file in a ...
9
votes
3answers
3k views

Why when copying a non-English URL from address bar it's URL encoded and not as the text I see (decoded)?

When I copy a link from the address bar that has characters that needs to be encoded usually, the copied link will contain the encoded text and not the decoded (which is what's visually seen). But if ...
0
votes
0answers
867 views

Windows RDP accent and special characters

Windows 10 RDP behaviour seems to have changed post April update. Same hardware, same mouse, same OS, same everything. I'm connected to a remote session (Windows Server 2012 R2) and am experiencing ...
3
votes
6answers
15k views

Proper encoding for file names in zip archives created in Windows and unpacked in linux

I have problems with different charsets in Windows and Linux (Centos). I have files with special characters in their filenames from many different languages. The zip archive is generated under Win7 ...

1
2 3 4 5 6