Questions tagged [unicode]

Unicode is the standard for computer representation of plain text. It encompasses the Universal Character Set, intended to unambiguously represent all characters used in human writing systems in any language, Unicode Transformation Formats (UTFs), defining standardized formats for storing and transmitting Unicode text, and standards for processing and manipulating text.

Filter by
Sorted by
Tagged with
0 votes
0 answers
13 views

Python hangs when printing some Unicode c1 control characters, not in a consistent manner

For testing purposes, I created a file with bytes 0xc2 0x90, representing Unicode code point 0x90 in UTF-8 encoding. I can cat this file without an issue, but trying to print the string written from ...
user avatar
1 vote
1 answer
25 views

Unicode in batch

My question is simple. I need to put fancy unicode into a batch file. I already put chcp 65001 at the start. Here is my example code: @echo off chcp 65001 >NUL echo [✓] This is a correct line echo [...
user avatar
  • 23
1 vote
1 answer
17 views

IDN U-Label to A-Label wrong with many services

I own the Unicode Domain κλαρα-σωλις.ευ, which should be converted to xn----ylba7abgd9bnh0e.xn--qxa6a, but many services convert the URL to xn----ylba7abgd9buc7d.xn--qxa6a. Websites like https://www....
user avatar
0 votes
1 answer
34 views

Two seemingly identical VS Code Linux installations display fonts differently

I have two laptops, both running the same version of latest Manjaro. The same version of visual-studio-code-bin from AUR is installed. Both use the same font for code. Yet, they render Unicode symbols ...
user avatar
  • 131
0 votes
0 answers
19 views

Check if unicode character will have associated glyph in bash

Problem setup I have a PS1 definition using nerdfonts. However, sometimes when ssh'ing into them from some machines, the special characters are not expanded. In this case, I will like to replace the ...
user avatar
  • 103
0 votes
0 answers
20 views

How to show exact characters in Hindi url instead of unicode character while sharing or copying it?

This is a page that has a slug and some content in Hindi language. Link:https://traveltriangle.com/packages/5%e0%a4%b0%e0%a4%be%e0%a4%a4%e0%a5%87%e0%a4%82-6%e0%a4%a6%e0%a4%bf%e0%a4%a8-%e0%a4%b6%e0%a4%...
user avatar
0 votes
1 answer
50 views

Unicode character is invisible on Windows but shows up on Linux

The character in question is the Braille Pattern Blank: "⠀" On machines with Windows and even on my phone, this character is rendered as invisible (as seen here). This is helpful because it ...
user avatar
  • 3
1 vote
0 answers
24 views

If a ligature/digraph has separate collation order, should it be considered different from constituent letters?

There are many digraphs and ligatures in common use like ß, w, ffi, st, æ, dž, ch etc. Some of these are completely different from its constituents. For eg, search for u in a string containing w should ...
user avatar
0 votes
0 answers
77 views

Can I enable Unicode UTF-8 WorldWide Support in WIndows 11, but set another encoding for a specific app?

generally, I like to enable UTF-8 worldwide support in Windows 11, because most of apps I use support UTF-8 and I am using Linux OS with UTF-8 at the same time. But the problem I had so far is one of ...
user avatar
  • 325
0 votes
0 answers
15 views

when running "LC_ALL=C.UTF-8 egrep -axv '.*'" to detect non-UTF8 characters how can I determine the exact character that caused the detection?

I frequently use this command: LC_ALL=C.UTF-8 egrep -laxv '.*' filename this tells me if the file contains any non-UTF8 characters (actually I usually use this in conjunction with find to scan many ...
user avatar
1 vote
2 answers
135 views

How do you open/import a CSV file with Unicode characters encoded as numeric character references?

In Excel, I tried to import (using Data > Import) a CSV file with Chinese characters. The characters are represented as Unicode numeric character references (NCR); for example 香&#...
user avatar
  • 113
1 vote
1 answer
61 views

password recovered in weird format

i have been trying for years to recover my old data from very old DS cards " MMC " recently i found out it is possible to get to mmcstore file that stores the password in plaints text all ...
user avatar
1 vote
0 answers
88 views

Reproducing folder named *

The question Folder named * was brought to my attention. I thought I could easily reproduce this by taking Git Bash and entering mkdir \* At first I didn't look closely, I just saw a folder appear in ...
user avatar
0 votes
1 answer
29 views

Confusing Unicode phenomenon

I have an irritating phenomenon in my home network. My NAS is a Synology, 3 workstations are Apple based and 1 is Windows 10. Lately I had a problem copying files using the Apple finder and it croaked ...
user avatar
0 votes
0 answers
54 views

Changing font for a range of characters using fontconfig

I want to change font for a range of Unicode characters (basically Devanagari). Found about the following way in another answer on SO, but it still won't work. I tried to reason about the code and ...
user avatar
0 votes
2 answers
57 views

Do web browsers have Unicode character files in them or they inherit these from the operating system?

If we create at least one new character with at least one typography set we would have to include any character file and any font file, in the browser file tree and also declare these files in the ...
user avatar
  • 3
1 vote
1 answer
36 views

How can you type characters from U+0100 and up with Numpad?

It appears that the Alt + Num shortcuts end at U+00ff (decimal 0255); typing Alt + 0255 yields ÿ which indeed is at U+ff. I have failed in finding out what the system for the hotkeys in excess of ...
user avatar
0 votes
0 answers
17 views

Rescuing corrupted unicode wrong language file names

I have a 3d model of a character that a the distributor had downloaded from a Japanese website sometime during 2013. The filename seems to have been messed up due to an English system locale. "...
user avatar
  • 1
0 votes
1 answer
139 views

Simplified Chinese characters are not displayed correctly in Windows command prompt

When I enter or paste a simplified Chinese character, it is displayed weirdly. It looks like a 'p' character enclosed in a rectangle. Please see the picture attached. But I copy the character and ...
user avatar
  • 1,638
0 votes
0 answers
13 views

Disabling the hotkey for Unicode mode (Ctrl-Alt-U) and Scancode mode (Ctrl-Alt-K)

My setup: Using Remote Desktop to connect to a Windows 10 Pro Desktop computer from a Intel MacBook Pro running MacOS 12.2 Apple Magic Keyboard with Numeric Pad PowerToys Keyboard remapping (remapped ...
user avatar
0 votes
0 answers
46 views

How to recover my file from Unicode which is corrupted after reset in Windows 10?

I had a file with a key in it. I did a reset of my windows, it was only afterward that I realized that I had forgotten to keep this document. I used TestDisk to find this file, but I damaged it. When ...
user avatar
0 votes
0 answers
66 views

Difference between Windows 10 'findstr' and 'Windows Search' regarding Unicode files

There seems to be a difference between two search tools in Windows 10. Specifically, the 'findstr' command can find text content encoded in UTF-8 and UTF-8 BOM, while 'Windows Search' can only find ...
user avatar
0 votes
2 answers
64 views

Trouble with perl and UTF-8

If I interpret documentation ci=orrectly, perl --CSD is suppose to ensure that input and output, processed or commands, are using UTF-8 encoding. But if I replace two hyphens -- with an em-dash — (U+...
user avatar
  • 673
-1 votes
1 answer
158 views

Which Unicode characters cannot be used for NTFS file names?

Typically, my programs are creating files with Extended Latin, CJK or Arabic characters in file names without issues and according to input data. I was under impression that only officially named ...
user avatar
  • 11.7k
1 vote
0 answers
42 views

Old Hangul (옛한글) on Safari not rendering

I have a Mac(MacOS 12.0.1) and use Safari as my default browser. Across my Mac, despite having several fonts that support it, Old Hangul (옛한글) does not render how it is supposed to. In more detail, ...
user avatar
  • 11
0 votes
0 answers
23 views

How do I activate the Unicode Edit Hebrew Alphabet

I want to activate the Unicode Edit ALphabet as in the second snippet also in Notepad as in the first snippet. How do I do that ? https://i.stack.imgur.com/gCsE9.jpg https://i.stack.imgur.com/9SAs7....
user avatar
0 votes
1 answer
42 views

Printf in gawk with the correct encoding?

I'm wondering: can gawk printf in any format besides ASCII? Currently, I'm using gawk match() to search through some UTF-8 text. When I go ahead and print out the matches gawk finds, it ends up like ...
user avatar
  • 1
1 vote
1 answer
27 views

Is there a way to set up characters with 5 digits of unicode as dead key code points in MSKLC?

Is there any way to overcome this software limitation? As seen here it only takes inputs of 4 digits long while i need to input in unicode keys 5 digits long, when I try to do it, an error message ...
user avatar
  • 17
0 votes
0 answers
18 views

Unicode: searching using a similar character (same graphene, but different codepoint)

I was searching both in Word and in Zotero for "Trickle-", finding no results. That's because the string I was looking for is actually "Trickle‐". What's the difference? The first (...
user avatar
1 vote
1 answer
32 views

What is the point of "extended" digits like ۱

This stack exchange comment uses the ۱ character, which I had never seen before. Using babelstone, I've identified the character: U+06F1 : EXTENDED ARABIC-INDIC DIGIT ONE Now, the interesting part ...
user avatar
2 votes
2 answers
500 views

How can I perform an ISO-8859-1 to UTF-8 text file conversion while not changing any characters that are already valid UTF-8

Consider a text file that looks like this visually: This’s ISO-8859-1 This’s UTF-8 Behind-the-scenes, the ’ curly quote character in the first line is encoded as ISO-8859-1, and the same ’ character ...
user avatar
0 votes
1 answer
33 views

Remap key to a UTF character from another keyboard layout in Linux?

I'm using KeyMapper to remap some of the keys on my keyboard, but I haven't figured out how to do this specific thing. I need a couple of Unicode characters from a different keyboard layout, so I can'...
user avatar
3 votes
1 answer
269 views

How to get box with rightward arrow symbol in MS word?

I tried searching all the symbols in character map and in Microsoft word's symbol section for the following symbol but couldn't find it. Box with rightward arrow: People usually use this for ...
user avatar
  • 33
2 votes
2 answers
505 views

Why is Chrome displaying color emoji characters but printing black & white?

The following characters (for example): 🌞 (U+1F31E Sun With Face) 🌙 (U+1F319 Crescent Moon) Are displayed like this in Chrome: But print like this (all drivers, including PDF) (in preview and in ...
user avatar
  • 9,800
0 votes
1 answer
24 views

Type superscripts of multiple characters to express mathematical exponents

If in linux I type CTRL-shift-U, followed by a unicode control code, I can type a superscript. So if I type 10, followed by CTRL-shift-U, followed by b9, I can get 10¹. How though do I write something ...
user avatar
  • 155
0 votes
0 answers
29 views

Which code page encodes ü as d0 91?

I have a zip file with garbled file names after unzipping (with unzip thefile.zip, the -U or -UU switches don't help) on my linux box. If I use 7z x thefile.zip the umlauts are skipped (missing in the ...
user avatar
  • 878
0 votes
0 answers
42 views

Can't type accented characters in linux terminal

When in the terminal emulator(doesn't mind which one but currently using kitty) I can't type accented characters. I can copy them from other sources(like firefox or a document) but I can't type them ...
user avatar
1 vote
1 answer
275 views

Text editors; Unicode; the zero-width non-joiner character

I need to edit text files that contain unicode characters (in ReStructuredText for input to Sphinx). I'm pretty confident that most text editors will store and display most Unicode characters ...
user avatar
0 votes
1 answer
76 views

How do I preview a string containing unsupported Unicode characters

I have a string. It contains a lot of unicode characters (mostly the flags). These are not supported on Windows. Is it possible to preview them anywhere using some online service? Ideally, I want to ...
user avatar
1 vote
1 answer
92 views

After setting EnableHexNumpad=1, hex Unicode alt-codes work well in Notepad++ and Excel but have a strange behavior in Word

I try to summarize what is the behavior I see, keeping into consideration that Windows can't handle codes above 0xFFFF: Word works flawlessly with decimal code point inserted through Alt+decimal. As ...
user avatar
1 vote
1 answer
36 views

xterm: circled numbers (U+2460-U+2470) only the left half of the glyph is displayed

I am using the version of xterm that ships with ubuntu 21.04 (package xterm361-1ubuntu3) and some characters such as circled numbers are not displayed correctly: the right half of the character is ...
user avatar
  • 111
1 vote
0 answers
22 views

diff while ignore unicode whitespace characters (CJK full width space)

I'm trying to diff two files. One of these files contains extra full-width spaces (U+3000): Text 1 Text 2 Text 3 Text 1   Text 2 Text 3 diff -w A.txt B.txt reports 2c2 < Text 2 --- >   Text ...
user avatar
  • 111
0 votes
0 answers
54 views

How do I display better emoji in my apps?

I want to show emoji's clearly in my terminal app. If you print the snowman before it'll look awful echo -e '\U2603' output: ☃ However I found out there's something called "Variation Selectors&...
user avatar
0 votes
1 answer
47 views

NSIS Error Launching Installer - Unicode characters in Windows Username

When downloading and running an EXE installer on my new laptop I get the NSIS Error Launching Installer. When the same installation is downloaded on a different computer and transferred via USB drive, ...
user avatar
17 votes
3 answers
4k views

What are the closest Unicode symbols to represent these icons (double arrow, bulb, CLI interface, multiple tabs)?

I am not really familiar with Unicode. I have some icons as .png files and I need to find Unicode symbols for them. Not sure if they exist. Not sure how to do a smart search for this kind of ...
user avatar
0 votes
1 answer
114 views

Notepad++ macro doesn't play back what I entered

This is my first Notepad++ (V7.8.4) macro. Something is going wrong. The macro is supposed to insert a Unicode discretionary hyphen, U+00DA. The actions I recorded were: type 0, 0, d, a; hold down ...
user avatar
0 votes
3 answers
284 views

Notepad++, entering Unicode characters

I'm trying to type Unicode characters in Notepad++ (v7.8.4), and it isn't working. This procedure should enter a Unicode character: Hold down Alt, press the numeric keypad's + key, then enter the ...
user avatar
0 votes
1 answer
34 views

Weird grep behavior with CJK characters? (bash)

grep fails to match certain strings with CJK characters. For example. Create a text file with content below: ==ShellType.サモナ\u30FC== Use grep. >> grep "ShellType.サモナ\u30FC" ...
user avatar
3 votes
4 answers
8k views

How Can I Type A Checkmark (✓) Via Alt Code?

Presently, every time I want to check something off I have to Google "checkmark", copy the symbol from a 3rd party website, paste it into a text editor to remove formatting, and then copy ...
user avatar
  • 401
0 votes
0 answers
37 views

Unicode Error when trying to use Command Prompt with USB Flash drive or SD Card

I have problems when trying to use unicode characters like Russian characters (Cyrillic) on the Command Prompt (CMD). This problem only happens when I am on USB Flash drive or SD Card, which use FAT32....
user avatar

1
2 3 4 5
14