Questions tagged [unicode]

Unicode is the standard for computer representation of plain text. It encompasses the Universal Character Set, intended to unambiguously represent all characters used in human writing systems in any language, Unicode Transformation Formats (UTFs), defining standardized formats for storing and transmitting Unicode text, and standards for processing and manipulating text.

Filter by
Sorted by
Tagged with
1 vote
0 answers
95 views

How to make one key stroke emit 3 unicode character in a custom keyboard layout in Linux mint?

I have created a custom keyboard layout for my regional language by editing different files. It works fine except for one problem. One of the characters needs 3 unicode characters in combination I.e. ...
Ritu Lahkar's user avatar
0 votes
1 answer
31 views

Interpret an Unicode value as real character in Notepad++

If I copy an Unicode encoded value as actual rendered character (for example form here - 1D400) and paste it into Notepad++, it really does show it as a "bold" character. But when I try to ...
Anka Petkova's user avatar
0 votes
0 answers
40 views

Git Bash doesn't display characters correctly, using Visual Studio Code's integrated terminal

I use Git Bash as the default terminal profile on Windows. When I execute this command, I get the below output: memlab run --scenario tests/oversized-object/index.js > 'command' �����ڲ����ⲿ���Ҳ���...
Lin Du's user avatar
  • 101
0 votes
0 answers
14 views

Unicode glyphs for wysiwyg ruler bar symbols (margin, left-tab,right-tab, center-tab and decimal-tab)

Various word processors and text layout software have a "ruler bar" to indicate margins, indentation, and tab locations for a block of text. The symbology used in ruler bars is fairly ...
Dan Menes's user avatar
  • 101
1 vote
1 answer
84 views

Bash prompt with zero width control characters

To prevent the prompt from warping around right-to-left text, I want to insert a zero width LRM into the bash prompt (U200e). Since this is a zero width character, my instinct was to wrap it with \[&...
Shachar Shemesh's user avatar
1 vote
1 answer
48 views

Correct way to encode mixed width text in Unicode?

From what I read, the fullwidth glyphs in Unicode are provided solely for backward compatibility and lossless roundtrip with legacy standards such as Shift-JIS. The rationale seems to be that Unicode ...
SuibianP's user avatar
1 vote
1 answer
46 views

Unicode sequence for custom character with dot underneath

Unicode has code points for certain Roman characters with a dot underneath, for instance U+1E04 — "Latin Capital Letter B With Dot Below" but code points don't exist for all letters. How can ...
ErikR's user avatar
  • 173
2 votes
1 answer
79 views

VIM uses wrong encoding - but only in status messages

I ran into a strange issue with my ArchLinux setup. Vim uses correct encoding for reading/displaying files but these status messages (which displays the current mode or reports back when the buffer is ...
Gabor Garami's user avatar
1 vote
2 answers
229 views

Excel treats unicode characters as text

I have received an excel file which contains data from government website, whose text is in Hindi language. When I open the csv file, it displays the hindi texts in unicode characters like the ...
Schmid's user avatar
  • 13
0 votes
1 answer
98 views

How to disable Ctrl+Shift+u keyboard shortcut (unicode-selector) in Fedora 39 KDE-Spin (Wayland)

0. How can I disable the Ctrl+Shift+u keyboard shortcut (unicode-selector) in Fedora 39 KDE-Spin (Wayland-Session)? Whenever I hit this key combination on a GTK+-app, the infamous underlined "u&...
LizLee's user avatar
  • 1
1 vote
2 answers
452 views

How to write correctly arbitrary fractions in Unicode?

How do i write correctly arbitrary fractions according to the Unicode standard for the OpenType feature frac ? My use case is: I write data in a text document(UTF-8) and have self written program ...
Tobias Wohlfarth's user avatar
3 votes
1 answer
158 views

How do I copy the URL contained in the Internet shortcut with unicode characters? (command line for many Internet shorcuts)

The subject was in part studied, there is 8 years (here : How do I copy the URL contained in the Internet shortcut?) I have thousand Internet shortcuts that I would like copy the URL contained to txt ...
dg lr's user avatar
  • 33
0 votes
1 answer
47 views

Can unicode characters requiring the number pad, e.g. U+3041, be typed using the On-Screen Keyboard?

Suppose that I want to type 'ぁ' *Unicode U+3041) using Window 10's On-Screen Keyboard without changing my language away from US English. Can it be done? As far as my research indicates, this would ...
J. Mini's user avatar
  • 136
1 vote
2 answers
480 views

Unicode characters became invisible since Windows 10 update

After a recent Windows 10 update, emoji became invisible in several apps (Google Chrome, MS Word). The behavior of MS Word is particularly weird: When I open a DOCX file that contains emoji (set with ...
root's user avatar
  • 1,366
0 votes
1 answer
114 views

If the `ffi` group of characters is smushed together into one character, then why I can select each of them separately?

In the video Why You Can Tweet More In Japanese: What Counts As A Character?, the author says that: Unicode has a single character for some English ligatures, like "ffi" - notice how the ...
Ooker's user avatar
  • 2,021
0 votes
1 answer
383 views

Notepad on Windows 11 not respecting Unicode monospace characters

I'm using box-drawing characters to represent trees. I need other people using Windows to see them so I can assume they all have Notepad installed. But even if I select Consolas as the font, here's ...
Juan's user avatar
  • 125
0 votes
0 answers
27 views

How to add multiple entries to MS-Word "Math AutoCorrect"?

In MS-Word Math AutoCorrect there are entries for all alphabets in Script type as below - Say, I want to add a similar suite to represent vectors with all the alphabets. Currently I can do it one ...
Anirban Chakraborty's user avatar
1 vote
2 answers
308 views

Website that used to display unicode properly no longer does so

This is a problem that I've encountered a couple times recently. Here is my most recent experience: Trying to browse https://www.scape.sc/release.php?id=48, a page that contains japanese text. The ...
homework's user avatar
1 vote
0 answers
33 views

CJK unicode characters output from `wine reg query` displayed on terminal are fine. But they become question marks after pipe

When I run wine reg query 'HKEY_CURRENT_USER\Software\Akelsoft\AkelPad\Recent' on my machine, the output is fine and contains something like file0 REG_MULTI_SZ Z:\home\x\怎.txt on my terminal. ...
cshu's user avatar
  • 175
1 vote
1 answer
190 views

Problems with Word link to Excel when Windows is set to use UTF-8

I've some Word documents that have fields that are automatically updated from an Excel file using Words built-in links to Excel (as in copy > paste special > paste as link). After setting up a ...
Sergio Duarte's user avatar
0 votes
1 answer
447 views

Change encoding to Unicode in .csv exported from Gmail

I'd like to copy the typed-in addresses from Gmail to Outlook 2021 (Windows 10). To do this, I'm using the Google Contacts Export to Outlook CSV function and nk2edit. The problem is that the special ...
MorganInTheMorning's user avatar
1 vote
1 answer
215 views

Random unicode characters while typing normally in Windows 10

Sometimes when I'm typing in Windows I get some unicode-variant of the character I was trying to type. for example: ŕ instead of r ś instead of s ḳ instead of k etc. Things I've already tried: Try ...
webjuicefern's user avatar
6 votes
4 answers
7k views

Convert UTF-16 LE to UTF-8 in windows via command line

(question re-written to be more useful) I have a batch script which will interact with command line programs, take their output, and then perform decisions based on that output. One of the programs I ...
bfh47's user avatar
  • 83
9 votes
3 answers
2k views

fixing mis-encoded Chinese in file names

I'm saddled with a bunch of files whose names are garbled beyond recognition. Even though I more or less know what those names originally contained, fixing them by hand would involve a lot of hassle, ...
wildekat's user avatar
0 votes
0 answers
42 views

In Excel, how do I handle someone else's workbook that uses UNICODE?

I have been sent an Excel workbook in which I find that a cell that appears to contain the letter "A" produces FALSE if I compare it with "A". That is, if the cell in question were ...
tkp's user avatar
  • 444
0 votes
0 answers
45 views

How to customize fonts in Chrome by Unicode block (or even Unicode character)?

On its default, Chrome chooses which fonts to use on its own and utterly ignores the fact the user has installed fonts that would support much more characters. For example, it ignores all CJKV ...
Alexander Z.'s user avatar
0 votes
0 answers
39 views

Is the dataset that underpins the Windows Character Map utility accessible somewhere on the system?

The Windows Character Map utility displays the glyphs available in the chosen font, along with the Unicode codepoint and a name for a selected character. Is the dataset that underpins this utility ...
Tim's user avatar
  • 817
2 votes
0 answers
208 views

tmux inside Cygwin mintty - unicode characters broken depending on command

Please help me understand what's going on with some unicode characters looking right inside mintty + tmux in some command outputs, but not in others. Sample commands: for c in 00AE 1F007 1F32D 1F603; ...
EndlosSchleife's user avatar
0 votes
1 answer
277 views

Missing some Unicode glyphs on Windows 7, is there way to fix/patch it?

I have an arrowsbe.txt file, with the following content (in hex): FE FF 00 41 00 42 00 43 2B A1 00 20 2B A2 You see, it is UTF-16BE encoded, with BOM at file start. There are two not-so-often seen ...
Jimm Chen's user avatar
  • 5,874
1 vote
0 answers
33 views

Unicode letters replaced by ***** (letter n )

the letter n is being replaced with **** in my console when I run dbt. In text format: 11:59:24 Fou*****d 397 models, 15 tests, 0 s*****apshots, 0 a*****alyses, 639 macros, 0 operatio*****s, 11 seed ...
Flyingfish's user avatar
0 votes
1 answer
239 views

unicode-escaping with a standard Unix tool

I have cooked up the following python script, it does 1 thing and it does it well. It does, whatever Unicode magic unicode-escape does in python3 to some text. #!/usr/bin/env python3 import sys text ...
Jachin's user avatar
  • 111
1 vote
1 answer
569 views

Convert Korean files that are showing up incorrectly to utf-8 - character shows Çѱ¹Ÿî

I was just about to ask this after a long time of searching so decided to answer my own question... I downloaded Korean subtitles in an .smi file that was in zip archive. When I extracted it, the ...
iateadonut's user avatar
7 votes
3 answers
6k views

What is a quick way to write "dagger" sign in MS Word equation mode?

In MS Word equation mode with the Unicode converter, I write symbols by putting the "\" sign and then typing the specific Unicode, i.e., for the summation sign I write "\sum" and ...
Luqman Saleem's user avatar
3 votes
1 answer
2k views

How can I set my system's default encoding to UTF-16?

My daily activity involves usage of English, French, Spanish, and when I save personal copies of web pages or other documents, the full character range of those languages finds its way into filenames ...
Eric Marceau's user avatar
1 vote
1 answer
199 views

zmv to rename Unicode characters (e.g. u0308 'COMBINING DIAERESIS') on Mac/zsh-shell

While cleaning a file server I found unwanted or non-ASCII characters in many filenames. To rename unwanted filenames, I normally use the comfortable zmv command in a zsh shell on an OSX machine. To ...
mfuerli's user avatar
  • 11
0 votes
0 answers
500 views

Problems with certain Unicode characters

I am using word, and I needed to insert the name of the Chinese Nüshu script in Nüshu (𛆁𛈬), there wasn't a font that supported it, so I downloaded every font I could find that supported it. Noto ...
LEG's user avatar
  • 1
2 votes
0 answers
92 views

Is it possible to write the Lovecraftian Sigil of the Gateway in unicode?

It isn't technically copyrighted and doesn't seem to be subject to trademark, and is kind of a cultural symbol, so for all I know there's a hidden symbol assignment for it somewhere... but the Sigil ...
Michael Macha's user avatar
0 votes
1 answer
845 views

Can't copy chinese text from PDF

I tried to open it with google docs, and tried the site i2orc to convert the file. But in both cases the Chinese characters are missing from the output, just as when i copy/paste them from the ...
Vitor Pinheiro's user avatar
2 votes
0 answers
129 views

Not able to copy Korean characters from PDF file using Acrobat Reader

I decided to study Korean and I found a book that I want to copy some vocabulary from, the problem is when I paste the copied text, it turns into gibberish characters. Any idea how to solve this? I ...
Wax's user avatar
  • 121
3 votes
1 answer
13k views

Unicode backspace key symbol ⌫

Is there a Unicode symbol for the backspace key ⌫, the x inside a left-pointing arrow? I know that Unicode has a "BACKSPACE" control character (U+0008) that it inherited from ASCII, and it ...
Jo Liss's user avatar
  • 4,239
0 votes
1 answer
311 views

Binding unicode λ symbol (code+glyph) to key combination

I would like to type Unicode λ in a clear way (key L and alt modifier, for example) and not pressing SHIFT+CTRL+u03bb each time (or doing a poor trick like copy/paste). I've tried a lot of ways to ...
Daniel Bandeira's user avatar
1 vote
1 answer
1k views

How can I type rough breathing marks in Classical Greek using the Windows 11 Greek Polytonic keyboard?

I'm learning to use the Greek Polytonic keyboard in Windows 11 to type Classical Greek. I can successfully type the following characters (using α as an example): ᾶ, ἀ, ἄ, ἂ, ά, ά, ἆ, ᾱ. For example, ἄ ...
user3457004's user avatar
0 votes
1 answer
71 views

Why can't I print this in windows ( ه҈҉҉҉҉҉҉҉҉҉҉҉҉҉҉҉҉҉҉҉҉҉҉҉҉҉҉ ')?

I got this from the following question: What are these ? ه҈҉҉҉҉҉҉҉҉҉҉҉҉҉҉҉҉҉҉҉҉҉҉҉҉҉҉ I can't get this to print in windows powershell. I tried using chcp 65001. BTW I can print 北京 but not ه҈҉҉҉҉҉҉҉҉҉҉҉...
dCoder's user avatar
  • 101
4 votes
0 answers
2k views

Why is it so HARD to have Windows 10 CMD console display Unicode correctly?

Before showing the hard(difficult) example of Windows 10 (Win10.21H2 in this case), let me show an easy example by Ubuntu 22.04 . I place file names with Chinese and Korean characters on a USB flash ...
Jimm Chen's user avatar
  • 5,874
2 votes
1 answer
317 views

Large Green Circle Emoji is not being displayed

My browser and apps are not displaying the Large Green Circle Emoji 🟢 [unicode 1F7E2]. Instead, the following is being displayed . I would appreciate some help in fixing this. I am using a MacBook ...
Kez's user avatar
  • 21
1 vote
1 answer
203 views

Counterclockwise Arrows emoji displays wrong on Windows 11

The Counterclockwise Arrows emoji (U+1F504) is supposed to look like this: Instead, it displays as the end arrow emoji (U+1F51A): The following list are the unicode characters in question: 🔄 (...
Zags's user avatar
  • 543
1 vote
0 answers
377 views

Python hangs when printing some Unicode c1 control characters, not in a consistent manner

For testing purposes, I created a file with bytes 0xc2 0x90, representing Unicode code point 0x90 in UTF-8 encoding. I can cat this file without an issue, but trying to print the string written from ...
Karl Knechtel's user avatar
1 vote
1 answer
399 views

Unicode in batch

My question is simple. I need to put fancy unicode into a batch file. I already put chcp 65001 at the start. Here is my example code: @echo off chcp 65001 >NUL echo [✓] This is a correct line echo [...
RakyX's user avatar
  • 23
1 vote
1 answer
35 views

IDN U-Label to A-Label wrong with many services

I own the Unicode Domain κλαρα-σωλις.ευ, which should be converted to xn----ylba7abgd9bnh0e.xn--qxa6a, but many services convert the URL to xn----ylba7abgd9buc7d.xn--qxa6a. Websites like https://www....
user avatar
0 votes
1 answer
180 views

Two seemingly identical VS Code Linux installations display fonts differently

I have two laptops, both running the same version of latest Manjaro. The same version of visual-studio-code-bin from AUR is installed. Both use the same font for code. Yet, they render Unicode symbols ...
facetus's user avatar
  • 131

1
2 3 4 5
15