Questions tagged [unicode]
Unicode is the standard for computer representation of plain text. It encompasses the Universal Character Set, intended to unambiguously represent all characters used in human writing systems in any language, Unicode Transformation Formats (UTFs), defining standardized formats for storing and transmitting Unicode text, and standards for processing and manipulating text.
710
questions
7
votes
1
answer
190
views
Fonts and different glyphs
I was always curious about how to create nonstandard fonts and couldn't find a good documentation how the font mechanism works.
How come the screen is rendering this? If this is a Unicode, how can I ...
7
votes
5
answers
6k
views
Good Font for Unicode Symbols
I'm looking for a good font for displaying Unicode, specifically I'm after a complete set of U2400-U2800. In Firefox I get most of it, but in my application I've tried Arial Unicode MS, Lucida Unicode ...
7
votes
2
answers
14k
views
How do I remove non-ASCII characters from filenames?
I have several files with names containing various Unicode characters.
I'd like to rename them to only contain the "printable" ASCII characters (32-126).
E.g,
Läsmig.txt //Before
...
7
votes
1
answer
802
views
Fancy colored rendering issue on osx 10.8 retina with iTerm
I use iTerm2, with oh-my-zsh and zsh and in my .zshrc file I set a couple of my prompts to the unicode bolt symbol as follows.
ZSH_THEME_GIT_PROMPT_DIRTY="%{$fg[yellow]%}⚡%{$reset_color%}"
RPROMPT="%(...
7
votes
1
answer
585
views
What is this mix of Chinese/Arabic/Korean/Japanese user owning a process listening on port 139?
While using an open port checking tool (Technicians toolbox v1.1.0) I found a strange user name listening on port 139 hiding in PID 4 with a mix of Chinese and other Unicode characters as the user ...
7
votes
2
answers
669
views
Can I set font fallbacks in PuTTy?
I want to be able to display the unicode characters ℓ, ∘, ₁, and ⊔ (among others) in emacs in screen in PuTTy. I can see the first one by setting the font to Courier New, or I can see the second and ...
6
votes
1
answer
14k
views
Unicode characters display improperly in KDE and on the console in Arch Linux
I recently switched from OpenSuSE to Arch Linux. Files with unicode characters in the name used to display fine, but after the switchover I just get mojibake. For example, in my music library ...
6
votes
2
answers
2k
views
Link all Noto Fonts into a giant font in Windows 7
Windows 7 has various fonts that cover different scripts within Unicode. However, the free Noto fonts provide a good alternative, covering a very large portion of Unicode with a visually uniform ...
6
votes
4
answers
7k
views
Convert UTF-16 LE to UTF-8 in windows via command line
(question re-written to be more useful)
I have a batch script which will interact with command line programs, take their output, and then perform decisions based on that output.
One of the programs I ...
6
votes
2
answers
760
views
How to type the right ceiling character “⌉” in a windows 7 login password box with a qwerty laptop keyboard?
Dumbest question ever: how can I type with laptop keyboard the "right ceiling" character (http://www.fileformat.info/info/unicode/char/2309/index.htm) aka "⌉" ) in the windows login password box ( ...
6
votes
2
answers
4k
views
How can I make “ls” show dotfiles first and preserve unicode filenames?
$ export LC_ALL=en_US.UTF-8
$ ls -al
total 24
drwxr-xr-x 6 pi pi 4096 Jul 23 16:34 .
drwxr-xr-x 9 pi pi 4096 Jul 23 16:33 ..
drwxr-xr-x 2 pi pi 4096 Jul 23 16:33 .A
drwxr-xr-x 2 pi pi 4096 Jul 23 16:...
6
votes
2
answers
8k
views
Why does Notepad++ display some Unicode characters as square?
It can display ₐ₊₋ but some other subscripts (like ₂ₙ) are converted to squares. When I copy that square and paste on here the problem disappears: ₂. Why is that? The file is encoded in UTF-8.
FYI: ...
6
votes
1
answer
3k
views
Which character encoding is used for ALT-codes?
In Windows, when entering characters using ALT+nnn, which character encoding is being used? And when entering characters with ALT+0nnn, which character encoding is being used? And how do these answers ...
6
votes
4
answers
4k
views
Find all UTF-16 encoded files on Windows
Is there a tool available for Windows (command line, gui, script, etc.) that can recurse a directory and identify all files encoded as UTF-16?
6
votes
1
answer
3k
views
How to disable library book file names transliteration in Calibre?
Whenever I import a book co the Calibre eBook manager library it converts the names/titles to English removing all the accents from European words and replacing non-Latin (e.g. Russian) words with ...
6
votes
1
answer
2k
views
Is there a Unicode-aware LC_COLLATE sort order which respects punctuation?
As far as I can tell, setting the environment variable LC_COLLATE=en_US.utf8 changes four things compared to LC_COLLATE=c, regarding how programs like ls will sort files:
Unicode characters are ...
6
votes
1
answer
9k
views
How to type a minus char in Windows, or why do Alt-Codes produce different chars in different programs?
I got stuck with a problem with Alt-codes. I frequently need to enter the minus sign in my texts. My company uses Excel, PowerPoint and Word to exchange texts. Therefore I need to be able to type the ...
6
votes
1
answer
2k
views
View font characters for fonts not installed
This question assumes a Windows system.
For installed fonts, one can use Windows' Character Map to view the available characters of those fonts (with their Unicode codes). Even better is the "Symbol" ...
6
votes
2
answers
763
views
Telugu (unicode) font rendering in emacs
I sometimes edit text in telugu language. However, when I open the file (UTF-8 encoded) in GNU emacs (version 23.1.50.1 on Ubuntu Jaunty) the text rendering is incorrect. The same text file opened in ...
6
votes
0
answers
402
views
How can I generate combining characters on windows? [duplicate]
A while ago I asked this question on SO where I found out about combining characters and how for alt+777 you get ○ on most editors and ̉ on skype, which can be combined with a previous character and ...
6
votes
5
answers
8k
views
How to export a spreadsheet to a UTF-8 .csv from Excel 2016 on mac?
Hoping you can help me out with this one...
For my work, I've been assisting a DBA for the last few weeks and we've now been given the task of uploading a very large spreadsheet which has several ...
5
votes
7
answers
16k
views
Weird symbols on Mac
Since I've had my mac, I keep seeing this weird symbol. Till today, it had been only in the place of bullet points in OpenOffice.org. The first pictures shows this in a .doc file created on a Windows ...
5
votes
2
answers
9k
views
Converting ascii Russian to Russian?
I have a text document that is supposed to be written in Russian but it seems to instead be ascii:
Óñòàíîâêà:
1)Çàïóñêàåì QuidamStudioSetup3.15.exe
2)Ïðè çàïðîñå ñåðèéíîãî íîìåðà ââîäèì
How could I ...
5
votes
3
answers
12k
views
How to identify horizontal tabs in Excel and replace it
I have thousands of data in my excel file, they are scraped data from various websites, initially stored in CSV files then migrated into Excel. This data is for use of my web server.
Now my problem ...
5
votes
3
answers
2k
views
Preserving Greek letters on my PC
How would convert this long table of vocabulary (one column of greek then one of english) in this document into one excel spreadsheet where the Greek characters are preserved? Whenever I try to copy-...
5
votes
8
answers
966
views
Entering Unicode characters by name
Sometimes I want to type Unicode characters (em-dash, quotes, Greek letters sometimes, superscripts etc). It can be done using character codes, but then one needs to look up / memorize them, which is… ...
5
votes
4
answers
1k
views
Bidi support in Vim, should I revert to Notepad++?
Good day everyone,
Seven weeks ago, I started learning Vim. I tried it in the past a lot, but this time wasn't like every instance in the past. I got it, and Vim became a habit that I can't quit. I ...
5
votes
5
answers
4k
views
How do I find out which language some Unicode characters belong to?
On Facebook, there are currently messages floating around with these strange chars:
ก็็็็็็็็็็็็็็็็็็็็ กิิิิิิิิิิิิิิิิิิิิ ก้้้้้้้้้้้้้้้้้้้
They are used to confuse the reader, because ...
5
votes
1
answer
11k
views
Alternative symbol for dot/period/full stop that will work at the end of a folder name?
I'm looking for an alternative period sign that will work at the end of a folder name.
It's not super important, but in my music organizing there is an album title that is stylized with a period at ...
5
votes
1
answer
10k
views
How to put unicode in Cmd/Batch?
So, i'm trying to make a nice batch menu but everytime i try to use unicode's fancy lines i just get random characters.
Is there any way to put unicode in cmd and or a batch file?
5
votes
2
answers
9k
views
how to insert unicode characters in xterm
... assuming it supports Unicode ?
5
votes
3
answers
4k
views
How to make unicode characters visible in Emacs?
When I open a file with some UTF-8 text in it the characters show up as boxes.
I think I have a font missing, because I can safely edit these boxes and the changes will turn out correctly when I look ...
5
votes
1
answer
15k
views
How to Make Windows Show Unicode Characters Properly?
How do I make Windows 7 show Unicode all characters properly, like those in this question?
Right now I just see squares for some of them.
5
votes
3
answers
5k
views
Can't type Unicode because of keyboard shortcuts
I’m trying to type some Unicode characters that contain letters. I am using Windows 7 but the issue also appears in Windows 8. An example is 🎻 (U+1F3BB). I can’t type it though because Firefox and ...
5
votes
1
answer
8k
views
Fix corrupted Unicode file names in a zip archive
A colleague gave me a zip archive of some data I need to analyse, but unfortunately the filenames have been corrupted somewhere along the way, either when creating the archive or when extracting them ...
5
votes
2
answers
7k
views
unicode in irfanview
I tried opening a picture and it mentions activating unicode.
UNICODE PlugIn in Properties->Languages
I only see english and german. I already installed the plugin pack (via exe). I still cant ...
5
votes
2
answers
15k
views
How to mount via cifs non-unicode samba sever with character set conversion?
in old times of smbfs I use codepage and iocharset options, but cifs does not support codepage. What I can do?
5
votes
5
answers
6k
views
Even on Windows 7, can you do a "dir" and be able to see filenames that has unicode characters?
This is somewhat related to question
On Windows 7, dir or tree can't show unicode characters, even starting cmd with cmd /U
Even on Windows 7, I found that the only way I can get unicode to go ...
5
votes
1
answer
4k
views
Putting a file encoded with UTF-8 on the clipboard with CLIP.EXE under Windows?
I have a situation where I have a Java program that first write a text file and then invokes "CMD /C CLIP < textfile" to be able to put an arbitrarily large file on the Windows clipboard. Works ...
5
votes
3
answers
548
views
Will IE, Firefox, and Chrome be unicode domain compatible
Since there will soon be Hebrew domain names, I'm wondering if the major browsers already have support for this built in, or whether we'll have to wait for a future release to visit our favorite ...
5
votes
5
answers
20k
views
What is this symbol `¬` and how to remove it from an MS Word 2013 file?
I used a OCR program to convert some scanned pages to an ms word file.
After the conversion is possible to found the symbol ¬ in the middle of many words.
I tried to search and replace it but word is ...
5
votes
1
answer
294
views
Does unicode have a ee character like ꜳ (U+A733, latin aa)?
Does unicode have a ee character like ꜳ (U+A733, latin aa)?
Either Google is no good with stuff under 3 letters, or it really doesn’t exist.
5
votes
1
answer
280
views
English numbers in non-English subtitle
I wrote my subtitle in a word document & saved it as a txt file with UTF-8 encoding. Then I changed its format from txt to srt manually. my subtitle language is Persian.
I put it in the same ...
5
votes
1
answer
1k
views
How to get the Unicode code and symbol name for some characters in a PDF file?
I have a PDF file with some Unicode characters (see picture).
I can copy these characters to clipboard and insert in, for example, MS Word and I see the character as a single square with a question ...
5
votes
2
answers
9k
views
How can I find out the encoding of this corrupted Chinese text, which an online tool fixes correctly?
I have a text in Simplified Chinese, which, when read as UTF-8 begins with ´ÓºÜ¾ÃÒÔÇ°¿ªÊ¼, which the online tool from MandarinTools (first search result for Repair Corrupted Chinese Email) fixes to ...
5
votes
6
answers
3k
views
How to replace LaTeX commands with Unicode symbols?
Often, during a conversation or an email, or at a forum, I would like to type some math, but I don't need full equation support. Unicode symbols should suffice.
What I need is an easy way to type ...
5
votes
1
answer
2k
views
What Unicode character is used to describe a horizontal fraction bar?
I have searched quite a bit, but all I can find is en and em dashes?
I thought Unicode tries to be specific about the use and meaning of a character, so I am expecting something specific.
Is there ...
5
votes
1
answer
618
views
Keyboard layout for math
I usually need to write math with LaTeX, and after seeing this question: Entering unicode math symbols. I came here with some small questions.
I find that not perfectly comfortable, and I was ...
5
votes
3
answers
2k
views
Google Chrome Cherokee Unicode Boxes/Squares
My Software I'm running Windows 7 64-bit and Google Chrome 64-bit Version 57.0.2987.98
When I bring up Google Chrome and type inside the URL using Cherokee keyboard I am able to see "ᏣᎳᎩ" Which ...
5
votes
1
answer
570
views
Characters turn into unicode in gnome terminal with lldb
I installed a fresh copy of lldb on my machine. Anything typed after lldb makes its first output (in this case being error: empty command) turns into unicode literals. These unicode literals are ...