Questions tagged [utf-8]
For discussions about UCS Transformation Format with 8 bits (UTF8). It is an encoding table that represents all characters in the Unicode character set.
270
questions
2
votes
2
answers
4k
views
Popular FTP clients failed to autodetect that VSFTPD serves UTF-8 file names
I run vsftpd 3.0.3 / armv7l / Debian 9.11 / Kernel 4.14.133+
Some paths have Greek characters.
In file /etc/vsftpd.conf there is a line utf8_filesystem=YES but, also, this is the default behavior.
...
- 101
10
votes
2
answers
6k
views
Trying to understand UTF-8 locale portability (and SSH) on various Linux systems including OS X
I spend a lot of my time sshed into various machines, all of which are different (some are embedded, some run Linux, some run BSD, &c.). On my own local machines, However, I use OS X, which of ...
- 55.6k
0
votes
3
answers
82
views
Is it an ANSI or UTF8 file?
I edited the following batch file in notepad. At the bottom-right corner of notepad, it showed "UTF8". I saved the file in ANSI format.
Now, the bottom-right corner of notepad showed "...
- 83.1k
33
votes
6
answers
169k
views
Converting text file to UTF-8 on Windows command prompt
I need to convert a text file to UTF-8 format via Windows command prompt. This needs to be done on another machine and I do not have rights to install software on that machine. I need something like:
...
CommunityBot
- 1
1
vote
1
answer
4k
views
Nano displays spaces instead of some symbols
I have a feeling that I have this bug, however I've just installed new Nano 4.7 from sources
When I open files, a lot of symbols (even non-unicode) as not displayed properly, but displayed as spaces. ...
CommunityBot
- 1
0
votes
2
answers
4k
views
ls cannot display utf8 encoded file name correctly when ssh-ing to an OS X machine
The problem I'm trying to resolve here is that, in the terminal of an ssh session to an OS X machine, the output of the ls command cannot display utf8 encoded Chinese characters in file names ...
CommunityBot
- 1
11
votes
7
answers
11k
views
Why does Unicode have big or little endian but UTF-8 doesn't?
UNICODE uses 2 bytes for one character, so it has big or little endian difference. For example, the character 哈 is 54 C8 in hex.
And its UTF-8 therefore is:
11100101 10010011 10001000
UTF-8 uses 3 ...
- 1,028
2
votes
1
answer
18k
views
Default character encoding for Excel Text Wizard?
A large part of my job is to run an SQL query, save the results as a UFT-8 encoded csv file then import it into Excel for further manipulation and distribution.
When I import the csv file into Excel ...
CommunityBot
- 1
2
votes
2
answers
3k
views
FFmpeg encoding for meta data wrong – need it in UTF8
When I run this command
ffmpeg.exe -i test.mp3 -metadata title="The Title You Want" -metadata artist="ÄÄÄßß!`n Artist Name" -metadata album="Name Fö#'ddp+!of the Album" -c:a copy -id3v2_version 3 ...
CommunityBot
- 1
6
votes
4
answers
8k
views
Convert UTF-16 LE to UTF-8 in windows via command line
(question re-written to be more useful)
I have a batch script which will interact with command line programs, take their output, and then perform decisions based on that output.
One of the programs I ...
- 3,750
8
votes
4
answers
21k
views
File encoding not preserved after saving in Notepad++
I'm using Notepad++ for editing my PHP scripts.
However, I found a strange problem: when changing the encoding from ANSI to UTF-8 (without BOM), saving, closing, re-loading – then checking encoding: ...
- 177
0
votes
3
answers
4k
views
Why do some Unicode characters appear as boxes?
Some Unicode characters cannot be shown in my browser.
I generated valid Unicode (utf8) characters but many of them are unable to be displayed. If they don't have representation, then why are they ...
- 101
10
votes
3
answers
12k
views
Can I set up KiTTY to send F7 press instead of bringing up Print dialogue when F7 button is pressed?
Can I set up KiTTY to send F7 press instead of bringing up Print dialogue when I press F7?
I make intense use of Midnight Commander and its editor, which both rely on F7 (to create a directory and to ...
- 11
0
votes
0
answers
154
views
Managing utf8 CSV on Mac
I use Excel on macOS and when I try to combine CSV files downloaded from SaaS platforms, it messes things up on the first lines. I don't have this problem when using Excel with Windows.
For now, I ...
- 1
2
votes
0
answers
232
views
ffmpeg printing unknown glyph between characters on utf-8 subtitle
FFmpeg is printing unknown glyphs between some two characters but the weird thing is it's not replacing a character that doesn't exist in the font, it's just printing a new unknown glygh and I can't ...
- 1,524
0
votes
1
answer
276
views
gnome-terminal does not display UTF-8 characters correctly (zsh)
I installed zsh v5.8.1 on Ubuntu 22.04.3. And my gnome-terminal looks like so:
the symboles do not seem to be right. Whats wrong?
- 454k
14
votes
2
answers
73k
views
Which languages does the character encoding UTF-8 support?
What written and speak-able languages does UTF-8 support?
How many languages does the UTF-8 support?
- 1,478
0
votes
1
answer
269
views
cli program `less` interprets a file as binary when it is utf-8 text
I have a file that has non-ascii, UTF-8 characters in it. When I use less to view that file I get a warning saying may be a binary file. See it anyway? But the file is clearly not a binary. And when ...
- 205
0
votes
1
answer
3k
views
Locale Setting Issues on Arch Linux
I am running Arch Linux. My locale appears to be incorrectly set, but I don't know how to fix it. When I run locale, my system outputs the following:
locale: Cannot set LC_MESSAGES to default locale: ...
- 1
1
vote
1
answer
73
views
How to define command line options in my sql systemctl service
I have a mysql install on Digital ocean cloud.
And by default it's working with system ctl service.
I need to run the server with those options :
That have taken from here.
So I've tried to edit this ...
- 2,057
1
vote
1
answer
208
views
Problems with Word link to Excel when Windows is set to use UTF-8
I've some Word documents that have fields that are automatically updated from an Excel file using Words built-in links to Excel (as in copy > paste special > paste as link).
After setting up a ...
19
votes
3
answers
17k
views
Program to check/look up UTF-8/Unicode characters in string on command line?
I've just realized I have a file on my system; it lists normally:
$ ls -la TΕSТER.txt
-rw-r--r-- 1 user user 8 2013-04-11 18:07 TΕSТER.txt
$ cat TΕSТER.txt
testing
... yet, it crashes a piece of ...
CommunityBot
- 1
7
votes
3
answers
7k
views
Which (default) fonts contain the Windows/Apple logo?
I'm looking for fonts which are installed on Windows respectively Apple by default which contain either the Windows or Apple-logo .
According to this article it should be character
U+F8FF ...
- 6,799
6
votes
2
answers
8k
views
Why does Notepad++ display some Unicode characters as square?
It can display ₐ₊₋ but some other subscripts (like ₂ₙ) are converted to squares. When I copy that square and paste on here the problem disappears: ₂. Why is that? The file is encoded in UTF-8.
FYI: ...
CommunityBot
- 1
7
votes
1
answer
9k
views
Getting "Warning: Missing charsets in String to FontSet conversion"
I'm using X applications over an SSH connection to some machine. When I run an X app, say, xclock for simplicity, I get a console message saying:
Warning: Missing charsets in String to FontSet ...
- 157
2
votes
1
answer
4k
views
Stop VS Code from auto guessing encoding
I use VS Code to make a German site.
I use a German special character in a style.css file.
After restarting VS Code and changing the file encoding from UTF-8 to
Windows-1252, I get what is shown in ...
3
votes
1
answer
9k
views
My text file is riddled with question marks. How can I make it readable?
When I open one of my text files in Visual Studio Code,
the text contains a lot of question marks where I had expected to see
Swedish letters, such as å, ä, ö :
^ click to enlarge
Down to the right (...
3
votes
2
answers
3k
views
rsync "File name too long (36)" error for filenames with UTF-8 characters
Trying to copy files from an NTFS-formatted HDD to an EXT4-formatted HDD, rsync fails to copy some of them having relatively long file names consisting of Asian (UTF-8) characters.
For example, there'...
CommunityBot
- 1
8
votes
3
answers
2k
views
How to set Notepad2 to use UTF-8 instead of ANSI
Each time I create a new file in Notepad2, the encoding is ANSI (1252).
I'd like instead to have UTF-8 as default. Is there a way to get this ?
0
votes
1
answer
7k
views
MobaXterm ssh console not showing correct character in tree command
When in Linux SSH box, using MobaXterm, I enter tree command, the output is:
âââ jboss
âââ gc.log.0.current
âââ server.log
which should be:
└── jboss
├── gc.log.0.current
└── server.log
In ...
- 1,540
14
votes
2
answers
42k
views
What encoding to get Å Ä Ö to work
I'm writing a small application in VB.NET that will enable me to
easily create a user "Windows 7 account" with a password, instead of
going through the control panel.
The problem I'm having ...
9
votes
4
answers
13k
views
How to find all files in directory that contain UTF-8 BOM (byte-order mark)?
On Windows, I need to find all files in a directory that contain UTF-8 BOM (byte-order mark). Which tool can do that and how?
It can be a PowerShell script, some text editor's advanced search feature ...
- 623
2
votes
0
answers
322
views
create zip format whose AES password is UTF international letters
for reason beyond me we want to create zip format encrypted with AES-256, whose password can be International, on Linux.
If we use 7-zip, I found it works when creating 7z file, ie the following works:...
- 123
1
vote
1
answer
204
views
Function to calculate length of a string in Google Spreadsheets when the string contains certain UTF-8 characters
This function returns 6 and it's expected to return 4:
=LEN("🥎A🥎B")
What function should I use to get the "real char count" expecting that one symbol in the UTF-8 icon map is 1 ...
- 454k
0
votes
1
answer
1k
views
Windows Server 2019 and File Encoding
I have run into an issue with Windows Server 2019 with saving files as UTF-8 without a BOM.
If you create a simple file in Notepad on Windows Server 2019, and save it as .xml with UTF-8 (there is no ...
- 481k
0
votes
1
answer
113
views
How does thetext decoder knows which text encoder is used to encode?
When I create a text file on Windows operating system using Notepad and hit save, I get to choose the text encoding.
Suppose I saved this file using UTF-16 LE encoding and later sent this file to a ...
- 63.1k
0
votes
1
answer
833
views
How to download a link that contains UTF-8 coding with WGET
I use wget (Windows) to download webpages. On a site all works well but some webpages return a zero file. Here are commands i execute The first loads well with WGET, the second returns an empty file
...
- 6,295
0
votes
0
answers
2k
views
"CocoaPods requires your terminal to be using UTF-8 encoding" in SSH session from Windows to macOs
I need to run pod install on macOS 12.4 through ssh remotely from a Windows 11 machine.
To do this, I ssh into the macOS machine through cmd. However, when I run pod install in the secure shell, I get ...
- 233
1
vote
2
answers
4k
views
charset=iso-8859-2 webpage displays with UTF-8 header - question marks (�) instead of accented letters
I have a webserver administration question.
In this website: http://www.mirkaphoto.hu/
All PHP generated pages contain the following line:
<meta http-equiv="Content-Type" content="text/html; ...
- 2,325
1
vote
1
answer
4k
views
Open UTF-8 csv files by double-clicking in Excel
I want to open UTF-8 coded csv- or text-files directly in Excel 2016 or later.
Of course I am aware of the import option, but I want to do this with a simple double-click.
Problem is that this way ...
- 481k
0
votes
2
answers
805
views
How to correctly decompress a file with ANSI coding so that the output file is with UTF-8 encoding? [duplicate]
I have a .zip file which is a compressed folder and has ANSI encoding (I think, because I opened it with Notepad and it said that it has ANSI encoding). The file (folder) contains other files which ...
- 1
0
votes
1
answer
776
views
Does FTP server supports UTF-16 encoding?
I am checking my application for different encoding techniques. In one such use case related to the FTP server, I do not see anything related to UTF-16. This means I can able login to the FTP server ...
- 454k
0
votes
0
answers
278
views
UTF8 characters not displayed in browsers both Firefox and Google Chrome
I use Linux Debian and everything used to work fine.
After upgrading to the newer 'bullseye' distribution I decided to compile my own kernel. All went well and I thought everything was working until ...
- 157k
6
votes
2
answers
20k
views
Control encoding of batch-created file
I wanted to automate the creation of a directory tree file in Windows 10.
In PowerShell, I executed the following commands:
cd C:\TreeTest
tree /f > .\TreeStructure.txt
The output was a pretty ...
- 13.2k
0
votes
1
answer
792
views
Printf in gawk with the correct encoding?
I'm wondering: can gawk printf in any format besides ASCII?
Currently, I'm using gawk match() to search through some UTF-8 text. When I go ahead and print out the matches gawk finds, it ends up like ...
- 27.9k
5
votes
0
answers
18k
views
Can I enable Unicode UTF-8 WorldWide Support in WIndows 11, but set another encoding for a specific app?
generally, I like to enable UTF-8 worldwide support in Windows 11, because most of apps I use support UTF-8 and I am using Linux OS with UTF-8 at the same time.
But the problem I had so far is one of ...
- 915
2
votes
2
answers
13k
views
How can I perform an ISO-8859-1 to UTF-8 text file conversion while not changing any characters that are already valid UTF-8
Consider a text file that looks like this visually:
This’s ISO-8859-1
This’s UTF-8
Behind-the-scenes, the ’ curly quote character in the first line is encoded as ISO-8859-1, and the same ’ character ...
- 27.9k
0
votes
0
answers
492
views
when running "LC_ALL=C.UTF-8 egrep -axv '.*'" to detect non-UTF8 characters how can I determine the exact character that caused the detection?
I frequently use this command:
LC_ALL=C.UTF-8 egrep -laxv '.*' filename
this tells me if the file contains any non-UTF8 characters (actually I usually use this in conjunction with find to scan many ...
- 175
1
vote
1
answer
7k
views
Microsoft Excel UTF-8 encoding without importing
Before you tell me to search more and to look at other people's questions and their answers read my precise question.
Most other topics here deal with how to make UTF-8 the default option within the ...
0
votes
1
answer
4k
views
Simplified Chinese characters are not displayed correctly in Windows command prompt
When I enter or paste a simplified Chinese character, it is displayed weirdly. It looks like a 'p' character enclosed in a rectangle. Please see the picture attached.
But I copy the character and ...
- 481k