Questions tagged [utf-8]

For discussions about UCS Transformation Format with 8 bits (UTF8). It is an encoding table that represents all characters in the Unicode character set.

Filter by
Sorted by
Tagged with
0 votes
2 answers
30 views

How to correctly decompress a file with ANSI coding so that the output file is with UTF-8 encoding? [duplicate]

I have a .zip file which is a compressed folder and has ANSI encoding (I think, because I opened it with Notepad and it said that it has ANSI encoding). The file (folder) contains other files which ...
user avatar
0 votes
0 answers
40 views

Locale Setting Issues on Arch Linux

I am running Arch Linux. My locale appears to be incorrectly set, but I don't know how to fix it. When I run locale, my system outputs the following: locale: Cannot set LC_MESSAGES to default locale: ...
user avatar
  • 1
0 votes
1 answer
47 views

Does FTP server supports UTF-16 encoding?

I am checking my application for different encoding techniques. In one such use case related to the FTP server, I do not see anything related to UTF-16. This means I can able login to the FTP server ...
user avatar
0 votes
0 answers
44 views

Cannot unrar (shell) files witch special character ( utf-8 ) in gnu/linux (fedora)

I got a problem. I cannot either open or extract correctly files from a .rar (multiple part) file via command line. Some files cannot be extracted because of their utf-x names. i got a directory with ...
user avatar
0 votes
0 answers
22 views

UTF8 characters not displayed in browsers both Firefox and Google Chrome

I use Linux Debian and everything used to work fine. After upgrading to the newer 'bullseye' distribution I decided to compile my own kernel. All went well and I thought everything was working until ...
user avatar
0 votes
0 answers
393 views

Can I enable Unicode UTF-8 WorldWide Support in WIndows 11, but set another encoding for a specific app?

generally, I like to enable UTF-8 worldwide support in Windows 11, because most of apps I use support UTF-8 and I am using Linux OS with UTF-8 at the same time. But the problem I had so far is one of ...
user avatar
  • 335
0 votes
0 answers
36 views

when running "LC_ALL=C.UTF-8 egrep -axv '.*'" to detect non-UTF8 characters how can I determine the exact character that caused the detection?

I frequently use this command: LC_ALL=C.UTF-8 egrep -laxv '.*' filename this tells me if the file contains any non-UTF8 characters (actually I usually use this in conjunction with find to scan many ...
user avatar
1 vote
1 answer
398 views

Open UTF-8 csv files by double-clicking in Excel

I want to open UTF-8 coded csv- or text-files directly in Excel 2016 or later. Of course I am aware of the import option, but I want to do this with a simple double-click. Problem is that this way ...
user avatar
0 votes
1 answer
341 views

Simplified Chinese characters are not displayed correctly in Windows command prompt

When I enter or paste a simplified Chinese character, it is displayed weirdly. It looks like a 'p' character enclosed in a rectangle. Please see the picture attached. But I copy the character and ...
user avatar
  • 1,658
0 votes
1 answer
82 views

How to convert this file into PNG

I have a file with no extension (as far as I can tell) that consists of special symbols. (File: https://drive.google.com/file/d/1h9MuUDfDtGEneEzZMNKLKWwY7JjZlBTS/view?usp=sharing) Here're a couple of ...
user avatar
0 votes
0 answers
102 views

Difference between Windows 10 'findstr' and 'Windows Search' regarding Unicode files

There seems to be a difference between two search tools in Windows 10. Specifically, the 'findstr' command can find text content encoded in UTF-8 and UTF-8 BOM, while 'Windows Search' can only find ...
user avatar
1 vote
0 answers
91 views

Outlook password encoding for email services (IMAP, SMTP)

I’m trying to make sense of how different mail clients log onto IMAP and SMTP services. There are the normal ones and then there is Outlook. Outlook seems to unconditionally encode passwords as Latin-...
user avatar
  • 195
1 vote
0 answers
31 views

Bash how to printf UTF-8 [duplicate]

Here is a small script to reproduce the default: printf "|%-32s|\n" "Here, winter and there, summer" printf "|%-32s|\n" "Ici, l'hiver et la, l'ete" printf "...
user avatar
  • 194
0 votes
0 answers
23 views

How do I activate the Unicode Edit Hebrew Alphabet

I want to activate the Unicode Edit ALphabet as in the second snippet also in Notepad as in the first snippet. How do I do that ? https://i.stack.imgur.com/gCsE9.jpg https://i.stack.imgur.com/9SAs7....
user avatar
0 votes
1 answer
58 views

Printf in gawk with the correct encoding?

I'm wondering: can gawk printf in any format besides ASCII? Currently, I'm using gawk match() to search through some UTF-8 text. When I go ahead and print out the matches gawk finds, it ends up like ...
user avatar
  • 1
2 votes
2 answers
1k views

How can I perform an ISO-8859-1 to UTF-8 text file conversion while not changing any characters that are already valid UTF-8

Consider a text file that looks like this visually: This’s ISO-8859-1 This’s UTF-8 Behind-the-scenes, the ’ curly quote character in the first line is encoded as ISO-8859-1, and the same ’ character ...
user avatar
0 votes
0 answers
42 views

how can I set alpine folders to utf-8, not ascii?

I typed the following into a new message and then hit ctrl-o to postpone. From inside alpine, the message looks like this: test superuser este sábado estaría bien When I export the postponed message ...
user avatar
0 votes
0 answers
39 views

How to use Crunch with utf-8 encoding character?

I use crunch to make passlist or wordlist. But if I type an Arabic character on CMD in Windows 10 I get characters like a question mark! How to create passlist with utf8 characters?
user avatar
2 votes
0 answers
259 views

Downloding files via SFTP on MobaXterm gets stuck when filenames are in Hebrew

When I try to download files whose names Hebrew characters, the download gets stuck and shows an error: Error EInOutError: I/O error 123 How do I fix this? I don't want to use another FTP client, I ...
user avatar
  • 914
0 votes
0 answers
45 views

Unicode Error when trying to use Command Prompt with USB Flash drive or SD Card

I have problems when trying to use unicode characters like Russian characters (Cyrillic) on the Command Prompt (CMD). This problem only happens when I am on USB Flash drive or SD Card, which use FAT32....
user avatar
2 votes
0 answers
269 views

Loading UTF8 CSV files generated on a Mac into Excel on Windows: does not recognize encoding

When I generate a UTF8 CSV file in Excel (or some other way) on Windows and then open it n Excel, I expect it to ask me to choose the right encoding. I got a UTF8 CSV file that was generated on a Mac. ...
user avatar
  • 363
6 votes
6 answers
5k views

Why does Unicode have big or little endian but UTF-8 doesn't?

UNICODE uses 2 bytes for one character, so it has big or little endian difference. For example, the character 哈 is 54 C8 in hex. And its UTF-8 therefore is: 11100101 10010011 10001000 UTF-8 uses 3 ...
user avatar
  • 2,566
0 votes
1 answer
1k views

MobaXterm ssh console not showing correct character in tree command

When in Linux SSH box, using MobaXterm, I enter tree command, the output is: âââ jboss âââ gc.log.0.current âââ server.log which should be: └── jboss ├── gc.log.0.current └── server.log In ...
user avatar
  • 1
19 votes
1 answer
1k views

Hyphen is not rendering in Notepad++

I'm sure this is an encoding issue, but I can't figure it out. I exported a spreadsheet from Excel as a UTF-8 CSV. This produced a CSV in the UTF-8-BOM character encoding. Opening this file in Notepad+...
user avatar
0 votes
1 answer
214 views

How to convert binary input into utf-16 characters on bash

I have bunch of bytes that has random bits in order and some of them 9 and 10. I can convert the 8 bit binary data into characters with a perl script like below. perl -lape '$_=pack"(B8)*",@...
user avatar
2 votes
1 answer
150 views

How to get a file list as utf8 encoded string into gnuplot?

I need the file list of a directory as utf8 encoded string in gnuplot. In gnuplot you can make a system call via system(), which (to my limited understanding) just calls cmd.exe and will carry out the ...
user avatar
  • 155
2 votes
1 answer
875 views

Converting excel files to UTF-8 .TSV

Every week I have to convert 25 or more Excel files to UTF-8 .tsv files. As of now I'm doing it using Editplus application manually. I was searching Google and other sites where I'm getting UTF-8 ....
user avatar
  • 151
0 votes
2 answers
293 views

Which text file encoding should i use to be compatible between Windows and Linux?

If i want text file (in this case .srt subtitle file) or just plain text file with various characters including ěščřžýáíéůú (WINDOWS-1250) in general to be working well both on Windows and Linux, ...
user avatar
  • 433
2 votes
1 answer
523 views

Clipping special characters to clipboard using command prompt

I want to place a certain useful special character to the clipboard to use it. So I did this using a simple batch script, something like this: @echo off set /p char=<character.txt echo %char%| ...
user avatar
4 votes
1 answer
185 views

Regexp fails to match UTF-8 characters in Notepad++

Given the following UTF-8 text in Notepad++: 🤣 1 ☺ ☺️ 2 😊 3 Both ^[^ ]+ and ^[\S]+ match only the second line. The same expressions matches all 3 lines in Visual Studio 2019. What am I missing?
user avatar
  • 537
2 votes
0 answers
108 views

Letting IMAP server know that Alpine is fine with UTF-8

I am using Alpine with a local IMAP server. For some messages, I get the following "advisory message" in Alpine: *********************************************************** ...
user avatar
  • 213
0 votes
1 answer
237 views

windows batch compare then skip utf  in first line of file

I would like list lines of file in batch and, in case of UTF file, skip "" characters in first line. @echo off setlocal EnableExtensions EnableDelayedExpansion for /f "delims=" %%a in (list.txt) ...
user avatar
1 vote
1 answer
58 views

How to transfer files between Windows and Linux via a cloud drive without messing up the names?

Because Windows and Linux use different encodings (I think CP-1252 and UTF-8 respectively), when I upload a file in a non-ASCII language to a cloud drive from one OS then download it in the other, the ...
user avatar
  • 325
1 vote
2 answers
339 views

Can anyone explain this encoding-related behaviour?

Encoding is not my strong point, despite having read quite a bit. There's a file I want to edit, its extension is .tdl, but that doesn't mean anything in particular. It is an XML file. The first ...
user avatar
4 votes
1 answer
3k views

Getting "Warning: Missing charsets in String to FontSet conversion"

I'm using X applications over an SSH connection to some machine. When I run an X app, say, xclock for simplicity, I get a console message saying: Warning: Missing charsets in String to FontSet ...
user avatar
  • 7,412
0 votes
0 answers
2k views

I am trying to convert a CSV file to ANSI format with Textedit on Mac OS High Sierra version 10.13

I have to provide CSV files with Energy Manager consumption data to an Energy Management System (EMS) and I am working on a Mac with OS High Sierra Version 10.13. I work with LibreOffice and with the ...
user avatar
1 vote
0 answers
42 views

Word 365 character encoding annoying

When I open some text files with Microsoft Word 365 (v2001 build 12430.20184 - 16.0.12430.20172) it asks me to choose the characters encoding. My question is: How to clean the original file to let ...
user avatar
1 vote
1 answer
2k views

Nano displays spaces instead of some symbols

I have a feeling that I have this bug, however I've just installed new Nano 4.7 from sources When I open files, a lot of symbols (even non-unicode) as not displayed properly, but displayed as spaces. ...
user avatar
4 votes
1 answer
558 views

What are these unknown symbols that show up in my HTML when using Notepad?

These characters can be found by me in Notepad when writing HTML. It absolutely causing problems for me. I can’t even delete it! So does anyone knows this symbol is or why it appears? I’ve tried to ...
user avatar
  • 531
0 votes
0 answers
30 views

derivative of momentum p dotted symbol

I need to write the derivative of momentum in HTML with the dot notation; which is a p with a dot above. I've found the analogous symbols v̇ q̇ for v and q but not that for p.
user avatar
0 votes
1 answer
315 views

Sending UTF-8 keycodes instead of UTF-16 in Windows 10

To my understanding, Windows 10 sends the keypress to the programs in UTF-16 since a while back. While I like the idea it poses a huge problem for me as I have software (Barrier) that doesn’t support ...
user avatar
  • 334
0 votes
0 answers
816 views

Error "Invalid utf8 character string" while upgrading MySQL

I have some InnoDB databases on my local MacBook Pro. And after upgrading MySQL through brew upgrade MySQL daemon can't start now. I already fixed problems with new case insensitive mode by renaming ...
user avatar
1 vote
1 answer
2k views

Popular FTP clients failed to autodetect that VSFTPD serves UTF-8 file names

I run vsftpd 3.0.3 / armv7l / Debian 9.11 / Kernel 4.14.133+ Some paths have Greek characters. In file /etc/vsftpd.conf there is a line utf8_filesystem=YES but, also, this is the default behavior. ...
user avatar
  • 147
0 votes
0 answers
231 views

Outlook doesn't recognize UTF-8 when ip address present in email content

I'm sending an email using Zend Framework 2, using layout with properly set <META content="text/html; charset=UTF-8" http-equiv=Content-Type> in <head> tag. When I put a link containing IP ...
user avatar
0 votes
2 answers
398 views

Special characters not recognize from Google Sheet & Microsoft Excel

I have developed a web crawler to extract some information and print them to an Excel spreadsheet. However, neither Excel nor Google Sheet recognize some special characters, see below: The text ...
user avatar
0 votes
1 answer
852 views

Japanese letters aren't showing correctly with UTF8

So I have these several files in Japanese text, that was meant for Japanese computers to use. I first unzipped them, to find a completely garbled unreadable text for the title of files. I went to ...
user avatar
-1 votes
1 answer
1k views

Use Microsoft Word to save a UTF-8 file without the BOM

I would like to use Microsoft Word (on a PC specifically) to open, edit, and then save again a plaintext file in UTF-8 format, but without adding the BOM character sequence to the beginning. Let's ...
user avatar
  • 253
125 votes
2 answers
20k views

Is it possible to create a QR code using text?

QR codes I have seen are mostly image files. But can you create QR codes using plain text? For example ASCII and UTF-8 have black boxes as characters. Can I use those together with spaces to create a ...
user avatar
  • 1,115
2 votes
1 answer
48 views

Character set reverse search

I have a set of strings (well, filenames, but that detail I can handle myself) that I want to convert to UTF-8. However, by trying the obvious candidates I'm not able to do the conversion successfully,...
user avatar
  • 997
5 votes
2 answers
13k views

Control encoding of batch-created file

I wanted to automate the creation of a directory tree file in Windows 10. In PowerShell, I executed the following commands: cd C:\TreeTest tree /f > .\TreeStructure.txt The output was a pretty ...
user avatar

1
2 3 4 5 6