Questions tagged [utf-8]

For discussions about UCS Transformation Format with 8 bits (UTF8). It is an encoding table that represents all characters in the Unicode character set.

Filter by
Sorted by
Tagged with
0
votes
1answer
35 views

MobaXterm ssh console not showing correct character in tree command

When in Linux SSH box, using MobaXterm, I enter tree command, the output is: âââ jboss âââ gc.log.0.current âââ server.log which should be: └── jboss ├── gc.log.0.current └── server.log In ...
19
votes
1answer
1k views

Hyphen is not rendering in Notepad++

I'm sure this is an encoding issue, but I can't figure it out. I exported a spreadsheet from Excel as a UTF-8 CSV. This produced a CSV in the UTF-8-BOM character encoding. Opening this file in Notepad+...
0
votes
1answer
21 views

How to convert binary input into utf-16 characters on bash

I have bunch of bytes that has random bits in order and some of them 9 and 10. I can convert the 8 bit binary data into characters with a perl script like below. perl -lape '$_=pack"(B8)*",@...
0
votes
0answers
40 views

Trying to copy non-ASCII Unicode characters from a Linux VNC session into Windows programs, I can only get escape codes

I'm on Windows 8.1 running TigerVNC's vncviewer64-1.11.0. I open a connection to a remote server (CentOS 7 with XFCE, if that matters). I highlight and copy some UTF-8 text: Then I copy it from the ...
2
votes
1answer
80 views

How to get a file list as utf8 encoded string into gnuplot?

I need the file list of a directory as utf8 encoded string in gnuplot. In gnuplot you can make a system call via system(), which (to my limited understanding) just calls cmd.exe and will carry out the ...
0
votes
1answer
177 views

Converting excel files to UTF-8 .TSV

Every week I have to convert 25 or more Excel files to UTF-8 .tsv files. As of now I'm doing it using Editplus application manually. I was searching Google and other sites where I'm getting UTF-8 ....
0
votes
2answers
29 views

Which text file encoding should i use to be compatible between Windows and Linux?

If i want text file (in this case .srt subtitle file) or just plain text file with various characters including ěščřžýáíéůú (WINDOWS-1250) in general to be working well both on Windows and Linux, ...
1
vote
1answer
151 views

Clipping special characters to clipboard using command prompt

I want to place a certain useful special character to the clipboard to use it. So I did this using a simple batch script, something like this: @echo off set /p char=<character.txt echo %char%| ...
4
votes
1answer
56 views

Regexp fails to match UTF-8 characters in Notepad++

Given the following UTF-8 text in Notepad++: 🤣 1 ☺ ☺️ 2 😊 3 Both ^[^ ]+ and ^[\S]+ match only the second line. The same expressions matches all 3 lines in Visual Studio 2019. What am I missing?
0
votes
0answers
189 views

Notepad keeps defaulting (and saving!) to UTF-8 instead of ANSI, how can I get ANSI?

From what I have been reading, Notepad should use ANSI encoding by default. Well, in my case it doesn't -- it defaults to UTF-8. It is infuriating because I have tried creating a blank .txt file, ...
0
votes
0answers
11 views

Messy font issue writing Arabic letters on Spyder IDE

I have just installed new Spyder IDE but I got a new problem writing bilangual code: The code is: number = df1['تعداد'] < 1000 Is there a way solving this problem?
2
votes
0answers
45 views

Letting IMAP server know that Alpine is fine with UTF-8

I am using Alpine with a local IMAP server. For some messages, I get the following "advisory message" in Alpine: *********************************************************** ...
0
votes
0answers
20 views

Change handling of UTF-8 characters in detox

I have the following filename: wzór umowy.pdf. I want to get: wzor_umowy.pdf. However, running detox with default settings on this file gives: wzo_r_umowy.pdf (notice the underscore _ after the ...
0
votes
1answer
126 views

windows batch compare then skip utf  in first line of file

I would like list lines of file in batch and, in case of UTF file, skip "" characters in first line. @echo off setlocal EnableExtensions EnableDelayedExpansion for /f "delims=" %%a in (list.txt) ...
1
vote
1answer
37 views

How to transfer files between Windows and Linux via a cloud drive without messing up the names?

Because Windows and Linux use different encodings (I think CP-1252 and UTF-8 respectively), when I upload a file in a non-ASCII language to a cloud drive from one OS then download it in the other, the ...
1
vote
2answers
91 views

Can anyone explain this encoding-related behaviour?

Encoding is not my strong point, despite having read quite a bit. There's a file I want to edit, its extension is .tdl, but that doesn't mean anything in particular. It is an XML file. The first ...
2
votes
1answer
1k views

Getting “Warning: Missing charsets in String to FontSet conversion”

I'm using X applications over an SSH connection to some machine. When I run an X app, say, xclock for simplicity, I get a console message saying: Warning: Missing charsets in String to FontSet ...
0
votes
0answers
1k views

I am trying to convert a CSV file to ANSI format with Textedit on Mac OS High Sierra version 10.13

I have to provide CSV files with Energy Manager consumption data to an Energy Management System (EMS) and I am working on a Mac with OS High Sierra Version 10.13. I work with LibreOffice and with the ...
1
vote
0answers
33 views

Word 365 character encoding annoying

When I open some text files with Microsoft Word 365 (v2001 build 12430.20184 - 16.0.12430.20172) it asks me to choose the characters encoding. My question is: How to clean the original file to let ...
1
vote
1answer
576 views

Nano displays spaces instead of some symbols

I have a feeling that I have this bug, however I've just installed new Nano 4.7 from sources When I open files, a lot of symbols (even non-unicode) as not displayed properly, but displayed as spaces. ...
4
votes
1answer
312 views

What are these unknown symbols that show up in my HTML when using Notepad?

These characters can be found by me in Notepad when writing HTML. It absolutely causing problems for me. I can’t even delete it! So does anyone knows this symbol is or why it appears? I’ve tried to ...
0
votes
0answers
26 views

derivative of momentum p dotted symbol

I need to write the derivative of momentum in HTML with the dot notation; which is a p with a dot above. I've found the analogous symbols v̇ q̇ for v and q but not that for p.
-1
votes
1answer
213 views

Sending UTF-8 keycodes instead of UTF-16 in Windows 10

To my understanding, Windows 10 sends the keypress to the programs in UTF-16 since a while back. While I like the idea it poses a huge problem for me as I have software (Barrier) that doesn’t support ...
0
votes
0answers
524 views

Error “Invalid utf8 character string” while upgrading MySQL

I have some InnoDB databases on my local MacBook Pro. And after upgrading MySQL through brew upgrade MySQL daemon can't start now. I already fixed problems with new case insensitive mode by renaming ...
0
votes
1answer
1k views

Popular FTP clients failed to autodetect that VSFTPD serves UTF-8 file names

I run vsftpd 3.0.3 / armv7l / Debian 9.11 / Kernel 4.14.133+ Some paths have Greek characters. In file /etc/vsftpd.conf there is a line utf8_filesystem=YES but, also, this is the default behavior. ...
0
votes
0answers
85 views

Outlook doesn't recognize UTF-8 when ip address present in email content

I'm sending an email using Zend Framework 2, using layout with properly set <META content="text/html; charset=UTF-8" http-equiv=Content-Type> in <head> tag. When I put a link containing IP ...
0
votes
2answers
237 views

Special characters not recognize from Google Sheet & Microsoft Excel

I have developed a web crawler to extract some information and print them to an Excel spreadsheet. However, neither Excel nor Google Sheet recognize some special characters, see below: The text ...
0
votes
1answer
466 views

Japanese letters aren't showing correctly with UTF8

So I have these several files in Japanese text, that was meant for Japanese computers to use. I first unzipped them, to find a completely garbled unreadable text for the title of files. I went to ...
-1
votes
1answer
937 views

Use Microsoft Word to save a UTF-8 file without the BOM

I would like to use Microsoft Word (on a PC specifically) to open, edit, and then save again a plaintext file in UTF-8 format, but without adding the BOM character sequence to the beginning. Let's ...
122
votes
2answers
15k views

Is it possible to create a QR code using text?

QR codes I have seen are mostly image files. But can you create QR codes using plain text? For example ASCII and UTF-8 have black boxes as characters. Can I use those together with spaces to create a ...
2
votes
1answer
35 views

Character set reverse search

I have a set of strings (well, filenames, but that detail I can handle myself) that I want to convert to UTF-8. However, by trying the obvious candidates I'm not able to do the conversion successfully,...
4
votes
2answers
8k views

Control encoding of batch-created file

I wanted to automate the creation of a directory tree file in Windows 10. In PowerShell, I executed the following commands: cd C:\TreeTest tree /f > .\TreeStructure.txt The output was a pretty ...
1
vote
1answer
1k views

Is it safe (no data loss) to convert ANSI to UTF-8 and then back to ANSI?

Is it safe (no data loss) to convert ANSI to UTF-8 and then back to ANSI? I have read that you can lose data going from UTF-8 to ANSI. But if the file was changed from ANSI to UTF-8 (and not changed ...
1
vote
2answers
1k views

“character encoding hell”- Configuring mariadb for utf8 end to end

Mariadb: "mysql Ver 15.1 Distrib 10.3.8-MariaDB" OS: Windows 10 64 bit I've been wrestling with getting a csv data file that contains "high 8 bit" characters such as the micron character and em dash ...
0
votes
2answers
138 views

Really weird “UTF-8” code

I downloaded a database from imdb in the form of a tsv.gz (csv) file. Imdb said that the file was in UTF-8 (https://www.imdb.com/interfaces/?ref_=login), but when I looked at the file in NotePad and ...
0
votes
0answers
24 views

Mac OS dictionary app shows some Hangul characters as blanks

This screenshot shows what happens when I look up the Korean dictionary inside my Mac OS's default Dictionary app. Apparently some characters are missing and are substituted by empty squares. Moreover,...
1
vote
1answer
85 views

What's the differences between different types of utf-8?

There is a problem with skype on linux. If I change my locale setting to en_US.utf-8, Chinese characters are poorly rendered (some are bold, some are not). If I change my locale setting to zh_CN.utf-...
4
votes
2answers
1k views

Should a use utf-8 or “utf-8” as a charset value in an email header?

When sending an email to an Outlook.com with forwarding turned on, I find that the forwarded mail is rejected. On examining the sent mail and the mail sitting in Outlook's inbox. I find that ...
1
vote
0answers
227 views

How can I reload an Excel spreadsheet using a different encoding?

Someone shared an Excel file with me (.xlsx, not .csv). Looking at the data in Excel it's obvious that the file is encoded using UTF-8, but Excel is interpreting the data as Windows 1252 encoded text. ...
1
vote
2answers
1k views

Outlook exporting emails as .csv - Encoding

I'm trying to export my emails as .csv files through Outlook 365 on Windows 10: File -> Open & export -> Import/Export -> Export to a file -> Comma Separated Values -> Select the inbox -> some ...
0
votes
1answer
858 views

How to change the property “default_encoding” of Sublime Text(Version 3.1.1, Build 3176) from “UTF-8” to “ISO-8859-1”?

I'm a PHP Developer by profession. I'm using Windows 10 Home Single Language 64-bit Operating System on my laptop. I've installed Sublime Text(Version 3.1.1, Build 3176) on my machine. I checked ...
0
votes
0answers
55 views

Changing .csv file from UTF-16 to UTF-8 deletes file data

I tried changing character set of .csv file from UTF-16 to UTF-8 using the unix command iconv -f utf-16le -t UTF-8//TRANSLIT <input file> -o <output file> After running word count ...
0
votes
0answers
24 views

How to be sure that a script saved with ANSI is going to work on every client environment?

Long story short. How can I fix users environments, to make them run our scripts using ANSI encode? The problem is, we send them scripts to run on their databases using ANSI encode. But some of ...
2
votes
2answers
3k views

LC_ALL=C is set, no idea why

I‘m using st, the simple-terminal or suckless-terminal, which is a terminal with Unicode-support. I have two machines, both run Arch Linux with basically the same system settings but i only get ...
0
votes
1answer
415 views

How to avoid Sed changing the file format?

I was trying to use a sed file to preprocess a file, but the output from sed seems to change the format. How should I avoid it? file A.txt A.txt UTF-8 Unicode English text, with very long lines sed ...
0
votes
0answers
126 views

In putty UTF-8 character edit is not working?

I am using putty (version .70) and character set type UTF-8 is enabled. Running C program in CentOS machine also an environmental variable $LANG is set as en_GB.UTF-8. I am getting the user input(...
1
vote
0answers
2k views

Return value in powershell script stored in string not utf8

I'm trying to extract tables out of a pdf using tabula and powershell. When I enter the command directly in the powershell console, I get the expected result displayed (in utf8 with umlaut-symbols) ...
2
votes
1answer
1k views

How to convert this string to Japanese using GNU/Linux tools?

Here is a string from a text file: @™TdaŽ®Æ‚êƒ~ƒNƒXƒgƒŒ[ƒgEƒrƒLƒjver1.11d1.d2iƒrƒLƒjƒ‚ƒfƒ‹ver.1.1³Ž®”z•z”Åj It includes many nonprinting characters and is copied here: https://pastebin.com/...
0
votes
0answers
2k views

Using .bat to convert ANSI to UTF-8 in windows [duplicate]

So, I have o convert a .csv file from ANSI encoding to UTF-8 in windows, using a .bat file. Basically a program capable of doing this conversion without needing Notepad++ nor excel and etc. Do you ...
0
votes
1answer
147 views

Symbols are lost after conversion from UTF-8 to ISO8859-1 and back to UTF-8

I have a file with properties in French. I would like to convert it to ISO8859-1. But after conversion, some symbols are lost. What is wrong? > cat fr.properties VAR2="élément n’a" > cat fr....

1
2 3 4 5