Questions tagged [utf-8]

For discussions about UCS Transformation Format with 8 bits (UTF8). It is an encoding table that represents all characters in the Unicode character set.

Filter by
Sorted by
Tagged with
1
vote
0answers
12 views

Word 365 character encoding annoying

When I open some text files with Microsoft Word 365 (v2001 build 12430.20184 - 16.0.12430.20172) it asks me to choose the characters encoding. My question is: How to clean the original file to let ...
0
votes
1answer
18 views

Nano displays spaces instead of some symbols

I have a feeling that I have this bug, however I've just installed new Nano 4.7 from sources When I open files, a lot of symbols (even non-unicode) as not displayed properly, but displayed as spaces. ...
3
votes
1answer
167 views

What are these unknown symbols that show up in my HTML when using Notepad?

These characters can be found by me in Notepad when writing HTML. It absolutely causing problems for me. I can’t even delete it! So does anyone knows this symbol is or why it appears? I’ve tried to ...
0
votes
0answers
18 views

Notepad or Excel altering accented character

I use Excel to construct a plain text file, I copy a bunch of concatenates into notepad, and the Encoding is set to UTF-8, a record on that file uses an accented e, é Opening this plain text file in ...
0
votes
0answers
21 views

derivative of momentum p dotted symbol

I need to write the derivative of momentum in HTML with the dot notation; which is a p with a dot above. I've found the analogous symbols v̇ q̇ for v and q but not that for p.
-1
votes
1answer
57 views

Sending UTF-8 keycodes instead of UTF-16 in Windows 10

To my understanding, Windows 10 sends the keypress to the programs in UTF-16 since a while back. While I like the idea it poses a huge problem for me as I have software (Barrier) that doesn’t support ...
0
votes
0answers
51 views

Error “Invalid utf8 character string” while upgrading MySQL

I have some InnoDB databases on my local MacBook Pro. And after upgrading MySQL through brew upgrade MySQL daemon can't start now. I already fixed problems with new case insensitive mode by renaming ...
0
votes
1answer
315 views

Popular FTP clients failed to autodetect that VSFTPD serves UTF-8 file names

I run vsftpd 3.0.3 / armv7l / Debian 9.11 / Kernel 4.14.133+ Some paths have Greek characters. In file /etc/vsftpd.conf there is a line utf8_filesystem=YES but, also, this is the default behavior. ...
0
votes
0answers
69 views

Not readable greek characters when converting xlsx to csv

My system: I run a fresh Windows 10 Pro N x64 installation on my pc, with MS-Office 2013 Professional Plus 2013 version. What I want to do: I have some huge .xlsx files with greek text characters ...
0
votes
0answers
18 views

Outlook doesn't recognize UTF-8 when ip address present in email content

I'm sending an email using Zend Framework 2, using layout with properly set <META content="text/html; charset=UTF-8" http-equiv=Content-Type> in <head> tag. When I put a link containing IP ...
0
votes
0answers
28 views

PhpMyAdmin 4.9.0.1 export MySQL Database latin1_swedish_ci and reimport as UTF-8

I have to update a quite old CMS-system to a new one on an other webspace. This means also a new database. The original database can't be modified, because at the moment the CMS is in use. There is ...
0
votes
2answers
56 views

Special characters not recognize from Google Sheet & Microsoft Excel

I have developed a web crawler to extract some information and print them to an Excel spreadsheet. However, neither Excel nor Google Sheet recognize some special characters, see below: The text ...
0
votes
0answers
43 views

How to convert multiple UTF-8 files to ANSI format?

I really don't know much about computer, but in order to use another converter I need my files to not contain any UTF-8 character, I thought this PowerShell command did the job: foreach($i in ls -...
0
votes
0answers
53 views

mysqldump from Windows to Linux, text encoding gone wrong

On Windows 10 I had a localhost web app on Wampserver (apache2 / PHP / MySQL). The database collation was set to utf8_general_ci, and all the pages have charset=utf-8 in the header. I decided to ...
0
votes
1answer
121 views

Japanese letters aren't showing correctly with UTF8

So I have these several files in Japanese text, that was meant for Japanese computers to use. I first unzipped them, to find a completely garbled unreadable text for the title of files. I went to ...
-1
votes
1answer
432 views

Use Microsoft Word to save a UTF-8 file without the BOM

I would like to use Microsoft Word (on a PC specifically) to open, edit, and then save again a plaintext file in UTF-8 format, but without adding the BOM character sequence to the beginning. Let's ...
0
votes
0answers
11 views

Teradata Export to UTF has Missing Records

I am using Teradata to query against a DB2 database. The query reports approximately 1 million records. I am exporting the results to a UTF file which is on a network drive. The query finishes ...
115
votes
1answer
12k views

Is it possible to create a QR code using text?

QR codes I have seen are mostly image files. But can you create QR codes using plain text? For example ASCII and UTF-8 have black boxes as characters. Can I use those together with spaces to create a ...
2
votes
1answer
30 views

Character set reverse search

I have a set of strings (well, filenames, but that detail I can handle myself) that I want to convert to UTF-8. However, by trying the obvious candidates I'm not able to do the conversion successfully,...
3
votes
2answers
3k views

Control encoding of batch-created file

I wanted to automate the creation of a directory tree file in Windows 10. In PowerShell, I executed the following commands: cd C:\TreeTest tree /f > .\TreeStructure.txt The output was a pretty ...
1
vote
1answer
521 views

Is it safe (no data loss) to convert ANSI to UTF-8 and then back to ANSI?

Is it safe (no data loss) to convert ANSI to UTF-8 and then back to ANSI? I have read that you can lose data going from UTF-8 to ANSI. But if the file was changed from ANSI to UTF-8 (and not changed ...
1
vote
2answers
732 views

“character encoding hell”- Configuring mariadb for utf8 end to end

Mariadb: "mysql Ver 15.1 Distrib 10.3.8-MariaDB" OS: Windows 10 64 bit I've been wrestling with getting a csv data file that contains "high 8 bit" characters such as the micron character and em dash ...
0
votes
2answers
70 views

Really weird “UTF-8” code

I downloaded a database from imdb in the form of a tsv.gz (csv) file. Imdb said that the file was in UTF-8 (https://www.imdb.com/interfaces/?ref_=login), but when I looked at the file in NotePad and ...
0
votes
0answers
22 views

Mac OS dictionary app shows some Hangul characters as blanks

This screenshot shows what happens when I look up the Korean dictionary inside my Mac OS's default Dictionary app. Apparently some characters are missing and are substituted by empty squares. Moreover,...
1
vote
1answer
52 views

What's the differences between different types of utf-8?

There is a problem with skype on linux. If I change my locale setting to en_US.utf-8, Chinese characters are poorly rendered (some are bold, some are not). If I change my locale setting to zh_CN.utf-...
4
votes
2answers
439 views

Should a use utf-8 or “utf-8” as a charset value in an email header?

When sending an email to an Outlook.com with forwarding turned on, I find that the forwarded mail is rejected. On examining the sent mail and the mail sitting in Outlook's inbox. I find that ...
1
vote
0answers
179 views

How can I reload an Excel spreadsheet using a different encoding?

Someone shared an Excel file with me (.xlsx, not .csv). Looking at the data in Excel it's obvious that the file is encoded using UTF-8, but Excel is interpreting the data as Windows 1252 encoded text. ...
1
vote
2answers
639 views

Outlook exporting emails as .csv - Encoding

I'm trying to export my emails as .csv files through Outlook 365 on Windows 10: File -> Open & export -> Import/Export -> Export to a file -> Comma Separated Values -> Select the inbox -> some ...
0
votes
1answer
387 views

How to change the property “default_encoding” of Sublime Text(Version 3.1.1, Build 3176) from “UTF-8” to “ISO-8859-1”?

I'm a PHP Developer by profession. I'm using Windows 10 Home Single Language 64-bit Operating System on my laptop. I've installed Sublime Text(Version 3.1.1, Build 3176) on my machine. I checked ...
0
votes
0answers
50 views

Changing .csv file from UTF-16 to UTF-8 deletes file data

I tried changing character set of .csv file from UTF-16 to UTF-8 using the unix command iconv -f utf-16le -t UTF-8//TRANSLIT <input file> -o <output file> After running word count ...
0
votes
0answers
24 views

How to be sure that a script saved with ANSI is going to work on every client environment?

Long story short. How can I fix users environments, to make them run our scripts using ANSI encode? The problem is, we send them scripts to run on their databases using ANSI encode. But some of ...
1
vote
2answers
2k views

LC_ALL=C is set, no idea why

I‘m using st, the simple-terminal or suckless-terminal, which is a terminal with Unicode-support. I have two machines, both run Arch Linux with basically the same system settings but i only get ...
0
votes
1answer
216 views

How to avoid Sed changing the file format?

I was trying to use a sed file to preprocess a file, but the output from sed seems to change the format. How should I avoid it? file A.txt A.txt UTF-8 Unicode English text, with very long lines sed ...
0
votes
0answers
823 views

CSV file Question marks everywhere [duplicate]

I have a really big problem with data file (I'll use another smaller file for example below) I did some excel work in CSV file and Saved it when I opened Georgian language characters were changed to ...
0
votes
0answers
121 views

In putty UTF-8 character edit is not working?

I am using putty (version .70) and character set type UTF-8 is enabled. Running C program in CentOS machine also an environmental variable $LANG is set as en_GB.UTF-8. I am getting the user input(...
1
vote
0answers
1k views

Return value in powershell script stored in string not utf8

I'm trying to extract tables out of a pdf using tabula and powershell. When I enter the command directly in the powershell console, I get the expected result displayed (in utf8 with umlaut-symbols) ...
2
votes
1answer
596 views

How to convert this string to Japanese using GNU/Linux tools?

Here is a string from a text file: @™TdaŽ®Æ‚êƒ~ƒNƒXƒgƒŒ[ƒgEƒrƒLƒjver1.11d1.d2iƒrƒLƒjƒ‚ƒfƒ‹ver.1.1³Ž®”z•z”Åj It includes many nonprinting characters and is copied here: https://pastebin.com/...
0
votes
0answers
1k views

Using .bat to convert ANSI to UTF-8 in windows [duplicate]

So, I have o convert a .csv file from ANSI encoding to UTF-8 in windows, using a .bat file. Basically a program capable of doing this conversion without needing Notepad++ nor excel and etc. Do you ...
0
votes
1answer
103 views

Symbols are lost after conversion from UTF-8 to ISO8859-1 and back to UTF-8

I have a file with properties in French. I would like to convert it to ISO8859-1. But after conversion, some symbols are lost. What is wrong? > cat fr.properties VAR2="élément n’a" > cat fr....
1
vote
1answer
1k views

Opening UTF-8 file with UTF-16 encoding in gedit results in readable Chinese

I know this isn't really a problem, but I was really curious why this is happening. How to reproduce this phenomenon Open gedit and type something in (I used Lorem Ipsum text from lipsum.com). Save ...
1
vote
0answers
530 views

How to mount nfs with utf8 support on ubuntu?

In short, I have two ubuntu 16.04 servers. Both of them are using en_US.utf-8. Now I follow this tutorial to mount a nfs from one server to another. I have done it successfully, but there is a problem ...
0
votes
0answers
463 views

How to print a Unicode text file by command prompt

I have a problem with printing a text file from windows command prompt to network printers. Everything works fine when my file just contains ASCII characters, but Unicode characters appear as question ...
1
vote
2answers
569 views

How to use imageMagick on Chinese Text to Image Handling

I try to use ImageMagick to handle a Chinese character to a image on my MacBook. According to ImageMagick's guide Unicode or UTF8 Format Text, I tried two ways. Code one: convert -background ...
1
vote
1answer
5k views

Make WordPad properly open a UTF-8 or UTF-16 encoded file

When I try to open a file that has UTF-8 encoding, I get some junk characters. I don't see anywhere in the open dialog to specify the encoding for the file. I have seen various answers which talk ...
3
votes
1answer
4k views

Why does Notepad++ display some Unicode characters as square?

It can display ₐ₊₋ but some other subscripts (like ₂ₙ) are converted to squares. When I copy that square and paste on here the problem disappears: ₂. Why is that? The file is encoded in UTF-8. FYI: ...
1
vote
1answer
2k views

How to remove all emojis from excel

I have an excel sheet that I want to export to MySQL using the "MySQL for Excel" feature. However I'm having trouble getting that to work because some of the cells have emojis such as 😃 in it. And so ...
0
votes
0answers
158 views

character encoding - importing HTML into Microsoft Excel

I exported my Google Chrome (browser) bookmarks as an HTML file and then imported that file into Microsoft Excel. After importing, the text looks bad in Excel. E.g., the word "don't" in the HTML ...
1
vote
1answer
7k views

Detect Character encoding of unknown characters in Notepad++, and find/replace

I have a CSV file in which I can see the following excerpt: I found these "black" characters by scrolling through the file. The file is huge(32 Mb). I am not sure what encoding the file is in; At the ...
0
votes
1answer
2k views

Microsoft Excel UTF-8 encoding without importing

Before you tell me to search more and to look at other people's questions and their answers read my precise question. Most other topics here deal with how to make UTF-8 the default option within the ...
3
votes
0answers
86 views

How to copy a link in Firefox with a plain text decoded format to past it in Notepad [duplicate]

Every time I try to copy a link location in Firefox and then past it in Notepad I get the encoded web adresses with numbers instead of characters, I searched a little for this problem, people seems ...

1 2 3 4 5