Questions tagged [utf-8]
For discussions about UCS Transformation Format with 8 bits (UTF8). It is an encoding table that represents all characters in the Unicode character set.
270
questions
0
votes
0
answers
55
views
derivative of momentum p dotted symbol
I need to write the derivative of momentum in HTML with the dot notation;
which is a p with a dot above. I've found the analogous symbols v̇ q̇ for v and q but not that for p.
0
votes
1
answer
615
views
Sending UTF-8 keycodes instead of UTF-16 in Windows 10
To my understanding, Windows 10 sends the keypress to the programs in UTF-16 since a while back. While I like the idea it poses a huge problem for me as I have software (Barrier) that doesn’t support ...
- 344
0
votes
0
answers
2k
views
Error "Invalid utf8 character string" while upgrading MySQL
I have some InnoDB databases on my local MacBook Pro. And after upgrading MySQL through brew upgrade MySQL daemon can't start now.
I already fixed problems with new case insensitive mode by renaming ...
2
votes
2
answers
4k
views
Popular FTP clients failed to autodetect that VSFTPD serves UTF-8 file names
I run vsftpd 3.0.3 / armv7l / Debian 9.11 / Kernel 4.14.133+
Some paths have Greek characters.
In file /etc/vsftpd.conf there is a line utf8_filesystem=YES but, also, this is the default behavior.
...
- 207
0
votes
0
answers
491
views
Outlook doesn't recognize UTF-8 when ip address present in email content
I'm sending an email using Zend Framework 2, using layout with properly set <META content="text/html; charset=UTF-8" http-equiv=Content-Type> in <head> tag.
When I put a link containing IP ...
0
votes
2
answers
917
views
Special characters not recognize from Google Sheet & Microsoft Excel
I have developed a web crawler to extract some information and print them to an Excel spreadsheet.
However, neither Excel nor Google Sheet recognize some special characters, see below:
The text ...
- 1
0
votes
1
answer
3k
views
Japanese letters aren't showing correctly with UTF8
So I have these several files in Japanese text, that was meant for Japanese computers to use. I first unzipped them, to find a completely garbled unreadable text for the title of files. I went to ...
- 49
-1
votes
1
answer
2k
views
Use Microsoft Word to save a UTF-8 file without the BOM
I would like to use Microsoft Word (on a PC specifically) to open, edit, and then save again a plaintext file in UTF-8 format, but without adding the BOM character sequence to the beginning.
Let's ...
- 265
129
votes
2
answers
27k
views
Is it possible to create a QR code using text?
QR codes I have seen are mostly image files. But can you create QR codes using plain text?
For example ASCII and UTF-8 have black boxes as characters. Can I use those together with spaces to create a ...
- 1,155
2
votes
1
answer
4k
views
Stop VS Code from auto guessing encoding
I use VS Code to make a German site.
I use a German special character in a style.css file.
After restarting VS Code and changing the file encoding from UTF-8 to
Windows-1252, I get what is shown in ...
2
votes
1
answer
139
views
Character set reverse search
I have a set of strings (well, filenames, but that detail I can handle myself) that I want to convert to UTF-8. However, by trying the obvious candidates I'm not able to do the conversion successfully,...
- 1,007
6
votes
2
answers
20k
views
Control encoding of batch-created file
I wanted to automate the creation of a directory tree file in Windows 10.
In PowerShell, I executed the following commands:
cd C:\TreeTest
tree /f > .\TreeStructure.txt
The output was a pretty ...
- 63
1
vote
1
answer
3k
views
Is it safe (no data loss) to convert ANSI to UTF-8 and then back to ANSI?
Is it safe (no data loss) to convert ANSI to UTF-8 and then back to ANSI?
I have read that you can lose data going from UTF-8 to ANSI.
But if the file was changed from ANSI to UTF-8 (and not changed ...
- 13
1
vote
2
answers
3k
views
"character encoding hell"- Configuring mariadb for utf8 end to end
Mariadb: "mysql Ver 15.1 Distrib 10.3.8-MariaDB"
OS: Windows 10 64 bit
I've been wrestling with getting a csv data file that contains "high 8 bit" characters such as the micron character and em dash ...
- 31
0
votes
2
answers
654
views
Really weird "UTF-8" code
I downloaded a database from imdb in the form of a tsv.gz (csv) file. Imdb said that the file was in UTF-8 (https://www.imdb.com/interfaces/?ref_=login), but when I looked at the file in NotePad and ...
- 1
0
votes
0
answers
37
views
Mac OS dictionary app shows some Hangul characters as blanks
This screenshot shows what happens when I look up the Korean dictionary inside my Mac OS's default Dictionary app. Apparently some characters are missing and are substituted by empty squares. Moreover,...
- 131
1
vote
1
answer
337
views
What's the differences between different types of utf-8?
There is a problem with skype on linux. If I change my locale setting to en_US.utf-8, Chinese characters are poorly rendered (some are bold, some are not). If I change my locale setting to zh_CN.utf-...
- 601
4
votes
2
answers
2k
views
Should a use utf-8 or "utf-8" as a charset value in an email header?
When sending an email to an Outlook.com with forwarding turned on, I find that the forwarded mail is rejected.
On examining the sent mail and the mail sitting in Outlook's inbox. I find that ...
- 43
2
votes
0
answers
358
views
How can I reload an Excel spreadsheet using a different encoding?
Someone shared an Excel file with me (.xlsx, not .csv). Looking at the data in Excel it's obvious that the file is encoded using UTF-8, but Excel is interpreting the data as Windows 1252 encoded text. ...
1
vote
2
answers
2k
views
Outlook exporting emails as .csv - Encoding
I'm trying to export my emails as .csv files through Outlook 365 on Windows 10:
File -> Open & export -> Import/Export -> Export to a file -> Comma Separated Values -> Select the inbox -> some ...
- 23
0
votes
1
answer
2k
views
How to change the property "default_encoding" of Sublime Text(Version 3.1.1, Build 3176) from "UTF-8" to "ISO-8859-1"?
I'm a PHP Developer by profession.
I'm using Windows 10 Home Single Language 64-bit Operating System on my laptop.
I've installed Sublime Text(Version 3.1.1, Build 3176) on my machine.
I checked ...
- 155
0
votes
0
answers
96
views
Changing .csv file from UTF-16 to UTF-8 deletes file data
I tried changing character set of .csv file from UTF-16 to UTF-8 using the unix command
iconv -f utf-16le -t UTF-8//TRANSLIT <input file> -o <output file>
After running word count ...
- 101
0
votes
0
answers
34
views
How to be sure that a script saved with ANSI is going to work on every client environment?
Long story short. How can I fix users environments, to make them run our scripts using ANSI encode?
The problem is, we send them scripts to run on their databases using ANSI encode.
But some of ...
3
votes
2
answers
5k
views
LC_ALL=C is set, no idea why
I‘m using st, the simple-terminal or suckless-terminal, which is a terminal with Unicode-support.
I have two machines, both run Arch Linux with basically the same system settings but i only get ...
- 237
0
votes
1
answer
2k
views
How to avoid Sed changing the file format?
I was trying to use a sed file to preprocess a file, but the output from sed seems to change the format. How should I avoid it?
file A.txt
A.txt UTF-8 Unicode English text, with very long lines
sed ...
- 1
0
votes
0
answers
164
views
In putty UTF-8 character edit is not working?
I am using putty (version .70) and character set type UTF-8 is enabled. Running C program in CentOS machine also an environmental variable $LANG is set as en_GB.UTF-8. I am getting the user input(...
- 1
1
vote
0
answers
2k
views
Return value in powershell script stored in string not utf8
I'm trying to extract tables out of a pdf using tabula and powershell. When I enter the command directly in the powershell console, I get the expected result displayed (in utf8 with umlaut-symbols)
...
- 757
2
votes
1
answer
2k
views
How to convert this string to Japanese using GNU/Linux tools?
Here is a string from a text file:
@™TdaŽ®Æ‚êƒ~ƒNƒXƒgƒŒ[ƒgEƒrƒLƒjver1.11d1.d2iƒrƒLƒjƒ‚ƒfƒ‹ver.1.1³Ž®”z•z”Åj
It includes many nonprinting characters and is copied here: https://pastebin.com/...
- 73
0
votes
0
answers
2k
views
Using .bat to convert ANSI to UTF-8 in windows [duplicate]
So, I have o convert a .csv file from ANSI encoding to UTF-8 in windows, using a .bat file. Basically a program capable of doing this conversion without needing Notepad++ nor excel and etc. Do you ...
0
votes
1
answer
912
views
Symbols are lost after conversion from UTF-8 to ISO8859-1 and back to UTF-8
I have a file with properties in French.
I would like to convert it to ISO8859-1.
But after conversion, some symbols are lost.
What is wrong?
> cat fr.properties
VAR2="élément n’a"
> cat fr....
1
vote
1
answer
2k
views
Opening UTF-8 file with UTF-16 encoding in gedit results in readable Chinese
I know this isn't really a problem, but I was really curious why this is happening.
How to reproduce this phenomenon
Open gedit and type something in (I used Lorem Ipsum text from lipsum.com). Save ...
- 13
1
vote
0
answers
1k
views
How to mount nfs with utf8 support on ubuntu?
In short, I have two ubuntu 16.04 servers. Both of them are using en_US.utf-8. Now I follow this tutorial to mount a nfs from one server to another. I have done it successfully, but there is a problem ...
- 135
0
votes
0
answers
810
views
How to print a Unicode text file by command prompt
I have a problem with printing a text file from windows command prompt to network printers. Everything works fine when my file just contains ASCII characters, but Unicode characters appear as question ...
1
vote
2
answers
1k
views
How to use imageMagick on Chinese Text to Image Handling
I try to use ImageMagick to handle a Chinese character to a image on my MacBook.
According to ImageMagick's guide Unicode or UTF8 Format Text, I tried two ways.
Code one:
convert -background ...
- 321
2
votes
1
answer
11k
views
Make WordPad properly open a UTF-8 or UTF-16 encoded file
When I try to open a file that has UTF-8 encoding, I get some junk characters. I don't see anywhere in the open dialog to specify the encoding for the file. I have seen various answers which talk ...
- 2,714
6
votes
2
answers
8k
views
Why does Notepad++ display some Unicode characters as square?
It can display ₐ₊₋ but some other subscripts (like ₂ₙ) are converted to squares. When I copy that square and paste on here the problem disappears: ₂. Why is that? The file is encoded in UTF-8.
FYI: ...
- 2,051
1
vote
1
answer
6k
views
How to remove all emojis from excel
I have an excel sheet that I want to export to MySQL using the "MySQL for Excel" feature. However I'm having trouble getting that to work because some of the cells have emojis such as 😃 in it. And so ...
- 33
0
votes
0
answers
338
views
character encoding - importing HTML into Microsoft Excel
I exported my Google Chrome (browser) bookmarks as an HTML file and then imported that file into Microsoft Excel.
After importing, the text looks bad in Excel.
E.g., the word "don't" in the HTML ...
1
vote
1
answer
14k
views
Detect Character encoding of unknown characters in Notepad++, and find/replace
I have a CSV file in which I can see the following excerpt:
I found these "black" characters by scrolling through the file. The file is huge(32 Mb). I am not sure what encoding the file is in; At the ...
- 13
1
vote
1
answer
7k
views
Microsoft Excel UTF-8 encoding without importing
Before you tell me to search more and to look at other people's questions and their answers read my precise question.
Most other topics here deal with how to make UTF-8 the default option within the ...
3
votes
0
answers
94
views
How to copy a link in Firefox with a plain text decoded format to past it in Notepad [duplicate]
Every time I try to copy a link location in Firefox and then past it in Notepad I get the encoded web adresses with numbers instead of characters, I searched a little for this problem, people seems ...
- 63
2
votes
2
answers
35k
views
Convert a text file from ansi to UTF-8 in windows batch scripting
We have a text file which is in default ANSI format and that needs to be converted into UTF-8 format. Is there any way we can use the general windows DOS commands to convert the file? We can use the ...
- 21
8
votes
5
answers
59k
views
Change the default of encoding in Notepad
I wanted to change the default of encoding in Notepad (ANSI) to UTF-8. According to following link went ahead and this work was done.
But still remains a problem. If create a text file, the default ...
- 81
1
vote
1
answer
14k
views
Is there a way to force Notepad++ Encoding to Windows-1252?
Is there a way to force Notepad++ Encoding to Windows-1252 for files that it doesn't auto-detect the encoding?
It seems it defaults to UTF-8 and I want it to default to Windows-1252 instead.
Thanks ...
- 11
0
votes
0
answers
2k
views
UTF8 characters in windows 10 file explorer not displaying correctly
I have a Dropbox folder which I sync between Linux and Windows 10. If I create a file with a special character like ä on Windows it is encoded as UTF16 and displays correctly on Linux. If I create a ...
- 1
2
votes
1
answer
7k
views
Change permanently terminal encoding in windows 10 [duplicate]
When I type in the cmd chcp 65001" and then close it, when reopening it resets to the default "850".
I need to be able to run my C++ program with utf8 but I can't if it keeps reseting itself...
- 121
33
votes
6
answers
169k
views
Converting text file to UTF-8 on Windows command prompt
I need to convert a text file to UTF-8 format via Windows command prompt. This needs to be done on another machine and I do not have rights to install software on that machine. I need something like:
...
- 433
1
vote
2
answers
4k
views
Russian UTF-8 tab delimited csv file saved from Excel 2016 is garbage in text editor
There is an option in Excel 2016 to export as a UTF-8 comma delimited CSV file. I don't want commas between fields- i want tabs.
I save the file as a tab-delimited txt file. In the Save As ...
- 13
3
votes
1
answer
18k
views
Emails being received in Base64, not being automatically decoded
A lot of agents at my company are receiving emails that still include the Barracuda (spam firewall) header (even in "message" view, not "source" view) and are encoded in Base64.
They are being sent ...
- 31
4
votes
1
answer
6k
views
Can the UTF-8 code page identifier (65001) be different on other computers?
I recently tried to explain to a friend how to create a simple one-line batch file:
subst t: "X:\Example"
On my machine that has been working fine for years, but on theirs I ran into an issue: their ...
- 143