Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [utf-8]

For discussions about UCS Transformation Format with 8 bits (UTF8). It is an encoding table that represents all characters in the Unicode character set.

0
votes
1answer
42 views

How to change the property “default_encoding” of Sublime Text(Version 3.1.1, Build 3176) from “UTF-8” to “ISO-8859-1”?

I'm a PHP Developer by profession. I'm using Windows 10 Home Single Language 64-bit Operating System on my laptop. I've installed Sublime Text(Version 3.1.1, Build 3176) on my machine. I checked ...
0
votes
0answers
24 views

Changing .csv file from UTF-16 to UTF-8 deletes file data

I tried changing character set of .csv file from UTF-16 to UTF-8 using the unix command iconv -f utf-16le -t UTF-8//TRANSLIT <input file> -o <output file> After running word count ...
0
votes
0answers
19 views

How to be sure that a script saved with ANSI is going to work on every client environment?

Long story short. How can I fix users environments, to make them run our scripts using ANSI encode? The problem is, we send them scripts to run on their databases using ANSI encode. But some of ...
0
votes
2answers
139 views

LC_ALL=C is set, no idea why

I‘m using st, the simple-terminal or suckless-terminal, which is a terminal with Unicode-support. I have two machines, both run Arch Linux with basically the same system settings but i only get ...
0
votes
1answer
22 views

How to avoid Sed changing the file format?

I was trying to use a sed file to preprocess a file, but the output from sed seems to change the format. How should I avoid it? file A.txt A.txt UTF-8 Unicode English text, with very long lines sed ...
0
votes
0answers
45 views

CSV file Question marks everywhere [duplicate]

I have a really big problem with data file (I'll use another smaller file for example below) I did some excel work in CSV file and Saved it when I opened Georgian language characters were changed to ...
0
votes
0answers
22 views

Private UTF-8 sequences

I have a few 3-byte UTF-8 octal sequences in, afaict, the private ranges, and I can't find any suitable resources to help me decode what they might be intended to represent. Up until now, in Perl, I'...
0
votes
0answers
64 views

In putty UTF-8 character edit is not working?

I am using putty (version .70) and character set type UTF-8 is enabled. Running C program in CentOS machine also an environmental variable $LANG is set as en_GB.UTF-8. I am getting the user input(...
1
vote
0answers
500 views

Return value in powershell script stored in string not utf8

I'm trying to extract tables out of a pdf using tabula and powershell. When I enter the command directly in the powershell console, I get the expected result displayed (in utf8 with umlaut-symbols) ...
2
votes
1answer
193 views

How to convert this string to Japanese using GNU/Linux tools?

Here is a string from a text file: @™TdaŽ®Æ‚êƒ~ƒNƒXƒgƒŒ[ƒgEƒrƒLƒjver1.11d1.d2iƒrƒLƒjƒ‚ƒfƒ‹ver.1.1³Ž®”z•z”Åj It includes many nonprinting characters and is copied here: https://pastebin.com/...
0
votes
0answers
18 views

Automatically merge combining characters into base characters in filenames? [duplicate]

I'm using ext4 file system under Linux. Some UTF-8 characters are combining characters which are used to modify other characters and sometimes they can actually be merged into the base character. ...
0
votes
0answers
255 views

Using .bat to convert ANSI to UTF-8 in windows [duplicate]

So, I have o convert a .csv file from ANSI encoding to UTF-8 in windows, using a .bat file. Basically a program capable of doing this conversion without needing Notepad++ nor excel and etc. Do you ...
0
votes
1answer
26 views

Symbols are lost after conversion from UTF-8 to ISO8859-1 and back to UTF-8

I have a file with properties in French. I would like to convert it to ISO8859-1. But after conversion, some symbols are lost. What is wrong? > cat fr.properties VAR2="élément n’a" > cat fr....
1
vote
1answer
275 views

Opening UTF-8 file with UTF-16 encoding in gedit results in readable Chinese

I know this isn't really a problem, but I was really curious why this is happening. How to reproduce this phenomenon Open gedit and type something in (I used Lorem Ipsum text from lipsum.com). Save ...
1
vote
0answers
275 views

How to mount nfs with utf8 support on ubuntu?

In short, I have two ubuntu 16.04 servers. Both of them are using en_US.utf-8. Now I follow this tutorial to mount a nfs from one server to another. I have done it successfully, but there is a problem ...
0
votes
0answers
507 views

How to get Excel to interpret an UTF-8 file with custom field separator correctly?

I'm maintaining a legacy PHP tool which outputs csv files with custom delimiters. This was fine before, because the files were only read by programs. But now that someone tries to open them with ...
0
votes
0answers
321 views

How to print a Unicode text file by command prompt

I have a problem with printing a text file from windows command prompt to network printers. Everything works fine when my file just contains ASCII characters, but Unicode characters appear as question ...
0
votes
2answers
223 views

How to use imageMagick on Chinese Text to Image Handling

I try to use ImageMagick to handle a Chinese character to a image on my MacBook. According to ImageMagick's guide Unicode or UTF8 Format Text, I tried two ways. Code one: convert -background ...
1
vote
1answer
2k views

Make WordPad properly open a UTF-8 or UTF-16 encoded file

When I try to open a file that has UTF-8 encoding, I get some junk characters. I don't see anywhere in the open dialog to specify the encoding for the file. I have seen various answers which talk ...
2
votes
1answer
1k views

Why does Notepad++ display some Unicode characters as square?

It can display ₐ₊₋ but some other subscripts (like ₂ₙ) are converted to squares. When I copy that square and paste on here the problem disappears: ₂. Why is that? The file is encoded in UTF-8. FYI: ...
1
vote
1answer
680 views

How to remove all emojis from excel

I have an excel sheet that I want to export to MySQL using the "MySQL for Excel" feature. However I'm having trouble getting that to work because some of the cells have emojis such as 😃 in it. And so ...
0
votes
0answers
99 views

character encoding - importing HTML into Microsoft Excel

I exported my Google Chrome (browser) bookmarks as an HTML file and then imported that file into Microsoft Excel. After importing, the text looks bad in Excel. E.g., the word "don't" in the HTML ...
1
vote
1answer
3k views

Detect Character encoding of unknown characters in Notepad++, and find/replace

I have a CSV file in which I can see the following excerpt: I found these "black" characters by scrolling through the file. The file is huge(32 Mb). I am not sure what encoding the file is in; At the ...
0
votes
1answer
887 views

Microsoft Excel UTF-8 encoding without importing

Before you tell me to search more and to look at other people's questions and their answers read my precise question. Most other topics here deal with how to make UTF-8 the default option within the ...
3
votes
0answers
83 views

How to copy a link in Firefox with a plain text decoded format to past it in Notepad [duplicate]

Every time I try to copy a link location in Firefox and then past it in Notepad I get the encoded web adresses with numbers instead of characters, I searched a little for this problem, people seems ...
0
votes
2answers
9k views

Convert a text file from ansi to UTF-8 in windows batch scripting

We have a text file which is in default ANSI format and that needs to be converted into UTF-8 format. Is there any way we can use the general windows DOS commands to convert the file? We can use the ...
1
vote
2answers
5k views

Change the default of encoding in Notepad

I wanted to change the default of encoding in Notepad (ANSI) to UTF-8. According to following link went ahead and this work was done. But still remains a problem. If create a text file, the default ...
0
votes
1answer
3k views

Is there a way to force Notepad++ Encoding to Windows-1252?

Is there a way to force Notepad++ Encoding to Windows-1252 for files that it doesn't auto-detect the encoding? It seems it defaults to UTF-8 and I want it to default to Windows-1252 instead. Thanks ...
0
votes
0answers
695 views

UTF8 characters in windows 10 file explorer not displaying correctly

I have a Dropbox folder which I sync between Linux and Windows 10. If I create a file with a special character like ä on Windows it is encoded as UTF16 and displays correctly on Linux. If I create a ...
1
vote
1answer
2k views

Change permanently terminal encoding in windows 10 [duplicate]

When I type in the cmd chcp 65001" and then close it, when reopening it resets to the default "850". I need to be able to run my C++ program with utf8 but I can't if it keeps reseting itself...
6
votes
2answers
33k views

Converting text file to UTF-8 on Windows command prompt

I need to convert a text file to UTF-8 format via Windows command prompt. This needs to be done on another machine and I do not have rights to install software on that machine. I need something like: ...
1
vote
2answers
1k views

Russian UTF-8 tab delimited csv file saved from Excel 2016 is garbage in text editor

There is an option in Excel 2016 to export as a UTF-8 comma delimited CSV file. I don't want commas between fields- i want tabs. I save the file as a tab-delimited txt file. In the Save As ...
1
vote
1answer
3k views

Emails being received in Base64, not being automatically decoded

A lot of agents at my company are receiving emails that still include the Barracuda (spam firewall) header (even in "message" view, not "source" view) and are encoded in Base64. They are being sent ...
2
votes
1answer
1k views

Can the UTF-8 code page identifier (65001) be different on other computers?

I recently tried to explain to a friend how to create a simple one-line batch file: subst t: "X:\Example" On my machine that has been working fine for years, but on theirs I ran into an issue: their ...
0
votes
1answer
81 views

Printing graphemes given UTF-8 code units in shell

I have a file with a list of smileys code units, and I need another one with the 'grapheme representation' in order to feed those to a grep. If I echo the code unit right in the shell it gets ...
0
votes
0answers
193 views

ModSecurity OWASP Core Rule Set - unicode false positive

We run some web services. We use ModSecurity for Apache webserver with the OWASP core rule set. We have problems with greek and russian requests, because of cyrillic and greek letters. In the rules ...
2
votes
1answer
21k views

How to change LibreOffice default text encoding?

I want to change the default text encoding used by LibreOffice when saving a document as a Text document. Where can I find this setting? I want it to be UTF-8 WITHOUT the BOM, which I believe is ...
0
votes
1answer
243 views

Is there a double caret sign?

Basically, is there a rotated right/left version of 《 》, such that the symbol would be pointing upward and not sideways. It's for a visualization project and I tried the "^" sign but it's too narrow ...
0
votes
1answer
3k views

In Notepad++ the encoding of a file is set to UTF-8 but the encoding is actually ASCII

I need some text files to be encoded as UTF-8 text files when I use them with Notepad++. However, sometimes I have UTF-8 selected as the encoding in Notepad++, but the file is actually in ASCII. I ...
0
votes
1answer
96 views

notepad++ don't show the right character despite the right encoding

My UTF8.txt file display all other Unicode characters fine but not the x̄, it show instead a"x" and it's top dash "-"on the right (and not above the x). (When I copy past this x- from np++ to chrome ...
1
vote
0answers
33 views

How to render invisible chars in a text area?

Assuming this is not a text renderer limitation, and that a font can opt to show those chars, I would like to have things like u2028 (LS - Line Separator) and u2029 (PS - Paragraph Separator) rendered ...
1
vote
1answer
5k views

Default character encoding for Excel Text Wizard?

A large part of my job is to run an SQL query, save the results as a UFT-8 encoded csv file then import it into Excel for further manipulation and distribution. When I import the csv file into Excel ...
1
vote
0answers
140 views

SSHing gives me UTF-8, but using 'ssh -t' does not

I'm accessing my desktop machine using SSH to connect to a Screen session. If do this: ssh -p 12345 111.11.111.111 screen -r "Jelly" I have UTF-8 support working fine. However, if I do this: ssh -p ...
0
votes
0answers
707 views

What is the difference in Windows CMD and PowerShell redirection and text Encoding?

Granted, this is not a great title, but to be honest I was unsure how to word the question without posting an essay as the question. This description should add some flesh. Problem: I have a Python ...
0
votes
1answer
346 views

How to convert Hebrew ID3/metadata tags from CP1255 to UTF-8?

I have numerous MP3 (and perhaps files in other audio formats) whose meta-data tags (ID3v1 and/or ID3v2 for the case of MP3) include Hebrew characters in CP1255 charset (or ISO-8859-8i, essentially ...
1
vote
1answer
208 views

Surrogate character to visualize a space like ̺ this, but without combining?

I'm looking for a character in Unicode like this (in black): The problem with COM­BI­NING INVERTED BRID­GE BELOW (code point U+033A, \xCC\xBA in UTF-8) is that it must be combined with another ...
2
votes
0answers
608 views

Set Locales on Ubuntu

Greetings: I want to set locales in Ubuntu. It currently has en_US.UTF-8 and I want to change it to es_ES.ISO-8859-1. I added the locale by entering the command sudo locale-gen "es_ES.ISO-8859-1" ...
0
votes
2answers
281 views

UTF-8 not recognized in SQL batch process through Putty

I have an .sql file with a few simple "Insert into" SQL commands that are being inserted into a table called Künstler. insert into Künstler (name) values ('Mariah Carey'); insert into Künstler (name) ...
0
votes
1answer
376 views

How to make wevtutil tool return results in UTF-8 format?

I'm writing a script that requires me to look up a specific event in the Windows Event Log using wevtutil tool. The command line goes as such: wevtutil qe System /q:"*[System[Provider[@Name='...
1
vote
3answers
2k views

charset=iso-8859-2 webpage displays with UTF-8 header - question marks (�) instead of accented letters

I have a webserver administration question. In this website: http://www.mirkaphoto.hu/ All PHP generated pages contain the following line: <meta http-equiv="Content-Type" content="text/html; ...