The character-encoding tag has no wiki summary.
1
vote
0answers
18 views
When I submit HTML characters in my form, why does ASP.NET throw an internal server (500) error? [migrated]
When I put in HTML characters in my form, such as <br />, ASP.NET throws an internal 500 exception as described here.
A potentially dangerous Request.Form value was detected from the client ...
3
votes
2answers
292 views
How to detect the encoding of a file?
On my filesystem (Windows 7) I have some text files (These are SQL script files, if that matters).
When opened with Notepad++, in the "Encoding" menu some of them are reported to have an encoding of ...
25
votes
7answers
1k views
Is the carriage-return char considered obsolete
I wrote an open source library that parses structured data but intentionally left out carriage-return detection because I don't see the point. It adds additional complexity and overhead for little/no ...
1
vote
2answers
232 views
What does the python Codecs module do?
I just read through the documentation on the Codecs module, but I guess my knowledge/experience of comp sci doesn't run deep enough yet for me to comprehend it.
It's for dealing with ...
5
votes
2answers
294 views
How relevant is UTF-7 when it comes to parsing emails?
I recently implemented incoming emails for an application and boy, did I open the gates of hell? Since then every other day an email arrives that makes the app fail in a different way.
One of those ...
2
votes
3answers
468 views
How does it matter if a character is 8 bit or 16 bit or 32 bit
Well, I am reading Programing Windows with MFC, and I came across Unicode and ASCII code characters. I understood the point of using Unicode over ASCII, but what I do not get is how and why is it ...
9
votes
3answers
3k views
Why do we need to put N before strings in Microsoft SQL Server?
I'm learning T-SQL. From the examples I've seen, to insert text in a varchar() cell, I can write just the string to insert, but for nvarchar() cells, every example prefix the strings with the letter ...
2
votes
2answers
155 views
What are the commonly confused encodings that may result in identical test data?
I'm fixing code that is using ASCIIEncoding in some places and UTF-8 encoding in other functions.
Since we aren't using the UTF-8 features, all of our unit tests passed, but I want to create a ...
2
votes
2answers
362 views
Should my source code be in UTF-8?
I feel that often you don't really choose what format your code is in. I mean most of my tools in the past have decided for me. Or I haven't really even thought about it. I was using TextPad on ...
2
votes
2answers
197 views
What is really happening when we change encoding in a string?
http://php.net/manual/en/function.mb-convert-encoding.php
Say I do:
$encoded = mb_convert_encoding ($original);
That looks like simple enough. WHat I am imagining is the following
$original has a ...
1
vote
2answers
402 views
Why was ASCII needed?
With an encoding such as EBCDIC being in existence already (and being 8 bit to boot), what was the need to invent yet another encoding and a 7 bit one at that?
Why was ASCII invented and what ...
3
votes
2answers
105 views
What steps can I take to avoid character encoding issues in a web application?
In previous web applications I've built, I've had issues with users entering exotic characters into forms which get stored strangely in the database, and sometimes appear different or double-encoded ...
3
votes
3answers
386 views
Was API hooking done as needed for Stuxnet to work? I don't think so
Caveat: I am a political science student and I have tried my level best to understand the technicalities; if I still sound naive please overlook that.
In the Symantec report on Stuxnet, the authors ...
3
votes
3answers
205 views
what limitation will we face if each user-perceived character is assigned to one codepoint?
Hi all I was wondering what limitations will we have if Unicode had decided to assign one and only one codepoint to every user-perceived character?
Currently, Unicode has code-points that correspond ...
2
votes
2answers
212 views
Should I HTML encode all output from my API?
I am creating a RESTful JSON API to access data from our website where the content is in German.
A handful of the fields will return formatted HTML while most are single lines of text although they ...
1
vote
1answer
1k views
What is the Best Collation for Use in MySQL Tables?
I'm curious what is considered the standard today for use as the Collation of MySQL Tables?
I was told that Latin-1 was the best choice when I was beginning with MySQL, but came across this post from ...
7
votes
5answers
4k views
What is the advantage of choosing ASCII encoding over UTF-8?
All characters in ASCII can be encoded using UTF-8 without an increase in storage (both requires a byte of storage).
UTF-8 has the added benefit of character support beyond "ASCII-characters". If ...
7
votes
3answers
846 views
Is UTF-16 fixed-width or variable-width? Why doesn't UTF-8 have byte-order problem?
Is UTF-16 fixed-width or variable-width? I got different results
from different sources:
From http://www.tbray.org/ongoing/When/200x/2003/04/26/UTF:
UTF-16 stores Unicode characters in ...
2
votes
3answers
177 views
Does printing out numbers involve converting the numbers into characters?
In programming languages, when numbers (either integer, or real) are printed out, are they firstly converted to the codes of the readable characters that are meant to represent the numbers, and then ...
13
votes
4answers
607 views
What issues lead people to use Japanese-specific encodings rather than Unicode?
At work I come across a lot of Japanese text files in Shift-JIS and other encodings. It causes many mojibake (unreadable character) problems for all computer users. Unicode was intended to solve this ...
1
vote
3answers
125 views
Is it ok to use localized character encodings for code?
Is it ok to use a localized encoding (i.e. ISO-8859-15) instead of ANSI/UTF-8/some standard for code?
What when you have names that do not translate very well into english code? Or when your company ...
0
votes
2answers
302 views
Encoding issues from MySQL database to PHP page
So I've been working on a small, small side project to learn a bit more about PHP database interactions. I bought a small, cheap database of "Inspirational Stories" and set to work on turning it into ...
17
votes
7answers
1k views
Should character encodings besides UTF-8 (and maybe UTF-16/UTF-32) be deprecated?
A pet peeve of mine is looking at so many software projects that have mountains of code for character set support. Don't get me wrong, I'm all for compatibility, and I'm happy that text editors let ...
