Archive for the ‘Encoding’ Category
Posted by jpluimers on 2022/03/16
Last year, Waterschap Amstel, Gooi en Vecht sent me a paper letter notifying the yearly water bill was going to be late as they were redesigning their IT systems.
Their letter introduced a classic Mojibake that had not been present in all their older paper letter communication.
- Street name on a letter via the old IT systems is
"Pyreneeën"
:

- Street name on a letter via the new IT systems is
"Pyreneeën"
:

Read the rest of this entry »
Like this:
Like Loading...
Posted in Development, Encoding, ftfy, Mojibake, Python, Software Development, Unicode, UTF-8, UTF8 | Leave a Comment »
Posted by jpluimers on 2022/03/10
When writing this, [Wayback/Archive.is] ftfy · PyPI:history indicates ftfy was already at 6.0.3.
It is still my goto tool for figuring out the cause of Mojibake. I remember writing about it the first time in 2016 (see the ftfy category) when it was already at version 3.0, discovering it after a few Mojibake posts.
By now it even understands right-to-left Mojibake garbage:
[Archive.is] Elia Robyn Speer on Twitter: “ftfy 5.8 is out! … A user reported that Hebrew text wasn’t being fixed, and this made me think about how to expand some of the trickier cases to non-Latin alphabets.”
Mojibake mishaps still happen a lot, so by now I hope I will have done a Mojibake themed Delphi talk at one or more conferences.
Read the rest of this entry »
Like this:
Like Loading...
Posted in !!con (bangbangcon), About, Autistic Spectrum/Autism, Cancer, Conference Topics, Conferences, Development, Encoding, Event, ftfy, Mojibake, Personal, Python, Rectum cancer, Scripting, Software Development, Unicode | Leave a Comment »
Posted by jpluimers on 2022/02/16
So I can find them back later:
- SMS: Short Message Service. Messages limited to 140 octet (160 7-bit characers, 140 8-bit characters or 70 16-bit characters) sent mainly over the GSM or UMTS mobile networks.
- Concatenated SMS or Multipart SMS. Does work on most devices and most operators. Way to send messages longer than 140 octets. Each part is billed separately.
- MSISDN a number uniquely identifying a subscription in a GSM or a UMTS mobile network. Always starts with country code. Never includes a prefix (like 00 or +).
- SMPP: Short Message Peer-to-Peer.
- HLR: Home Location Register.
An interesting party with some public SMS APIs is MessageBird. You can compare their old and new ones:
Read the rest of this entry »
Like this:
Like Loading...
Posted in Development, Encoding, Software Development | Leave a Comment »
Posted by jpluimers on 2022/02/15
[Wayback] WILT: XML encode a string in .net « Benoit MARTIN’s Weblog:
Always wondered why I couldn’t find a method that would XML encode a string, effectively escaping the 5 illegal characters for XML. There is such a method but its location in the API is not intuitive at all. It’s in the System.Security
namespace: [Wayback] SecurityElement.Escape(String) Method (System.Security) | Microsoft Docs
public static string? Escape (string? str);
Its usage is:
tagText = System.Security.SecurityElement.Escape(tagText);
This will escape the 5 characters <
, >
, &
, "
and '
–jeroen
Like this:
Like Loading...
Posted in .NET, Development, Encoding, Software Development, XML, XML escapes, XML/XSD | Leave a Comment »
Posted by jpluimers on 2022/02/15
From my Windows XP days (which are long gone), but historically relevant the answer to [Wayback] DELPHI : EEncodingError – Invalid code page on windows xp embedded – Stack Overflow by [Wayback] Remy Lebeau:
The TEncoding.ASCII
property uses codepage 20127, which is not installed on XP Embedded by default. You have to install it manually. The TEncoding
class does not exist in D2006.
Are you using Indy 10, by chance? It uses TEncoding.ASCII
by default for its string encodings. This exact error has been known to occur when using Indy on XP Embedded.
–jeroen
Like this:
Like Loading...
Posted in ASCII, Delphi, Development, Encoding, Power User, Software Development, XP-embedded | Leave a Comment »