Posted by jpluimers on 2022/03/16
Last year, Waterschap Amstel, Gooi en Vecht sent me a paper letter notifying the yearly water bill was going to be late as they were redesigning their IT systems.
Their letter introduced a classic Mojibake that had not been present in all their older paper letter communication.
"Pyreneeรซn":
"Pyreneeรยรยซn":
Posted in Development, Encoding, ftfy, Mojibake, Python, Software Development, Unicode, UTF-8, UTF8 | Leave a Comment »
Posted by jpluimers on 2022/03/10
When writing this, [Wayback/Archive.is] ftfy ยท PyPI:history indicates ftfy was already at 6.0.3.
It is still my goto tool for figuring out the cause of Mojibake. I remember writing about it the first time in 2016 (see the ftfy category) when it was already at version 3.0, discovering it after a few Mojibake posts.
By now it even understands right-to-left Mojibake garbage:ย 
[Archive.is] Elia Robyn Speer on Twitter: “ftfy 5.8 is out! … A user reported that Hebrew text wasn’t being fixed, and this made me think about how to expand some of the trickier cases to non-Latin alphabets.”
Mojibake mishaps still happen a lot, so by now I hope I will have done a Mojibake themed Delphi talk at one or more conferences.
Posted in !!con (bangbangcon), About, Autistic Spectrum/Autism, Cancer, Conference Topics, Conferences, Development, Encoding, Event, ftfy, Mojibake, Personal, Python, Rectum cancer, Scripting, Software Development, Unicode | Leave a Comment »
Posted by jpluimers on 2022/03/09
I needed this for my blog post tomorrow:
import os os.system('sh') # or bash, tcsh, zsh, whatever. :-P
[Wayback] How do I drop a bash shell from within Python? – Stack Overflow
Thanks [Wayback] Chris Jester-Young!
This trick works at the Python shell.
–jeroen
Posted in Development, Python, Scripting, Software Development | Leave a Comment »
Posted by jpluimers on 2022/02/23
A follow-up on Source: Some links with notes on WoonVeilig/Egardia security system communications, protocols and support by 3rd party home automation apps:
Instructions on how to setup Egardia / Woonveilig within Home Assistant.
…
If the system support XMPP, disable XMPP by invalidating the configuration in the XMPP menu (for example by changing the user name). This is required for recent firmwares of the GATE-03 system as it does not use the Reporting server at all in the case of a valid XMPP configuration.
This is the actual Woonveilig/Egardia plugin that Home Assistant can use. It is integrated through [Wayback] pythonegardia ยท PyPI via [Wayback/Archive.is] core/requirements_all.txt at dev ยท home-assistant/core
Python library to interface with Egardia / Woonveilig alarm. Tested withย WV-1716,ย GATE-01,ย GATE-02ย andย GATE-03ย version of Egardia / Woonveilig. Other versions might work, but unsure. Originally written for integration withย Home Assistant it can also by used to integrate with these alarms in other solutions.
Notes on the Woonveilig/Egardia GATE-03 model alarm hub (where 192.168.x.y is the IPv4 address that hub):
http://192.168.x.y/setting/xmpp.htm.xmpp01.egardia.com as primary and xmpp01.alt.egardia.com as secondary server on port 443.arg-####-authย ย where ###### are the last 6 *lowercase* hexadecimal digits of the MAC address of the GATE-03.http://192.168.x.y/action/xmppGet http GET request fired by http://192.168.x.y/setting/xmpp.htm.ip://######@ics.alt.egardia.com:52010/CID where ###### are the last 6 *uppercase* hexadecimal digits of the MAC address of the GATE-03.http://192.168.x.y/setting/userCode.htm together with their user names.http://192.168.x.y/setting/codeSetting.htm and obtained via http://192.168.x.y/action/areaListGet and http://192.168.x.y/action/codeSettingGetI got all of the above via: [Wayback/Archive.is] GATE-03 system does not report to Egardiaserver ยท Issue #26 ยท jeroenterheerdt/python-egardia (which by coincidence used the same firmware I had: HSGW 0.0.2.18.1 HPGW-L2-XA35H).
Which brings me to some Google search with some remarkable results:
…
LUPUSEC simply re-branded a Climax HPGW-G2 system and loaded some of their custom firmware on it.
…
So I did a quick look at LUPUS XT* based products:
Then at the Woonveilig/Egardia and Climax shops:
Conclusions:
Side note on open ports
PORT STATE SERVICE VERSION 9/tcp filtered discard 25/tcp filtered smtp 80/tcp open http 445/tcp filtered microsoft-ds
PORT STATE SERVICE VERSION 9/tcp filtered discard 21/tcp open ftp oftpd 25/tcp filtered smtp 80/tcp open tcpwrapped 445/tcp filtered microsoft-ds 554/tcp open rtsp 711/tcp open cisco-tdp? 1935/tcp open rtmp? 6000/tcp open X11? 49152/tcp open upnp Portable SDK for UPnP devices 1.6.17 (Linux 3.4.35; UPnP 1.0)
Posted in Communications Development, Development, Python, Scripting, Software Development | Leave a Comment »
Posted by jpluimers on 2021/12/01
Wanting a simple way on the console to convert a .pcap file to a .wav file, I searched for [Wayback] console convert pcap to wav – Google Search.
The reason is that [Wayback] fritzcap (written in Python) sometimes crashes while doing the conversion of a phone recording, so then only the .pcap file is available. I still want to figure this out, but given my health situation, I might not be able to in time.
Posted in *nix, *nix-tools, Audio, Development, ffmpeg, Fritz!, Fritz!Box, fritzcap, Hardware, Media, Network-and-equipment, Power User, Python, Scripting, Software Development, Wireshark | Leave a Comment »
Posted by jpluimers on 2021/11/23
Cool tool for when you ever need random users to test a system [Wayback] Random User Generator | Home:
Random user generator is a FREE API for generating placeholder user information. Get profile photos, names, and more. It’s like Lorem Ipsum, for people.
This was used when extracting Parler data to substantiate evidence around the 20210106 USA Capitol riots.
You can even use a simple HTTP GET like [Wayback] randomuser.me/api and get a JSON result like this.
{"results":[{"gender":"female","name":{"title":"Miss","first":"Malou","last":"Mortensen"},"location":{"street":{"number":2669,"name":"Lyngbyvej"},"city":"Sundby","state":"Syddanmark","country":"Denmark","postcode":48047,"coordinates":{"latitude":"-35.1307","longitude":"113.7480"},"timezone":{"offset":"+1:00","description":"Brussels, Copenhagen, Madrid, Paris"}},"email":"malou.mortensen@example.com","login":{"uuid":"981747de-66fe-40b0-87ea-adfe403fe1be","username":"purpleostrich871","password":"sweets","salt":"x86aQbIB","md5":"55497ac53530b428f98b9d36267ceeef","sha1":"358b94ffabe7d827c34da15791e5d6717c594428","sha256":"6e357e887877e29b7e6d53073f648174382c53c24f83479e25fed9c82075ed32"},"dob":{"date":"1995-06-05T04:50:35.145Z","age":26},"registered":{"date":"2018-07-21T00:59:50.523Z","age":3},"phone":"02990797","cell":"94800012","id":{"name":"CPR","value":"050695-9954"},"picture":{"large":"https://randomuser.me/api/portraits/women/27.jpg","medium":"https://randomuser.me/api/portraits/med/women/27.jpg","thumbnail":"https://randomuser.me/api/portraits/thumb/women/27.jpg"},"nat":"DK"}],"info":{"seed":"8971869bb62b73d7","results":1,"page":1,"version":"1.3"}}
Via:
–jeroen
Posted in Communications Development, Development, HTTP, Internet protocol suite, JavaScript/ECMAScript, JSON, Python, REST, Scripting, Software Development, TCP | Leave a Comment »
Posted by jpluimers on 2021/10/28
After doing a lot of – historically grown – dash scripting for ESXi, I found out there is Python available on ESXi:
Yes I know that Python 3.5 is end-of-life (and 3.5.10 was the latest version), but it is a lot better than shell scripts.
So now some links for my list of things to try in order to use Python for scripting ESXi operations:
Take a look at theย pyVmomiย project which is the official Python SDK for the VMware vSphere API that allows you to manage ESX, ESXi and vCenter.
Moreover, theย pyvmomi-community-samplesย repository contains lot of examples.
Also, checkout the pyvmomi Community Samples repo. It has all kinds of great samples, including one that could fit this request:ย github.com/vmware/pyvmomi-community-samples/blob/master/samples/โฆ โ [Wayback] Kyle Ruddy
Welcome to the pyvmomi-community-samples project
This is a place for anyone to learn about working with the vSphere Management SDK’s native python binding library pyVmomi. Samples here are contributed by developers like you and curated by your fellow developers. The quality and validity of the samples will vary, however, if you see a problem report it! If you can solve someone’s problem, contribute a fix! If you need a new sample ask for one!
pyVmomi is the Python SDK for the VMware vSphere API that allows you to manage ESX, ESXi, and vCenter.
Executable Samples
This directory contains a collection of executable sample scripts that use the pyVmomi library. There is aยtoolsย directory that holds a collection of tools and aยtestsย directory that holds the tests for those tools.Quality and License
Scripts are provided as-is by numerous contributors and the status of any sample at any point is subject to change. The project is intended as a collaborative exercise in community learning and may not contain best practice methods.All samples revert to the license of the project and all ownership reverts to the community project.Contribution Notes
- If a script is in this directory, it is an executable sample.
- conform to pep8
- avoid using any special tools beyond pyVmomi.
- do not extend the pyVmomi API in this project we have two separate projects dedicated to that.
- tests are appreciated but optional because of this sample quality must be manually assessed bug reports and fixes are much appreciated.
- A reviewer will pull a new sample for testing and will attempt to run the sample. If the reviewer can do this, the sample can be merged
Getting Help
- Question can be opened as issues atย https://github.com/vmware/pyvmomi-community-samples/issues
- The IRC forumย #pyvmomiย is for developers workingย withย pyVmomi
of which there are many, for instance:
Any reusable classes or methods that you develop can be included in packages under this directory. When adding a reusable component we highly recommend that you include tests.Only some samples will make use of reusable components. This is where to put those.
–jeroen
Posted in *nix, *nix-tools, ash/dash, ash/dash development, Development, Power User, Python, Scripting, Software Development | Leave a Comment »
Posted by jpluimers on 2021/09/22
[WayBack] Thread by @0xdade: Today I learned that you can put zero width spaces in file names on Linux. Have fun. I’m playing with this because punycode/IDN is fascinatiโฆ
Today I learned that you can put zero width spaces in file names on Linux. Have fun.I’m playing with this because punycode/IDN is fascinating, and I wanted to know what happened when I started shoving unicode in the path portion of the url, which isn’t part of how browsers try to protect URLs, as far as I can tell
I think it’s more entertaining to have a file that is named *only* a zero width space, but I think using them throughout a filename is better to break tab completion and not stand out too much. A filename that is just blank looks strange in ls output.Thank goodness adduser is looking out for our best interests.Oooh this one is pretty subtle.Just about pissed myself with this one.Not related to the terminal fun, but related to zero width characters:
You can:
– Break url previews https://0xdaโโโโโโ.โde
– @โ0xdade without tagging
– Make a word like systemโd not searchableย twitter.com/search?q=from%โฆOkay but back to command line crap. I really like this one. Create a directory named .[ZWS]One thing that is cool about using zero width spaces is that “ls” has a flag, “-b”, that is meant to escape non-graphic characters. Inserting a newline, for instance, would be escaped to \n. But the zero width space is technically a graphic character, so nothing happens.
Fun.
Have no fear, though. It’s not unbeatable. It’s only fun if the language and LC settings are set to support utf-8. If you set LC_ALL=C or whatever that isn’t utf-8, then it looks like this.Putting a link to this tweet here so that I don’t lose it again in the future.
dade@0xdadeMy god, it is beautiful. I mean except all the whitespace I can’t get rid of before the command lmao.
And these tweets:
xsel for linux). zws () { echo -n '\u200D' | pbcopy }โฆ “
000. If you cat it, there were \b chars to hide the flag. Super tedious.โฆ “
Variation Selectors (U+FE00..U+FE0F) are zero-width invisible modifiers with the ID_Continue property, so can be used inside variable names in languages like Python or C#. And since they’re modifiers, the cursor doesn’t stop when it passes them.โฆ “\a in C) is printed by the program, it will cause the terminal to ring its bell.โฆ “[WayBack] Acme::Bleach – For really clean programs – metacpan.org
https://0xdaโโโโโโ.โde – @โ0xdade without tagging – Make a word like systemโd not searchable “
[WayBack] Thread by @Plazmaz: @0xdade Was doing some real fucking around with urls recently: gist.github.com/Plazmaz/565a5cโฆ (was gonna flesh it out more but didn’t findโฆ:
ย Was doing some real fucking around with urls recently:(was gonna flesh it out more but didn’t find the time)ย
ย This one is my fave:
‘โ’ (\u2044)
or
‘โ’ (\u2215)
Allow for this:
google.comโsearchโqueryโ.example.com
google.comโsearchโqueryโ@example.comย[WayBack] url-screwiness.md ยท GitHub:
This is a list of methods for messing with urls. These are often useful for bypassing filters, SSRF, or creating convincing links that are difficult to differentiate from legitimate urls.
And a bit of documentation links:
–jeroen
Posted in *nix, .NET, C#, Development, NTFS, Power User, Python, Scripting, Software Development, Windows | Leave a Comment »
Posted by jpluimers on 2021/09/14
Besides manual upload at [Archive.is] Upload to Internet Archive, there are also automated ways of uploading content.
One day I need this to archive pages or sites into the WayBack machine: [WayBack] Overview of Client Libraries ยท Internet Archive (most of which is Python based):
Posted in Bookmarklet, Development, Internet, InternetArchive, Power User, Python, Scripting, Software Development, WayBack machine, Web Browsers | Leave a Comment »
Posted by jpluimers on 2021/09/02
It is always fun to see how Sudoku solving algorithms are created and implemented. This is no exception: [WayBack] Coming Back to Old Problems: How I Finally Wrote a Sudoku Solving Algorithm – DEV Community ๐ฉโ๐ป๐จโ๐ป
For a visual Sudoku solver, I usually take [WayBack] Sudoku Solver by Andrew Stuart. Shows the logic behind solving Sudoku square by square which is part of [WayBack] SudokuWiki.org – Getting Started having many visual explanations on how to solve these puzzles, for instance:
It’s a kind of sudo ku, but visually and never failed me solve one.
–jeroen
Posted in Algorithms, Development, Python, Scripting, Software Development | Leave a Comment »
The Wiert Corner - irregular stream of stuff 