Posted by jpluimers on 2017/06/21
For one of my VMs I forgot to note which of the initial password I had changed, so I wanted to check them.
Since I didn’t have a keyboard attached to the console and ssh wasn’t allowing root, I needed an alternative than actual login to test the passwords.
Luckily /etc/shadow, with getent and openssl came to the rescue.
Since getent varies per distribution, here is how it works on OpenSuSE:
Posted in *nix, *nix-tools, ash/dash, bash, bash, Development, Encoding, Hashing, Linux, md5, openSuSE, Power User, Scripting, Security, SHA, SHA-256, SHA-512, Software Development, SuSE Linux | Leave a Comment »
Posted by jpluimers on 2017/04/21
For future research: opensuse – How to run my script after SuSE finished booting up? – Unix & Linux Stack Exchange
Reason? Want to show the output of this as the last boot sequence line:
hostname
ip route
echo
ip address | grep -w 'UP\|flags\|inet\|inet6'
echo more detailed info through "ip address" and "ip route"
cat /etc/resolv.conf | grep nameserver
–jeroen
Posted in *nix, *nix-tools, bash, Linux, openSuSE, Power User, SuSE Linux, Tumbleweed | Leave a Comment »
Posted by jpluimers on 2017/04/12
Blank imageFlair
Hosting Grumpydev Imageflair locally ended with two issues left: an empty image and my wish to include more complete StackExchange bits like the current StackExchange flair does.
I thought fixing the empty image would take a rainy day. It actually took a few rainy hours.
The culprit is that I didn’t have the Microsoft Core Fonts for the Web installed. Which was no coincidence as the free download of those from Microsoft terminated in 2002. The upside is that because of their licenses, they are available as open source and most linux distributions have a script package that will download these fonts. OpenSuSE has fetchmsttfonts for this.
Alternatively, you can use the web.archive.org to download manually, but that’s a tad tedious. But if you love tedious: Free downloads – TrueType core fonts for the Web.
zypper install fetchmsttfonts
That installs the fonts in:
/usr/share/fonts/truetypeThe drawback of having fetchmsttfonts is that the original Microsoft versions of these fonts are downloaded from corefonts.sourceforge.net each time the fetchmsttfonts package is updated, potentially overwriting newer versions of the fonts in that directory. If you don’t want that, use the trick at (not yet archived at the WayBack machine) font handling – install fetchmsttfonts, copy fonts, rpm -e fethmsttfonts, copy fonts back.
Having the fonts installed, I thought the only thing I needed to fix were the multiple references in config.php from that pointed to Arial.TTF. I took the poor man’s approach and just did this being in the directory of config.php:
cp /usr/share/fonts/truetype/arial.ttf Arial.TTF
Filled Imageflair
That didn’t work either: still no text showed.
So I decided to run imageFlair.php from the command line after setting $imageflair_debug = true; in config.php which then resulted in all sorts of warnings like
PHP Warning: imagettftext(): Could not find/open font
After reading I decided to build a small php-gd.tester.php script containing phpinfo(); and gd_info showing these portions for PHP GD (non-relevant bits stripped):
| Additional .ini files parsed | /etc/php5/conf.d/ctype.ini, /etc/php5/conf.d/dom.ini, /etc/php5/conf.d/gd.ini, /etc/php5/conf.d/iconv.ini, /etc/php5/conf.d/json.ini, /etc/php5/conf.d/mysql.ini, /etc/php5/conf.d/mysqli.ini, /etc/php5/conf.d/pdo.ini, /etc/php5/conf.d/pdo_mysql.ini, /etc/php5/conf.d/pdo_sqlite.ini, /etc/php5/conf.d/sqlite3.ini, /etc/php5/conf.d/tokenizer.ini, /etc/php5/conf.d/xmlreader.ini, /etc/php5/conf.d/xmlwriter.ini |
| GD Support | enabled |
| GD headers Version | 2.1.1 |
| GD library Version | 2.1.1 |
| FreeType Support | enabled |
| FreeType Linkage | with freetype |
| FreeType Version | 2.6.3 |
| GIF Read Support | enabled |
| GIF Create Support | enabled |
| JPEG Support | enabled |
| libJPEG Version | 8 |
| PNG Support | enabled |
| libPNG Version | 1.6.21 |
| WBMP Support | enabled |
| XPM Support | enabled |
| libXpm Version | 30411 |
| XBM Support | enabled |
| WebP Support | enabled |
And the gd_info dump:
| <?php | |
| echo "<h1>gd_info</h1>"; | |
| $gdInfo = gd_info(); | |
| echo "<table>"; | |
| foreach($gdInfo as $key=>$value) { | |
| echo "<tbody>"; | |
| echo "<tr>"; | |
| echo "<td class='e'>" . $key . "</td>"; | |
| echo "<td class='v'>" . $value . "</td>"; | |
| echo "</tbody>"; | |
| } | |
| echo "</table>"; | |
| ?> |
| GD Version | 2.1.1 |
| FreeType Support | 1 |
| FreeType Linkage | with freetype |
| T1Lib Support | |
| GIF Read Support | 1 |
| GIF Create Support | 1 |
| JPEG Support | 1 |
| PNG Support | 1 |
| WBMP Support | 1 |
| XPM Support | 1 |
| XBM Support | 1 |
| WebP Support | 1 |
| JIS-mapped Japanese Font Support |
Too bad though: no information on where it sources the fonts from.
Having no solution for the font rendering yet, I focussed at the lack of profile picture.
In the past, the images were generated with gravatar information in the JSON, but now that is empty. See for instance the output of http://superuser.com/users/flair/1.json versus his image http://superuser.com/users/flair/1.png
| { | |
| "id": 1, | |
| "gravatarHtml": { | |
| }, | |
| "profileUrl": "http:\/\/superuser.com\/users\/1\/jeff-atwood", | |
| "displayName": "Jeff Atwood", | |
| "reputation": "14,561", | |
| "badgeHtml": "<span title=\"24 gold badges\"><span class=\"badge1\">●<\/span><span class=\"badgecount\">24<\/span><\/span><span title=\"79 silver badges\"><span class=\"badge2\">●<\/span><span class=\"badgecount\">79<\/span><\/span><span title=\"109 bronze badges\"><span class=\"badge3\">●<\/span><span class=\"badgecount\">109<\/span><\/span>" | |
| } |
That reveals quite a change in the JSON that imageFlair expects. Actually there is a lot of HTML in there.
So decided to try http://superuser.com/users/flair/1 in addition to http://superuser.com/users/flair/1.json with this result:
| <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd"> | |
| <html xmlns="http://www.w3.org/1999/xhtml"> | |
| <head> | |
| <meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> | |
| <style type="text/css"> | |
| .valuable-flair .userInfo .username a, .valuable-flair .mod-flair | |
| { | |
| color: #1086A4; | |
| } | |
| </style> | |
| <link rel="stylesheet" href="//sstatic.net/flair-Default.css" /> | |
| </head> | |
| <body> | |
| <div class="valuable-flair"> | |
| <div class="gravatar"> | |
| <a title="See my profile on Super User" target="_blank" href="http://superuser.com/users/1/jeff-atwood"><div class="gravatar-wrapper-50"><img src="https://www.gravatar.com/avatar/51d623f33f8b83095db84ff35e15dbe8?s=50&d=identicon&r=PG" alt="" width="50" height="50"></div></a> | |
| </div> | |
| <div class="userInfo"> | |
| <span class="username"><img src="http://superuser.com/favicon.ico" width="16" /><a href="http://superuser.com/users/1/jeff-atwood" target="_blank">Jeff Atwood</a><span class="mod-flair" title="moderator">♦</span></span> | |
| <br /> | |
| <span class="reputation-score" title="reputation score">14,561</span> | |
| <br /> | |
| <span title="24 gold badges"><span class="badge1">●</span><span class="badgecount">24</span></span><span title="79 silver badges"><span class="badge2">●</span><span class="badgecount">79</span></span><span title="109 bronze badges"><span class="badge3">●</span><span class="badgecount">109</span></span> | |
| </div> | |
| </div> | |
| </body> | |
| </html> |
Two downsides here:
Time for another rainy day (:
–jeroen
Posted in *nix, *nix-tools, bash, Development, Linux, openSuSE, PHP, Pingback, Power User, Scripting, Software Development, Stackoverflow, SuSE Linux | Leave a Comment »
Posted by jpluimers on 2017/04/05
A friend of mine made the mistake to capture some CDs using WMA files and throwing away the CDs. His old Nokia could play them, but not his new iOS and Android devices.
ffmeg and bash to the rescue:
find . -iname "*.wma" -execdir bash -c 'NAME="{}" && ffmpeg -y -i "$NAME" -ab 192k "${NAME/.wma/.mp3}" -map_metadata 0:s:0 && rm "$NAME"' \;
Tricks used:
Posted in *nix, *nix-tools, Audio, bash, bash, Development, ffmpeg, Media, Power User, Scripting, Software Development | Leave a Comment »
Posted by jpluimers on 2017/03/14
RegEx Fu
One of the things after moving most of my things from copy.com to Google Drive was the direct (public) download URLs that copy.com provides. DropBox has them as well, but Google Drive lacks them in the UI.
There is a URL format that does allow for direct download though:
While Google aims for Drive to be a competent Dropbox competitor, there’s one small but key feature that isn’t easy: sharing direct download links. Fortunately, you can create your own.
Source: Share Direct Links to Files in Google Drive and Skip the Web Viewer
You can do a similar replacement for Google Doc URLs: How to Create Direct Download Links for Files on Google Drive
The Google Drive conversion seems straightforward as they convert from either of
https://drive.google.com/file/d/FILE_ID/edit?usp=sharing
https://drive.google.com/file/d/FILE_ID/view
https://drive.google.com/open?id=FILE_ID
to
https://drive.google.com/uc?export=download&id=FILE_ID
There are tons of RegEx examples for doing the first conversion at Regex to modify Google Drive shared file URL – Stack Overflow, but
Since I’m a command-line person, I’ve opted for a sed conversion that wasn’t in the above list. I choose sed because it allows you to convert either a line or a complete file at one time.
There are a few indispensable resources to get my regex expressions right:
So here it goes, starting with fixing https://drive.google.com/open?id=FILE_ID as it’s the most simple replacement because the FILE_ID is at the end.
First of all, these code fragments below are part of bash functions as bash functions remove the quoting hell you have with bash aliases.
Where bash aliases have no parameters (i.e. the arguments are put after the end of the expansion), functions have parameters. So if you want to pass all function parameters to a command inside a function, you have to use “$@” to pass all parameters.
This fragment fixes https://drive.google.com/open?id=FILE_ID printing each fix on one line using the p for printing command in sed:
sed -n 's@https://drive.google.com/open?id=@https://drive.google.com/uc?export=download\&id=@p' "$@"
A few remarks:
& to \& as the ampersand has a special meaning in the replacement part of the sed expression: the “match” itself.The second fragment fixes https://drive.google.com/file/d/FILE_ID/edit?usp=sharing and https://drive.google.com/file/d/FILE_ID/view again printing each fix:
sed -n 's@https://drive.google.com/file/d/\([^.]*\)/.*@https://drive.google.com/uc?export=download\&id=\1@p' "$@"
Some more remarks:
\([^.]*\) and using the value in the replace with \1 as reference.\(.*?\) capturing group (sed can’t do that) but \([^.]*\)/ which matches any non-slash inside the capturing group until the first slash outside that group.The final part is combing both replacement into one sed command:
sed 's@https://drive.google.com/open?id=@https://drive.google.com/uc?export=download\&id=@;s@https://drive.google.com/file/d/\([^.]*\)/.*@https://drive.google.com/uc?export=download\&id=\1@' "$@"
Final remarks:
–jeroen
Posted in *nix, *nix-tools, bash, bash, Development, Power User, Scripting, sed, sed script, Software Development | Leave a Comment »
Posted by jpluimers on 2017/03/07
Nice: “you can get both aliases and functions with compgen -a -A function”
It uses the compgen completion generator. Simply brilliant (:
Source: bash – how do I list the functions defined in my shell? – Stack Overflow
–jeroen
Posted in *nix, *nix-tools, bash, bash, Development, Power User, Scripting, Software Development | Leave a Comment »
Posted by jpluimers on 2017/01/10
Getting the local IP (actually IPs, but most hosts only have a single IP):
# OS X:
alias whatismylocalip='ifconfig | sed -En '\''s/127.0.0.1//;s/.*inet (addr:)?(([0-9]*\.){3}[0-9]*).*/\2/p'\'''
# Linux:
alias whatismylocalip='ip a | sed -En '\''s/127.0.0.1//;s/.*inet (addr:)?(([0-9]*\.){3}[0-9]*).*/\2/p'\'''
I got them via bash – How to I get the primary IP address of the local machine on Linux and OS X? – Stack Overflow
Mac OS X and BSD have ifconfig, but most Linux distributions don’t use ifconfig any more in favour of iproute2, so you use ip a (which is shorthand for ip address show) there.
Their output is similar enough for the sed to work, though. Which surprised be because I didn’t know about the -E option (it lacks in the manual Linux page but it is in the Mac OS X one) which enables POSIX extended regular expressions. In Linux this is documented as -r, but -E also works.
I learned this through the Sed – An Introduction and Tutorial which compares the various versions of sed which also explains about the -n doing no printing.
–jeroen
Posted in *nix, *nix-tools, Apple, bash, bash, Development, Linux, Mac, Mac OS X / OS X / MacOS, Mac OS X 10.4 Tiger, Mac OS X 10.5 Leopard, Mac OS X 10.6 Snow Leopard, Mac OS X 10.7 Lion, MacBook, MacBook Retina, MacBook-Air, MacBook-Pro, MacMini, openSuSE, OS X 10.10 Yosemite, OS X 10.8 Mountain Lion, OS X 10.9 Mavericks, Power User, Scripting, Software Development, SuSE Linux, Tumbleweed | Leave a Comment »
Posted by jpluimers on 2016/11/01
If you see this in journalctl after boot in a VM, then you likely want to disable piix4 smbus device detection:
Jul 07 23:02:47 revue systemd-udevd[507]: maximum number (136) of children reached Jul 07 23:02:47 revue systemd-udevd[507]: maximum number (136) of children reached ... Jul 07 23:02:47 revue systemd-udevd[507]: maximum number (136) of children reached Jul 07 23:02:47 revue systemd-udevd[507]: maximum number (136) of children reached ... Jul 07 23:02:47 revue kernel: piix4_smbus 0000:00:07.3: SMBus Host Controller not enabled!
The solution is to add one line to /etc/modprobe.d/50-blacklist.conf (well: maybe [WayBack] add a comment line as well):
blacklist i2c_piix4
via:
–jeroen
Posted in *nix, *nix-tools, bash, bash, Development, Linux, openSuSE, Power User, Scripting, Software Development, SuSE Linux, Tumbleweed | 2 Comments »
Posted by jpluimers on 2016/10/20
The unix shell is hard, but boy, sometimes it can work like magic, for instance piping two testssl.sh commands into one gist:
retinambpro1tb:testssl.sh jeroenp$ ( ./testssl.sh --version ; ./testssl.sh --local ) | gist -d "testsll version and local ciphers for Mac OS X Darwin binarries supporting zlib"
https://gist.github.com/701496d7fbf929967aa1
The source of this magic was this AskUbuntu answer: How to merge and pipe results from two different commands to single command? – Ask Ubuntu
–jeroen
via: openssl.Darwin.x86_64 lacks zlib support · Issue #164 · drwetter/testssl.sh
Posted in *nix, *nix-tools, bash, bash, Development, Power User, Scripting, Software Development, Uncategorized | Leave a Comment »
Posted by jpluimers on 2016/09/14
The ESXi console top to show processes is not available *, the alternative is esxtop. But that can show garbage because the ESXi console has a very limited support of terminals **.
For instance, when connecting from a Mac OS X terminal through ssh, this is my terminal:
# echo $TERM
xterm-256color
The solution:
TERM=xterm esxtop
–jeroen
via: VMware KB: Output of esxtop defaults to non-interactive CSV with unknown TermInfo.
Posted in *nix, *nix-tools, bash, bash, Development, ESXi5, ESXi5.1, ESXi5.5, ESXi6, Power User, Scripting, Virtualization, VMware, VMware ESXi | 2 Comments »
The Wiert Corner - irregular stream of stuff 