April 2026
M	T	W	T	F	S	S
	1	2	3	4	5
6	7	8	9	10	11	12
13	14	15	16	17	18	19
20	21	22	23	24	25	26
27	28	29	30

Archive for the ‘Scripting’ Category

Converting sendmail .db files to text

Posted by jpluimers on 2016/09/15

If you want to inverse the work of newaliases, you can use makemap to convert them to text:

makemap -u hash access.db

This is quite handy to see if the newaliases indeed put all information into the db file (for instance if you use a script, you can verify it ran correctly).

It works for any db, but you need to be aware of the database format: hash type or btree type.

To my knowledge only one uses the btree type format:

userdb.db

All others use hash type format:

aliases.db
aliases-maillist.db
mailertable.db
genericstable.db
virtusertable.db
access.db
auth-info.db
domaintable.db

–jeroen

via: Reading Sendmail .db files.

Posted in *nix, *nix-tools, bash, Development, Linux, openSuSE, Power User, Scripting, Software Development, SuSE Linux | Leave a Comment »

ESXi: when esxtop shows garbage.

Posted by jpluimers on 2016/09/14

The ESXi console top to show processes is not available *, the alternative is esxtop. But that can show garbage because the ESXi console has a very limited support of terminals **.

For instance, when connecting from a Mac OS X terminal through ssh, this is my terminal:

# echo $TERM xterm-256color

The solution:

TERM=xterm esxtop

–jeroen

via: VMware KB: Output of esxtop defaults to non-interactive CSV with unknown TermInfo.

Read the rest of this entry »

Posted in *nix, *nix-tools, bash, bash, Development, ESXi5, ESXi5.1, ESXi5.5, ESXi6, Power User, Scripting, Virtualization, VMware, VMware ESXi | 2 Comments »

Firebird gbak backing up a remote database that has spaces in the path and is on a remote Windows machine

Posted by jpluimers on 2016/09/13

I will likely need a batch file like this again:

setlocal
set gbakExe=C:\Program Files (x86)\Firebird\Firebird_2_5\bin\gbak.exe
set dbPart=MyDatabase
set dbSource=192.168.199.24:C:\Path with spaces\%dbPart%.fdb
set dbUser=sysdba
set dbPassword=masterkey
"%gbakExe%" -verify -transportable -user %dbUser% -password %dbPassword% "%dbSource%" %dbPart%.fbk
endlocal

You need the quotes around %gbakExe% and %dbSource% to ensure spaces in paths are preserved.

–jeroen

Sources:

Posted in Batch-Files, Database Development, Development, Firebird, Scripting, Software Development | Leave a Comment »

vim-cmd suspending/resuming a bunch of VMs

Posted by jpluimers on 2016/09/13

These two vim-cmd scripts come in very handy:

	#!/bin/sh
	VMS=`vim-cmd vmsvc/getallvms \| grep -v Vmid \| awk '{print $1}'`
	for VM in $VMS ; do
	# echo "Probing VM with id: $VM."
	PWR=`vim-cmd vmsvc/power.getstate $VM \| grep -v "Retrieved runtime info"`
	name=`vim-cmd vmsvc/get.config $VM \| grep -i "name =" \| awk '{print $3}' \| head -1 \| awk -F'"' '{print $2}'`
	echo "VM with id $VM has power state $PWR (name = $name)."
	done

view raw

esxi-show-power-state-of-all-VMs.sh

hosted with ❤ by GitHub

	#!/bin/sh
	# https://wiert.me/2021/04/30/vmware-esxi-console-viewing-all-vms-suspending-and-waking-them-up-part-5/
	RUNNING=0
	vmids=`vim-cmd vmsvc/getallvms \| sed -n -E -e "s/^([[:digit:]]+)\s+((\S.+\S)?)\s+(\[\S+\])\s+(.+\.vmx)\s+(\S+)\s+(vmx-[[:digit:]]+)\s*?((\S.+)?)$/\1/p"`
	for vmid in ${vmids} ; do
	# echo "Probing VM with id: $vmid."
	powerState=`vim-cmd vmsvc/power.getstate ${vmid} \| sed '1d'`
	name=`vim-cmd vmsvc/get.config ${vmid} \| sed -n -E -e '/$vim.vm.ConfigInfo$ \{/,/files = $vim.vm.FileInfo$ \{/ s/^ +name = "(.)",.?/\1/p'`
	vmPathName=`vim-cmd vmsvc/get.config ${vmid} \| sed -n -E -e '/files = $vim.vm.FileInfo$ \{/,/tools = $vim.vm.ToolsConfigInfo$ \{/ s/^ +vmPathName = "(.)",.?/\1/p'`
	# echo "VM with id ${vmid} has power state ${powerState} (name = ${name}; vmPathName = ${vmPathName})."
	if [ "${powerState}" == "Powered on" ] ; then
	RUNNING=1
	echo "Powered on VM with id ${vmid} and name: $name"
	echo "Suspending VM with id ${vmid} and name: $name"
	vim-cmd vmsvc/power.suspend ${vmid} > /dev/null &
	fi
	done

	while true ; do
	if [ $RUNNING -eq 0 ] ; then
	echo "Gone…"
	break
	fi
	RUNNING=0
	for vmid in ${vmids} ; do
	# echo "Probing VM with id: $vmid."
	powerState=`vim-cmd vmsvc/power.getstate ${vmid} \| sed '1d'`
	name=`vim-cmd vmsvc/get.config ${vmid} \| sed -n -E -e '/$vim.vm.ConfigInfo$ \{/,/files = $vim.vm.FileInfo$ \{/ s/^ +name = "(.)",.?/\1/p'`
	vmPathName=`vim-cmd vmsvc/get.config ${vmid} \| sed -n -E -e '/files = $vim.vm.FileInfo$ \{/,/tools = $vim.vm.ToolsConfigInfo$ \{/ s/^ +vmPathName = "(.)",.?/\1/p'`
	# echo "VM with id ${vmid} has power state ${powerState} (name = ${name}; vmPathName = ${vmPathName})."
	if [ "${powerState}" == "Powered on" ] ; then
	RUNNING=1
	echo "Waiting for id ${vmid} and name: $name…"
	fi
	done
	sleep 1
	done

	exit 0

view raw

esxi-suspend-all-VMs.sh

hosted with ❤ by GitHub

	#!/bin/sh
	SUSPENDED=0
	VMS=`vim-cmd vmsvc/getallvms \| grep -v Vmid \| awk '{print $1}'`
	VMstateToProcess="Suspended"
	for VM in $VMS ; do
	# echo "Probing VM with id: $VM."
	PWR=`vim-cmd vmsvc/power.getstate $VM \| grep -v "Retrieved runtime info"`
	name=`vim-cmd vmsvc/get.config $VM \| grep -i "name =" \| awk '{print $3}' \| head -1 \| awk -F'"' '{print $2}'`
	echo "VM with id $VM has power state $PWR (name = $name)."
	if [ "$PWR" == "$VMstateToProcess" ] ; then
	SUSPENDED=1
	echo "Suspended VM with id $VM and name: $name"
	echo "Resuming VM with id $VM and name: $name"
	# you'd think power.suspendResume is the inverse of power.suspend, but actually power.on is:
	vim-cmd vmsvc/power.on $VM > /dev/null &
	fi
	done

	while true ; do
	if [ $SUSPENDED -eq 0 ] ; then
	echo "Gone…"
	break
	fi
	SUSPENDED=0
	for VM in $VMS ; do
	PWR=`vim-cmd vmsvc/power.getstate $VM \| grep -v "Retrieved runtime info"`
	if [ "$PWR" == "$VMstateToProcess" ] ; then
	name=`vim-cmd vmsvc/get.config $VM \| grep -i "name =" \| awk '{print $3}' \| head -1 \| awk -F'"' '{print $2}'`
	echo "Waiting for id $VM and name: $name…"
	SUSPENDED=1
	fi
	done
	sleep 1
	done

view raw

esxi-resume-all-suspended-VMs.sh

hosted with ❤ by GitHub

–jeroen

Posted in bash, Development, ESXi4, ESXi5, ESXi5.1, ESXi5.5, ESXi6, Power User, Scripting, Software Development, Virtualization, VMware, VMware ESXi | Leave a Comment »

Modifying openssl to build on Mac without makedepend: using cc -M/gcc -M/clang -M

Posted by jpluimers on 2016/09/08

Coping with OpenSSL is frustrating on so many levels. It would be hilarious if not so many depended on it.

The main thing is that there is so much cruft in openssl but nobody seemingly to care enough about copying with that cruft. Though the intentions of the LibreSSL are great and it has far left cruft, it didn’t gain enough ground in the 2+ years it exists.

For me, the biggest problem was that OpenSSL would fail to build on “modern” OS X versions. These lack makedepend which was part of OS X, but got removed somewhere between 2006 and 8.0 in 2012. Luckily, the 2006 post also mentions the alternative: gcc -M.

Actually cc -M or clang -M work just as well as cc symlinks to clang and gcc calls clang with some parameters.

OpenSSL references makedepend in a lot of Makefiles (see list below). The good part is that config and Configure modify the Makefiles so most people use a manual workaround after running Configure or revert to a macports built or other binaries of makedepend or a homebrew formula.

That is not really an automated solution suitable for general use, let alone suitable for Continuous Integration, so I dug a bit deeper: config is a shell script and Configure is a sherl script: a cleverly crafted shell script starting with the below line invoking Perl with the rest of the script. The reason is that #! shebangs need an absolute location which for Perl can vary. A nice discussion on this trick is at Running Under Some Shell which contains a more elaborate how this works:

Read the rest of this entry »

Posted in bash, Development, Makefile, Perl, Scripting, Software Development | Leave a Comment »

A bash script to btrfs snapshot details like disk sizes (requires btrfs quota to be enabled)

Posted by jpluimers on 2016/09/06

One thing I’ve not figured out yet is this: How does enabling btrfs quotas impact the system? – Unix & Linux Stack Exchange

My gut feeling says it’s not much. But if someone knows: please chime in.

Anyway: btrfs quota support helps you to see how big snapshots (and other subvolumes) are.

Enabling and disabling is easy (the slash is the path from where to enable quota):

btrfs quota enable /

btrfs quota disable /

The bad thing is that there is no command that gives just the quota status. You have to revert to btrfs qgroup show /

This will show you quota groups when quota are enabled:

qgroupid         rfer         excl 
--------         ----         ---- 
0/5          16.00KiB     16.00KiB

or errors when quota are disabled either of these two errors:

# btrfs qgroup show /
ERROR: can't perform the search - No such file or directory
ERROR: can't list qgroups: No such file or directory

# btrfs qgroup show /
ERROR: can't list qgroups: quotas not enabled

You might also want to check the syslogs as there was a [PATCH 1/2] btrfs: syslog when quota is enabled.

The btrfs qgroup output is the base for agronick/btrfs-size: A script that will print out a list of BTRFS subvolumes along with their size in megabytes and their name.

It actually shows it in human readable form (kilo/mega/giga/… bytes) and is documented at Get the size of your BTRFS Snapshots | PoisonPacket. It gives me a nice overview that corresponds to the snapper list output (see below).

The script has two drawbacks:

when quota is disabled, you get this error:

./btrfs-size/btrfs-size.sh: line 55: can't + 0: syntax error: invalid arithmetic operator (error token is "'t + 0")

it can take a while for btrfs quota enable / to actually deliver the quota for all the qgroupid values snapper uses. Until that time, the columns ID/Total/Exclusive Data are empty.
it won’t warn you if the quota data is out of data; to check that, run the below script

# btrfs qgroup show / > /dev/null WARNING: Qgroup data inconsistent, rescan recommended

In that case, run btrfs quota rescan / and wait for it to complete by running this command until the warning is gone:

# btrfs qgroup show / > /dev/null WARNING: Rescan is running, qgroup data may be incorrect

If the warning reverts to WARNING: Qgroup data inconsistent, rescan recommended then you might see the effects from this bug and should not worry about it: Bug 933428 – btrfs qgroup – allways shows WARNING: Qgroup data inconsistent.

For more btrfs quota background information, see: UseCases – btrfs Wiki.

–jeroen

Read the rest of this entry »

Posted in *nix, *nix-tools, bash, Development, Linux, openSuSE, Power User, Scripting, Software Development, SuSE Linux, Tumbleweed | 1 Comment »

Perl: checking if makedepend is available without using File::Which

Posted by jpluimers on 2016/08/25

Long lasting open source projects often use makedepend to amend Makefiles with C header dependencies.

However, makedepend is old, not available on some systems (like Mac OS X or Windows) and can have different behaviour than the C compiler on those systems. The alternative usually is the -M switch on the C compiler.

In practice, either makedepend, or the alternative is available, so when prepping for a build you have to choose which one to use.

Some of those open source projects use Perl as a bootstrapper. I’ll write more about those boots trappers in the future, but first lets go back to the post title:

First detecting the availability of makedepend from Perl without relying on File::Which which isn’t installed by default on systems having Perl so a gated check-in build like this Travis build fails.

The trick I use is Perl backticks (aka qx) to try and execute makedepend merging the output of both stdout and stderr (using 2>&1 which is available on most shells). If there is no output, then the result is undef which means makedepend is not available.

	# http://perldoc.perl.org/perlop.html#Quote-Like-Operators
	# ensure to take the stdout and stderror so we get output like this:
	# 'makedepend: error: cannot open "Makefile.makedepend"
	#'.
	my $makedepend_output = `makedepend -f Makefile.makedepend 2>&1`;
	if (!$makedepend_output)
	{
	print "No makedepend executable found on your path.\n";
	}
	else
	{
	print "Output of makedepend: '$makedepend_output'.\n";
	}

view raw

does-makedepend-exist.pl

hosted with ❤ by GitHub

–jeroen

via:

Posted in Development, Perl, Scripting, Software Development | 1 Comment »

Update to List-Delphi-Installed-Packages.ps1 shows HKCU/HKLM keys and doesn’t truncated fields any more

Posted by jpluimers on 2016/08/24

I’ve posted an update to List-Delphi-Installed-Packages.ps1 that:

added HKCU/HKLM registry key values for each BDS version
doesn’t truncate fields any more when your console has limited width
is now in UTF-8 format so the BitBucket web-interface can show it

For the first two: Phry for helping me to force Format-Table to show more than 10 columns and pointing me how find out how to do this with Out-String so it doesn’t truncate fields; blog post about it will follow.

Now – as I can display more than 10 columns- I can start working in integrating all the other info about various BDS versions.

Source is at https://bitbucket.org/jeroenp/besharp.net/src/tip/Native/Delphi/Scripts/List-Delphi-Installed-Packages.ps1?fileviewer=file-view-default

A text dump of the current output is below with the Delphi versions including CompilerVersion, RTLVersion, VERXXX Define, DllSuffix and more.

–jeroen

via: If you need to know underlying information on Delphi versions « The Wiert Corner – irregular stream of stuff

Read the rest of this entry »

Posted in Delphi, Development, PowerShell, Scripting, Software Development | Leave a Comment »

List goals/targets in GNU make that contain variables in their definition – Stack Overflow

Posted by jpluimers on 2016/08/24

*nix systems tools often are have write-only maintenance tricks:

alias make-list-target='make -qp | awk -F":" "/^[a-zA-Z0-9][^$#\/\t=]*:([^=]|$)/ {split(\$1,A,/ /);for(i in A)print A[i]}"'

Like usual, I have only a vague idea what the regex expressions do.
–jeroen

via List goals/targets in GNU make that contain variables in their definition – Stack Overflow.

Posted in Awk, bash, Development, Scripting, Software Development | Leave a Comment »

reg files: Deleting Registry Keys and Values

Posted by jpluimers on 2016/08/10

The registry key deletion example from Microsoft is slightly wrong, as they wrapped the code over three lines:

[ -HKEY_LOCAL_MACHINE\Software\Test ]

That confuses some people, so here is the correct example:

[-HKEY_LOCAL_MACHINE\Software\Test]

The registry value deletion misses the square brackets, so that example should be like this:

[HKEY_LOCAL_MACHINE\Software\Test] "TestValue"=-

The original Microsoft article:

Deleting Registry Keys and Values

To delete a registry key with a .reg file, put a hyphen (-) in front of the RegistryPath in the .reg file. For example, to delete the Test subkey from the following registry key:

HKEY_LOCAL_MACHINE\Software

put a hyphen in front of the following registry key in the .reg file:

HKEY_LOCAL_MACHINE\Software\Test

The following example has a .reg file that can perform this task.

[ -HKEY_LOCAL_MACHINE\Software\Test ]

To delete a registry value with a .reg file, put a hyphen (-) after the equals sign following the DataItemName in the .reg file. For example, to delete the TestValue registry value from the following registry key:

HKEY_LOCAL_MACHINE\Software\Test

put a hyphen after the “TestValue”= in the .reg file. The following example has a .reg file that can perform this task.

HKEY_LOCAL_MACHINE\Software\Test

“TestValue”=-

To create the .reg file, use Regedit.exe to export the registry key that you want to delete, and then use Notepad to edit the .reg file and insert the hyphen.

–jeroen

via: How to add, modify, or delete registry subkeys and values by using a .reg file..

Posted in Development, Registry Files, Scripting, Software Development | Leave a Comment »

« Previous Entries

Next Entries »

	jpluimers on Position paper nachtsluiting D…
	Jeroen Wiert Pluimer… on Pie Comic by John McNamee: Mov…
	Attila Kovacs on Crowbarring Windows 95 into Wi…
	Jeroen Wiert Pluimer… on Does Odido (the old T-Mobile N…
	Lars Fosdal on Security alarm provider Woonve…

The Wiert Corner – irregular stream of stuff

Jeroen W. Pluimers on .NET, C#, Delphi, databases, and personal interests

Subscribe

Archives

Recent Comments

Recent Posts

Blog Stats

Meta title

Tag Cloud Title

Top Clicks

Top Posts

My badges

Twitter Updates

My Flickr Stream

Pages

All categories

Email Subscription

Archive for the ‘Scripting’ Category

Converting sendmail .db files to text

ESXi: when esxtop shows garbage.

Firebird gbak backing up a remote database that has spaces in the path and is on a remote Windows machine

vim-cmd suspending/resuming a bunch of VMs

Modifying openssl to build on Mac without makedepend: using cc -M/gcc -M/clang -M

A bash script to btrfs snapshot details like disk sizes (requires btrfs quota to be enabled)

Perl: checking if makedepend is available without using File::Which

Update to List-Delphi-Installed-Packages.ps1 shows HKCU/HKLM keys and doesn’t truncated fields any more

List goals/targets in GNU make that contain variables in their definition – Stack Overflow

reg files: Deleting Registry Keys and Values

Jeroen W. Pluimers on .NET, C#, Delphi, databases, and personal interests

Subscribe

Archives

Recent Comments

Recent Posts

Blog Stats

Meta title

Tag Cloud Title

Top Clicks

Top Posts

My badges

My Flickr Stream

Pages

All categories

Email Subscription

Archive for the ‘Scripting’ Category

Rate this:

Share this:

Rate this:

Share this:

Rate this:

Share this:

Rate this:

Share this:

Rate this:

Share this:

Rate this:

Share this:

Rate this:

Share this:

Rate this:

Share this:

Rate this:

Share this:

Rate this:

Share this: