The Wiert Corner – irregular stream of stuff

Jeroen W. Pluimers on .NET, C#, Delphi, databases, and personal interests

  • My badges

    Mastodon

  • Twitter Updates

  • Pages

  • All categories

  • Enter your email address to subscribe to this blog and receive notifications of new posts by email.

    Join 1,854 other subscribers

Archive for the ‘Linux’ Category

« Previous Entries
Next Entries »

My ZFS question on G+: investigation for using a XW6600 based system with ZFS.

Posted by jpluimers on 2014/12/20

My ZFS question on G+:

Hi everyone. I’m a geek. Learned most of the stuff by doing, and keeping tracks of what I did on my tech-blog http://wiert.me

I want to start with ZFS on a pair of HP XW6600 machines having 32gigabyte of RAM.
Any help on that is much appreciated.

The idea is to have one of these here in a closet and the other remotely, and perform replication between them (I’ve a 50megabit fiber-to-the-home uplink which can grow to 100megabit plus, internally my network is gigabit).

My current data is on a Windows 2003 x64 server with dual RAID5 configurations that are synced every night (not optimal for various reasons) with about 12gigabyte of files having mostly read-only access patterns and these kinds of sizes:
– small files between 4kilobyte and a few megabytes
– photos between 5 and 20 megabytes
– ISO backups and 7zip archives of projects (operating system installers, etc) between 100megabytes-6gigabytes
plus an ESXi machine having about 4gigabyte of data (mostly sizes between 20 and 200 gigabyte).

New storage should initially be at least 16gigabyte with room for growth.

I’m having active experience with OpenSuSE, ESXi and Windows. Solaris experience is from a long time ago. Learning by doing is my way of quickly gaining knowledge.

My schedule is doing research until the end of January (partially overlapping with a holiday) then building and testing until the end of Q1, going live early Q2.

Current plan is to put a lot of Samsung M9T 2terabyte SATA drives (they are only 9.5millimeter high) into the XW6600 rigs.
Earlier this year I did some research on controllers and hard drives, and I wonder how much of it is still current: https://wiert.me/2014/03/12/lots-of-2-5-3-5-and-5-25-conversion-brackets-and-hot-swap-bays/
(A quick calculation shows I should be able to get at least 14 externally accessible M9T drives into this machine, plus room for internal SSDs, etc).

So: where should I get started?

Initial questions I have:
– how about rebuild time when drives are lost? (how does the process of cold/hot spares work, can this be automated, how fast is it?)
– I’m not happy about the RAID5 rebuild times, so are 2TB drives indeed the sizes to go for?
– how about configuring things like ZFS equivalents of stripe size, buffer sizes, etc?
– what SATA controllers to use (is mainboard OK, what in addition to the mainboard SATA?)
– how can ZFS be used as an iSCSI target? how well does that work? (That would be really nice to connect to it from ESXi, Windows and many Linuxes/Linii)
– what about compression and block-deduplication?
– what about ZIP and L2ARC? how to estimate their size?
– which ZFS implementation to use? ZoL? OpenSolaris? Nexenta? Others?
– can a ZFS volume grow by adding extra drives?
(14 drives would get ~20terrabyte based on Z-3: http://www.servethehome.com/raid-calculator/ or http://wintelguy.com/raidcalc.pl but I want to have room for growth)

Lots of 2.5, 3.5 and 5.25 conversion brackets, cages and hot-swap bays

–jeroen

via: Hi everyone. I’m a geek. Learned most of the stuff by doing, and keeping tracks….

Posted in *nix, Hardware, HP XW6600, Linux, openSuSE, Power User, SuSE Linux, ZFS | 2 Comments »

running dig DNS under Windows

Posted by jpluimers on 2014/11/21

The dig (domain information groper) command under unix/Linux is a great way to help verify that a DNS host like BIND is working properly.

A few of my servers are Linux, but most of my desktops usually are Windows, so I was happy to find the Using the dig dns tool on Windows 7 article by Dan Esparza explaining there is a Windows version.

So I:

  1. Downloaded the Windows version of BIND (I took the BIND 9.9.2-P1 ZIP file)
  2. Unzipped that into my C:\BIN\BIND directory
  3. Ran this command, just like I would on a Linux box:
    dig @192.168.171.214 pluimers.com
  4. Checked the below output to the zone configuration on the openSUSE box serving the DNS for my domain

; <<>> DiG 9.9.2-P1 <<>> @192.168.171.214 pluimers.com
; (1 server found)
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 12911
;; flags: qr aa rd ra; QUERY: 1, ANSWER: 1, AUTHORITY: 5, ADDITIONAL: 6

;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags:; udp: 4096
;; QUESTION SECTION:
;pluimers.com.                  IN      A

;; ANSWER SECTION:
pluimers.com.           172800  IN      A       82.161.132.169

;; AUTHORITY SECTION:
pluimers.com.           172800  IN      NS      ns7.4delphi.com.
pluimers.com.           172800  IN      NS      ns6.4delphi.com.
pluimers.com.           172800  IN      NS      ns2.4delphi.com.
pluimers.com.           172800  IN      NS      ns1.4delphi.com.
pluimers.com.           172800  IN      NS      ns3.4delphi.com.

;; ADDITIONAL SECTION:
ns1.4delphi.com.        172800  IN      A       82.161.132.169
ns2.4delphi.com.        172800  IN      A       176.9.152.132
ns3.4delphi.com.        172800  IN      A       176.9.152.131
ns6.4delphi.com.        172800  IN      A       109.70.6.22
ns7.4delphi.com.        172800  IN      A       176.9.143.167

;; Query time: 15 msec
;; SERVER: 192.168.171.214#53(192.168.171.214)
;; WHEN: Wed Jan 02 16:07:58 2013
;; MSG SIZE  rcvd: 235

–jeroen

via Dig (command) – Wikipedia, the free encyclopedia.

Posted in *nix, Linux, openSuSE, Power User, SuSE Linux, Windows, Windows 7 | Leave a Comment »

Interesting thread about various file systems: BTRFS, ReiserFS, ext4

Posted by jpluimers on 2014/10/30

Be sure to read the comments at Chris Mason deklariert BTRFS als Stable, und Suse setzt es als Default für / in der neuen SLES ein….

Some of the comments provide great insight in the practical use of:

  • BTRFS
  • ReiserFS
  • ext3
  • ext4
  • LVM
  • Recoverry

(via: Kristian Köhntopp; Btrfs-Erfinder stuft sein Linux-Dateisystem als stabil ein | heise online. )

–jeroen

Posted in *nix, Linux, Power User, SuSE Linux | Tagged: | Leave a Comment »

Windows: authenticated command-line download from IIS server wget: no, cURL: yes.

Posted by jpluimers on 2014/10/03

Had to download a bunch of stuff over the command-line from an IIS server that was using authentication. Not basic authentication, but NTLM authentication.

wget kept failing, even wget 1.10 that usually does NTLM quite OK (but up to 1.10.2 has a security vulnerability so you should not use wget 1.10 any more).

So I installed a Windows x86 cURL binary, and downloaded+copied the root certificates, then did some reading on the command-line switches.

Without any, cURL does http basic authentication. But a Windows server usually expects NTLM authentication (hardly documented, but it uses the Negotiate protocol).

When not using NTLM, both would show (wget -d, or curl -v) this in the output, indicating you should use NTLM authentication: Read the rest of this entry »

Posted in *nix, *nix-tools, cURL, Linux, Power User, SuSE Linux, wget, Windows, Windows Server 2000, Windows Server 2003, Windows Server 2003 R2, Windows Server 2008, Windows Server 2008 R2 | Leave a Comment »

Solution for opensuse 12.2: yast “System Services (Runlevel): Services” very slow

Posted by jpluimers on 2014/09/26

Thanks to the wonderful people at the opensuse forums (especially Knurpht and wolfi323) for helping me out with opensuse 12.2: yast “System Services (Runlevel): Services” very slow: how to investigate.

The solution is to install openldap2, then reboot.

The easiest way is to perform this under sudo:

zypper install openldap2

Somehow in opensuse 12.2 yast, sendmail and apache depend on it (though the yast/zypper software installer don’t recognize the dependency).

Without the reboot, yast was still slow. Not sure why yet.

I will need to check this out in the most current opensuse release.

–jeroen

via:  opensuse 12.2: yast “System Services (Runlevel): Services” very slow: how to investigate.

Posted in *nix, Linux, openSuSE, Power User, SuSE Linux | Leave a Comment »

MINIX 3.3.0 is now available – Google Groups

Posted by jpluimers on 2014/09/20

Earlier this week: MINIX 3.3.0 is now available – Google Groups:

Hi all,

We are pleased to present the MINIX 3.3.0 stable release. The major new features & improvements of this release include:

New features

  • The first release with ARM support, three Beagle targets are supported
  • Experimental USB support for the Beaglebones (hubs & mass storage)
  • Cross-compiling for both ARM and x86 – the buildsystem is very portable

Improvements

  • Big source code cleanup – cleaner C types in messages, improved NetBSD compatibility, all minix-specific code moved to a top-level minix/ folder
  • Updated packages overall – a big set is built now; and they are dynamically linked now
  • Improved driver modularity

The full release notes can be found at http://wiki.minix3.org/Releases/3.3.0

To find out more about this and older releases, please see http://wiki.minix3.org/Releases.

You can grab the ISO image from the download page http://www.minix3.org/download

For instructions on the ARM build, see http://wiki.minix3.org/DevelopersGuide/MinixOnARM

Join us! See http://www.minix3.org/community/

We’re conducting a survey to find out about our audience. Please take our survey linked to the green box at the top of the minix3.org page.  Thanks!
On  behalf of the MINIX team

Andy Tanenbaum

–jeroen

via: http://bit.ly/minix330

Posted in *nix, Linux, MINIX, openSuSE, Power User, SuSE Linux | Leave a Comment »

interesting: YUMI – Multiboot USB Creator that understands both Windows and Linux

Posted by jpluimers on 2014/09/15

Ever wanted to put all your Windows installs on a bootable USB stick, but also add some Linux functionality?

It looks like YUMI can do just that.

On my research list (:

–jeroen

via: YUMI – Multiboot USB Creator (Windows) | USB Pen Drive Linux.

Posted in *nix, Linux, Power User, SuSE Linux, Windows, Windows 7, Windows 8, Windows Server 2008, Windows Server 2008 R2, Windows Vista, Windows XP | Leave a Comment »

Some notes on the Samsung UE40C6800 TV, PVR, decoding the PVR recordings and SamyGO extensions

Posted by jpluimers on 2014/09/10

After having recorded quite a few broadcastings to USB from my Samsung UE40C6800 TV with the T.VALDEUC 3011.0 firmware, I wanted to copy them over to either a Windows or Linux based machine for post editing.

Then I found out the USB device had been reformatted into XFS, probably because of its Guaranteed-rate I/O.

The first post I came across (SettoreZero: XFS filesystem and Samsung LEDTVs) indicated XFS is supported under Linux, but not under Windows (it appears the latter might be true).

So I went collecting useful links on which I will start doing deeper research in a few categories.

As it looks now, most of it will probably lead to various Linux shell scripts based on SamyGO.

General info:

XFS documentation:

Limux support:

Windows support:

SamyGO (selected with this particular TV in mind):

SamyGO forum:

–jeroen

via XFS – Wikipedia, the free encyclopedia.

Posted in *nix, Development, Linux, openSuSE, Power User, Software Development, SuSE Linux | 2 Comments »

software.opensuse.org: Install package isv:ownCloud:community / owncloud

Posted by jpluimers on 2014/08/31

On my research list: software.opensuse.org: Install package isv:ownCloud:community / owncloud.

Posted in *nix, Linux, openSuSE, Power User, SuSE Linux | Leave a Comment »

Linux: sudo, su and their options (via: Ask Ubuntu)

Posted by jpluimers on 2014/08/25

Applies to many Linux distros and explains a lot about sudo, su and their parameters: sudo – How to run a command as a user whose login is disabled? – Ask Ubuntu.

Posted in *nix, Linux, Power User, SuSE Linux | Leave a Comment »

« Previous Entries
Next Entries »