The Wiert Corner – irregular stream of stuff

Jeroen W. Pluimers on .NET, C#, Delphi, databases, and personal interests

  • My badges

  • Twitter Updates

  • My Flickr Stream

  • Pages

  • All categories

  • Enter your email address to subscribe to this blog and receive notifications of new posts by email.

    Join 1,861 other subscribers

Archive for the ‘Internet’ Category

Find the TTL for a domain and subdomain by getting to the authoritative nameserver first

Posted by jpluimers on 2018/11/15

Lets find the authoritative name server and TTL (time to live) for the example.org domain and www.example.org subdomain.

Notes:

1a: get parents of name servers

First start with a root server (dig: getting the list of root servers) to get parents of the name servers for example.org (don’t you love indirection!):

$ dig +norecurse +noall +authority @f.root-servers.net. example.org.
org.            172800  IN  NS  a0.org.afilias-nst.info.
org.            172800  IN  NS  a2.org.afilias-nst.info.
org.            172800  IN  NS  b0.org.afilias-nst.org.
org.            172800  IN  NS  b2.org.afilias-nst.org.
org.            172800  IN  NS  c0.org.afilias-nst.info.
org.            172800  IN  NS  d0.org.afilias-nst.org.

You can repeat this query for 2 more root servers to ensure they are in sync.

1b: get authoritative name servers from the parents

Now repeat with at least 3 of these to ensure they give matching results for the name servers for example.org:

$ dig +norecurse +noall +authority @b0.org.afilias-nst.info. example.org.
example.org.        86400   IN  NS  b.iana-servers.net.
example.org.        86400   IN  NS  a.iana-servers.net.
$ dig +norecurse +noall +authority @c0.org.afilias-nst.info. example.org.
example.org.        86400   IN  NS  a.iana-servers.net.
example.org.        86400   IN  NS  b.iana-servers.net.
$ dig +norecurse +noall +authority @a0.org.afilias-nst.info. example.org.
example.org.        86400   IN  NS  a.iana-servers.net.
example.org.        86400   IN  NS  b.iana-servers.net.

2a: getting the domain name servers from a public name server

A query to a public DNS server will also return a name server list, but then you would need to know that name server first. In addition, you can not ask for +authority; you have to ask for +answer NS in stead:

$ dig +norecurse +noall +answer NS @8.8.8.8 example.org.
example.org.        55312   IN  NS  a.iana-servers.net.
example.org.        55312   IN  NS  b.iana-servers.net.

The name servers on the list are not guaranteed to be authoritative, as this query returns an empty result:

$ dig +norecurse +noall +authority @8.8.8.8 example.org.

2b. ensuring the name servers are authoritative name servers

From the name servers returned, you can now check if the servers themselves return the same name servers. If so, then you are sure they are authoritative:

$ dig +norecurse +noall +authority @a.iana-servers.net. example.org.
example.org.        86400   IN  NS  a.iana-servers.net.
example.org.        86400   IN  NS  b.iana-servers.net.
$ dig +norecurse +noall +authority @b.iana-servers.net. example.org.
example.org.        86400   IN  NS  b.iana-servers.net.
example.org.        86400   IN  NS  a.iana-servers.net.

3: get the actual TTL

With the authoritative name servers, you can get the actual TTL:

$ dig +norecurse +noall +answer SOA @a.iana-servers.net. example.org.
example.org.        3600    IN  SOA sns.dns.icann.org. noc.dns.icann.org. 2017042729 7200 3600 1209600 3600
$ dig +norecurse +noall +multiline +answer SOA @a.iana-servers.net. example.org.
example.org.        3600 IN SOA sns.dns.icann.org. noc.dns.icann.org. (
                2017042729 ; serial
                7200       ; refresh (2 hours)
                3600       ; retry (1 hour)
                1209600    ; expire (2 weeks)
                3600       ; minimum (1 hour)
                )

I got the +multiline trick from [WayBackHOWTO: Using dig(1) to Find DNS Time to Live (TTL) Values – A-Team Systems.

4: get the count down TTL from a local name server

You can repeat the above process with a non-authoritative name server a few times to see the TTL decrease:

$ dig +norecurse +noall +answer SOA example.org.
example.org.        322 IN  SOA sns.dns.icann.org. noc.dns.icann.org. 2017042729 7200 3600 1209600 3600
$ dig +norecurse +noall +answer SOA example.org.
example.org.        321 IN  SOA sns.dns.icann.org. noc.dns.icann.org. 2017042729 7200 3600 1209600 3600

This is for instance what is returned by [WayBackexample.org DNS information – who.is example.org DNS information. DNS records such SOA, TTL, MX, TXT and more.

Public DNS servers having multiple servers per IP can even run disperse TTL numbers, for instance Google DNS at 8.8.8.8 does this:

$ dig +norecurse +noall +answer SOA @8.8.8.8 example.org.
example.org.        13  IN  SOA sns.dns.icann.org. noc.dns.icann.org. 2017042729 7200 3600 1209600 3600
$ dig +norecurse +noall +answer SOA @8.8.8.8 example.org.
example.org.        1388    IN  SOA sns.dns.icann.org. noc.dns.icann.org. 2017042729 7200 3600 1209600 3600
$ dig +norecurse +noall +answer SOA @8.8.8.8 example.org.
example.org.        10  IN  SOA sns.dns.icann.org. noc.dns.icann.org. 2017042729 7200 3600 1209600 3600

Note that +nssearch does not work for me

Using +nssearch as per [WayBackHow to find what Authoritative Name Server provided the answer using dig? – Server Fault fails for me:

$ dig +nssearch example.org
SOA sns.dns.icann.org. noc.dns.icann.org. 2017042729 7200 3600 1209600 3600 from server 199.43.135.53 in 83 ms.
SOA sns.dns.icann.org. noc.dns.icann.org. 2017042729 7200 3600 1209600 3600 from server 199.43.133.53 in 144 ms.
;; connection timed out; no servers could be reached

This reveals this in the bold values:

  • The authoritative nameserver sns.dns.icann.org is not publicly accessible.
  • TTL 7200 (7200 seconds is 2 hours).

Future research

Authoritative answers might not be present in dig queries on some platforms. I need to dig deeper into [WayBackterminal – Dig not returning authority section? – Ask Different to see why.

Glue records are always tricky to get right: [WayBackHow to check domain NS glue records using dig « Admins eHow

–jeroen

Posted in *nix, *nix-tools, bash, Development, dig, DNS, Internet, Power User, Scripting, Software Development | Leave a Comment »

Stratix BreedbandAtlas | Bekijk de consumentenbreedband dekking op uw locatie

Posted by jpluimers on 2018/11/09

[WayBack] BreedbandAtlas | Bekijk de consumentenbreedband dekking op uw locatie:

De BreedbandAtlas toont u actuele informatie over de dekking van consumentenbreedband in Nederland – zowel het type verbinding als de snelheid.

This is for consumer broadband connections, but for many businesses that is good enough (especially since players like xs4all and HeldenVanNu offer business plans like subnets, PIN-payment-over-IP).

Via: [WayBack] ‘Aanleg glasvezel groeit weer door lokale projecten en aanleg in buitengebieden’ – IT Pro – Nieuws – Tweakers

The site is by Stratix which also has published this fiber penetration chart over time:

Read the rest of this entry »

Posted in ADSL, fiber, Internet, Power User | Leave a Comment »

Wieso eigentlich PPPoE, Deutschland? Ganz früher, als Ihr noch ein Joghurt im Regal war…

Posted by jpluimers on 2018/11/05

An historic view on PPPoE usage: [WayBack] Wieso eigentlich PPPoE, Deutschland? Ganz früher, als Ihr noch ein Joghurt im Regal wart und die Telekom von ISDN mit Kanalbündelung (128kBit/s) auf DSL… – Kristian Köhntopp – Google+

Note that in The Netherlands:

Actually, xs4all DSL and Fiber use PPPoE too, in large part because it makes it easer for them to do IPv6. From https://www.xs4all.nl/service/diensten/internet/installeren/modem-instellen/hoe-kan-ik-een-ander-modem-dan-fritzbox-instellen.htm

<<<
ADSL
PPPoA (vpi/vci 8/48, vc-mux). Via de PPPoA verbinding loopt zowel IPv4 als IPv6 verkeer.
PPP authenticatie: PAP
• PPP credentials moeten ingevuld zijn (de waarden zijn niet belangrijk, maar er moet er wel iets ingevuld zijn)

VDSL en FTTH
PPPoE via VLAN6 (802.1Q). Via de PPPoE verbinding loopt zowel IPv4 als IPv6 verkeer.
• PPP authenticatie: PAP
• PPP credentials moeten ingevuld zijn (de waarden zijn niet belangrijk, maar er moet er wel iets ingevuld zijn)
RFC4638 wordt ondersteund op ons netwerk. Dit betekent dat u als klant een MTU van 1500 kunt gebruiken als uw router RFC4638 ondersteunt.
>>>

–jeroen

Posted in ADSL, fiber, Internet, Power User | Leave a Comment »

IPv4 to IPv6 conversion on a load balancer causing rare packet loss

Posted by jpluimers on 2018/11/02

Nice find on not so nice packet conversion: [WayBack] Fun with IPv6 We were investigating packet loss. The loss rate was very low (smaller than 1 of 1000) but as UDP was used, it caused rare but noticeab… – Martin Seeger – Google+

Basically the load balancer could not cope well converting empty IPv4 UDP checksums to IPv6 and back.

Or like Kris mentioned it: [WayBack] Null. In Zahlen: -1., causing a nice set of comments to be posted on short term solutions versus long time forgotten problems.

–jeroen

Posted in Internet, IPv4, IPv6, Network-and-equipment, Power User, routers | Leave a Comment »

Aside from the Wayback Machine, what are other options for getting screenshots of websites from the past? – Quora

Posted by jpluimers on 2018/10/15

I’ve used these myself:

There are many more listed in for instance these links:

IIPC OpenWayBack:

–jeroen

Posted in Internet, InternetArchive, Power User, WayBack machine | Leave a Comment »

Notes on recording audio calls from a Fritz!Box and playing back those captures calls

Posted by jpluimers on 2018/09/28

A while ago, I documented some links for In case I ever need to record calls on my Fritz!Box devices.

By now, I’ve done a bit more investigation: I’ve enabled the call monitor, did some port scans, installed domoticz and got deeper into fritzcap.

Oh and I got packet capturing to work too: Fritz!Box – capture network packets in Wireshark format or ISDN in dtrace format.

A small recap so I don’t forget what I did and what the effects were.

Enabling CallMonitor

[WayBackFritzbox – Domoticz showed how to enable the CallMonitor option in your Fritz!Box

  • Dial #96*5* to enable (response “CallMonitor On”)
  • Dial #96*4* to disable (response “CallMonitor Off”)
  • It seems not possible to ask for the current state (enabled/disabled)
  • After it is enabled, the TCP port 1012 on your Fritz!Box is available for tools like [WayBackDomoticz and fritzcap.

Read the rest of this entry »

Posted in *nix, Fritz!, Fritz!Box, Internet, Linux, openSuSE, Power User, SuSE Linux | Leave a Comment »

Fritz!Box – capture network packets in Wireshark (tshark/tcpdump) format or ISDN in dtrace format

Posted by jpluimers on 2018/09/24

You can capture network packets on a Fritz!Box for any interface by:

  1. appending `/html/capture.html` to the IP address of your Fritz!Box
  2. providing your credentials
  3. for ISDN traces optionally entering any dtrace parameters in the edit box
  4. pressing the Start button for the port you want to capture
  5. pressing the Stop button when you are finished capturing

Example URL: 192.168.178.1/html/capture.html

Note it’s ISDN [WayBackDtrace – Fritz!Box, not nx kernel [WayBackDTrace – Wikipedia

I’ve seen this on these devices:

  • Fritz!Box 7360 running FRITZ!OS 06.30
  • Fritz!Box 7490 running FRITZ!OS: 06.83

Note there are tons of tools allowing to capture from various scripting languages:

–jeroen

Read the rest of this entry »

Posted in Fritz!, Fritz!Box, Internet, Power User | Leave a Comment »

Satellite internet is awfully slow for interactive use

Posted by jpluimers on 2018/09/17

A while back, Thomas Mueller assumed that Satellite internet could be an alternative for rural areas in Germany: [WayBack> Auch der Internet-Anschluss über Satellit funktioniere allenfalls quälend langsam <Das kommt mir aber ziemlich seltsam vor… – Thomas Mueller (dummzeuch) – Google+ as a response to [Archive.isTelekom-Posse: Wirt soll eine Million Euro für schnelles Internet zahlen – WELT.

So I summed up what throttling to 600 (optimistic) or 1000 millisecond (realistic) latency on a 10 megabit connection means: awfully slow for interactive use.

The problem with satellite based internet is latency times: 500 milliseconds is the physical minimum for a geostationary connection. It can easily double with overbooked connections (default with consumer DSL/Cable/Fiber).

The latency combined with the very chatty nature of most applications, is the real killer for your experience.

Compare that to my speeds 2 years ago: https://wiert.me/2015/10/05/fiber-to-fiber-speed-beats-cable-to-fiber-speed-by-a-factor-2-all-three-internet-connections-are-in-the-same-house/

I just did a comparison with the fiber connection at my brother (who lives some 20 miles away) and work too and re-checked the fiber connections in the article (they stayed the same).

  • fiber 1 = home
  • fiber 2 = home
  • fiber 3 = brother
  • fiber 4 = work

Traceroute results:

  • fiber 1 to fiber 2: 5 milliseconds
  • fiber 3 to fiber 2: 8 milliseconds
  • fiber 4 to fiber 2: 4 milliseconds
  • cable to fiber 2: 10 millseconds
  • ADSL to fiber 2: 15 millseconds

With these, you can have > 50 connections per second.

Satellite gives you 2 connections per second if you are lucky.

The blog page takes ~160 web requests.

  • DOM content load ~ 1.0 seconds
  • Full load finished ~2.2 seconds
  • Render finished ~5.0 seconds

I throttled it down to Satellite speed:

  • 10 megabit downstream
  • 2 megabit upstream
  • 600 millisecond latency

Now this is the load:

  • DOM content load ~ 2.9 seconds
  • Full load finished ~9.9 seconds
  • Render finished ~10.0 seconds

Increasing the latency to 1000 milliseconds brings this:

  • DOM content load ~ 4.2 seconds
  • Full load finished ~11.8 seconds
  • Render finished ~14.9 seconds

Fully loading gmail.com or booking .com with 1000 millisecond latency takes over 30 seconds.
References:

Read the rest of this entry »

Posted in Internet, Power User | 2 Comments »

XS4ALL Software download site

Posted by jpluimers on 2018/09/14

When you want to download actual known amounts of bytes, then use the [Archive.isXS4ALL Software download site which has plenty of files in both sizes that are powers of 1024 and powers of 1000, so you can use the units that fits you best:

I usually run commands like these:

traceroute download.xs4all.nl & wget -O /dev/null http://download.xs4all.nl/test/2GiB.bin

traceroute download.xs4all.nl & wget -O /dev/null http://download.xs4all.nl/test/10GiB.bin

The first is for speeds up to ~100 megabit/second, the latter for speeds up to ~1 gigabits/second; wget examples based on [WayBacklinux – How do I request a file but not save it with Wget? – Stack Overflow.

From the xs4all shell servers, you have about 1 gigabit speed. At home it is about 80 gigabit.

Since the download is over a longer period of time, you get a better estimate of average speeds than regular speedtest varieties do.

[ ]100MB.bin               2014-05-28 22:18   95M  
[ ]100MiB.bin              2014-05-28 22:18  100M  
[ ]100mb.bin               2014-05-28 22:18   95M  
[ ]10GB.bin                2014-05-28 22:20  9.3G  
[ ]10GiB.bin               2014-05-28 22:20   10G  
[ ]10MB.bin                2014-05-28 22:19  9.5M  
[ ]10MiB.bin               2014-05-28 22:19   10M  
[ ]10gb.bin                2014-05-28 22:20  9.3G  
[ ]10mb.bin                2014-05-28 22:19  9.5M  
[ ]1GB.bin                 2014-05-28 22:20  954M  
[ ]1GiB.bin                2014-05-28 22:20  1.0G  
[ ]1MB.bin                 2014-05-28 22:19  1.0M  
[ ]1MiB.bin                2014-05-28 22:19  1.0M  
[ ]1gb.bin                 2014-05-28 22:20  954M  
[ ]1mb.bin                 2014-05-28 22:19  1.0M  
[ ]200MB.bin               2016-08-03 13:35  191M  
[ ]200MiB.bin              2016-08-03 13:35  200M  
[ ]2GB.bin                 2014-05-28 22:21  1.9G  
[ ]2GiB.bin                2014-05-28 22:21  2.0G  
[ ]2gb.bin                 2014-05-28 22:21  1.9G  
[ ]500MB.bin               2016-08-03 13:36  477M  
[ ]500MiB.bin              2016-08-03 13:35  500M

–jeroen

Posted in Internet, ISP, LifeHacker, Power User, SpeedTest, xs4all | Leave a Comment »

Privacy Badger was blocking fsdn.com CDN domains

Posted by jpluimers on 2018/09/14

Not sure why Privacy Badger blocked both fsdn.com and a.fsdn.com (if someone knows how to find that out: please let me know), but these are CDN domains are used by Slashdot and sf.net, so I have put a.fsdn.com from red to yellow (no cookies).

I have not unblocked s.fsdn.com, which redirects to sourceforge.net over TLS.

Related:

–jeroen

Read the rest of this entry »

Posted in Internet, Power User, Security | Leave a Comment »