Retry to ReUPing the networkd card

[Basher52]

We had a very short power loss at noon today, no more then half a second, but all our equipment rebooted.

Rebooting is a good thing, but since our ISP also had the power loss... and wasn't working until about 45 minutes later... when my gateway server was up and trying to reup the NIC,
it just tried once and since it couldn't get the IP from the DHCP server it didn't go up
... and here my question arises...

Is there something that I missed or don't know about that can make the NIC to retry like in every X minutes or so?
If not, can someone help me to create such a script, 'cos I suck at BASH and especially the very good thing called: awk

Since all our equipment sits behind the gateway server nothing can connect to the ISP network and thus... internet and if the gateway don't won't "go up"
so does nothing behind it.

[Void Main]

I think it should keep retrying if you have it set to DHCP. What do your logs show?

[Basher52]

well...
first, have no clue what log to look in, second... I was trying to UP the NIC like 10 seconds after it was done trying
so my patients wasn't like that good

[Void Main]

The DHCP log entries should be in /var/log/messages.

[Basher52]

Code: Select all

2011-03-07T12:23:14.432036+01:00 unknown ntpd[1246]: transmit: 192.168.67.255 key 42 not found
2011-03-07T12:23:24.025274+01:00 unknown smartd[2169]: Device: /dev/sda, 21 Currently unreadable (pending) sectors
2011-03-07T12:24:17.432017+01:00 unknown ntpd[1246]: transmit: 192.168.67.255 key 42 not found
2011-03-07T12:25:20.432054+01:00 unknown ntpd[1246]: transmit: 192.168.67.255 key 42 not found
2011-03-07T12:26:24.432029+01:00 unknown ntpd[1246]: transmit: 192.168.67.255 key 42 not found
2011-03-07T12:30:11.733332+01:00 unknown rsyslogd: [origin software="rsyslogd" swVersion="4.4.2" x-pid="1095" x-info="http://www.rsyslog.com"] (re)start
2011-03-07T12:30:11.705749+01:00 unknown rsyslogd: WARNING: rsyslogd is running in compatibility mode. Automatically generated config directives may interfer with your rsyslog.conf settings. We suggest upgrading your config and adding -c4 as the first rsyslogd option.
2011-03-07T12:30:11.715472+01:00 unknown rsyslogd: Warning: backward compatibility layer added to following directive to rsyslog.conf: ModLoad imuxsock
2011-03-07T12:30:13.985613+01:00 unknown acpid: starting up
2011-03-07T12:30:13.995594+01:00 unknown acpid: 1 rule loaded
2011-03-07T12:30:13.995736+01:00 unknown acpid: waiting for events: event logging is off
2011-03-07T12:30:15.535839+01:00 unknown automount[1242]: lookup_read_master: lookup(nisplus): couldn't locate nis+ table auto.master
2011-03-07T12:30:16.272317+01:00 unknown xinetd[1283]: xinetd Version 2.3.14 started with libwrap loadavg labeled-networking options compiled in.
2011-03-07T12:30:16.276024+01:00 unknown xinetd[1283]: Started working: 1 available service
2011-03-07T12:30:16.325999+01:00 unknown ntpdate[1294]: no servers can be used, exiting
2011-03-07T12:30:16.413557+01:00 unknown ntpd[1301]: ntpd 4.2.4p8@1.1612-o Wed Dec  9 11:49:22 UTC 2009 (1)
2011-03-07T12:30:16.425526+01:00 unknown ntpd[1302]: precision = 0.695 usec
2011-03-07T12:30:16.426091+01:00 unknown ntpd[1302]: Listening on interface #0 wildcard, 0.0.0.0#123 Disabled
2011-03-07T12:30:16.426270+01:00 unknown ntpd[1302]: Listening on interface #1 wildcard, ::#123 Disabled
2011-03-07T12:30:16.428519+01:00 unknown ntpd[1302]: Listening on interface #2 eth1, fe80::208:a1ff:fec5:1f53#123 Enabled
2011-03-07T12:30:16.429237+01:00 unknown ntpd[1302]: Listening on interface #3 lo, ::1#123 Enabled
2011-03-07T12:30:16.429656+01:00 unknown ntpd[1302]: Listening on interface #4 lo, 127.0.0.1#123 Enabled
2011-03-07T12:30:16.430098+01:00 unknown ntpd[1302]: Listening on interface #5 eth1, 192.168.67.250#123 Enabled
2011-03-07T12:30:16.430693+01:00 unknown ntpd[1302]: Listening on routing socket on fd #22 for interface updates
2011-03-07T12:30:16.432137+01:00 unknown ntpd[1302]: kernel time sync status 2040
2011-03-07T12:30:16.471135+01:00 unknown ntpd[1302]: frequency initialized -36.883 PPM from /var/lib/ntp/drift
2011-03-07T12:30:17.053548+01:00 unknown /usr/sbin/gpm[1345]: *** info [daemon/startup.c(136)]:
2011-03-07T12:30:17.053732+01:00 unknown /usr/sbin/gpm[1345]: Started gpm successfully. Entered daemon mode.
2011-03-07T12:30:17.426723+01:00 unknown ntpd[1302]: transmit: 192.168.67.255 key 42 not found
2011-03-07T12:30:19.687827+01:00 unknown avahi-daemon[1659]: Found user 'avahi' (UID 70) and group 'avahi' (GID 70).
2011-03-07T12:30:19.688319+01:00 unknown avahi-daemon[1659]: Successfully dropped root privileges.
2011-03-07T12:30:19.688983+01:00 unknown avahi-daemon[1659]: avahi-daemon 0.6.25 starting up.
2011-03-07T12:30:19.775277+01:00 unknown avahi-daemon[1659]: Successfully called chroot().
2011-03-07T12:30:19.775484+01:00 unknown avahi-daemon[1659]: Successfully dropped remaining capabilities.
2011-03-07T12:30:19.781488+01:00 unknown avahi-daemon[1659]: Loading service file /services/ssh.service.
2011-03-07T12:30:19.902543+01:00 unknown avahi-daemon[1659]: Joining mDNS multicast group on interface eth1.IPv4 with address 192.168.67.250.
2011-03-07T12:30:19.902998+01:00 unknown avahi-daemon[1659]: New relevant interface eth1.IPv4 for mDNS.
2011-03-07T12:30:19.903154+01:00 unknown avahi-daemon[1659]: Network interface enumeration completed.
2011-03-07T12:30:19.903276+01:00 unknown avahi-daemon[1659]: Registering new address record for fe80::208:a1ff:fec5:1f53 on eth1.*.
2011-03-07T12:30:19.903501+01:00 unknown avahi-daemon[1659]: Registering new address record for 192.168.67.250 on eth1.IPv4.
2011-03-07T12:30:19.904042+01:00 unknown avahi-daemon[1659]: Registering HINFO record with values 'I686'/'LINUX'.
2011-03-07T12:30:20.773724+01:00 unknown avahi-daemon[1659]: Server startup complete. Host name is unknown.local. Local service cookie is 1788427504.
2011-03-07T12:30:21.605305+01:00 unknown acpid: client connected from 1781[68:68]
2011-03-07T12:30:21.605581+01:00 unknown acpid: 1 client rule loaded
2011-03-07T12:30:21.641087+01:00 unknown avahi-daemon[1659]: Service "unknown" (/services/ssh.service) successfully established.
2011-03-07T12:30:40.831371+01:00 unknown smartd[2243]: smartd 5.39.1 2010-01-28 r3054 [i386-redhat-linux-gnu] (local build)#012Copyright (C) 2002-10 by Bruce Allen, http://smartmontools.sourceforge.net#012
2011-03-07T12:30:40.831703+01:00 unknown smartd[2243]: Opened configuration file /etc/smartd.conf
2011-03-07T12:30:40.873352+01:00 unknown smartd[2243]: Configuration file /etc/smartd.conf parsed.
2011-03-07T12:30:40.874276+01:00 unknown smartd[2243]: Device: /dev/sda, opened
2011-03-07T12:30:41.392037+01:00 unknown smartd[2243]: Device: /dev/sda, found in smartd database.
2011-03-07T12:30:41.803718+01:00 unknown smartd[2243]: Device: /dev/sda, is SMART capable. Adding to "monitor" list.
2011-03-07T12:30:41.804578+01:00 unknown smartd[2243]: Device: /dev/sdb, opened
2011-03-07T12:30:41.805029+01:00 unknown smartd[2243]: Device: /dev/sdb, IE (SMART) not enabled, skip device#012Try 'smartctl -s on /dev/sdb' to turn on SMART features
2011-03-07T12:30:41.805327+01:00 unknown smartd[2243]: Unable to register SCSI device /dev/sdb at line 33 of file /etc/smartd.conf
2011-03-07T12:30:41.805576+01:00 unknown smartd[2243]: Device /dev/sdb not available
2011-03-07T12:30:41.805959+01:00 unknown smartd[2243]: Device: /dev/sdc, open() failed: No such device
2011-03-07T12:30:41.806301+01:00 unknown smartd[2243]: Device: /dev/sdd, open() failed: No such device
2011-03-07T12:30:41.806626+01:00 unknown smartd[2243]: Device: /dev/sde, open() failed: No such device
2011-03-07T12:30:41.806966+01:00 unknown smartd[2243]: Device: /dev/sdf, open() failed: No such device
2011-03-07T12:30:41.807283+01:00 unknown smartd[2243]: Monitoring 1 ATA and 0 SCSI devices
2011-03-07T12:30:42.082833+01:00 unknown smartd[2243]: Device: /dev/sda, 21 Currently unreadable (pending) sectors
2011-03-07T12:30:42.084365+01:00 unknown smartd[2243]: Error retrieving getaddrinfo(unknown.host): Name or service not known
2011-03-07T12:30:42.084817+01:00 unknown smartd[2243]: Sending warning via mail to root ...
2011-03-07T12:30:42.429153+01:00 unknown smartd[2243]: Warning via mail to root: successful
2011-03-07T12:30:42.446226+01:00 unknown smartd[2251]: smartd has fork()ed into background mode. New PID=2251.
2011-03-07T12:31:22.426368+01:00 unknown ntpd[1302]: transmit: 192.168.67.255 key 42 not found
2011-03-07T12:32:28.426400+01:00 unknown ntpd[1302]: transmit: 192.168.67.255 key 42 not found
2011-03-07T12:33:31.426400+01:00 unknown ntpd[1302]: transmit: 192.168.67.255 key 42 not found
2011-03-07T12:34:22.723245+01:00 unknown avahi-daemon[1659]: Registering new address record for fe80::219:66ff:fe05:c8ed on eth0.*.
2011-03-07T12:34:23.001551+01:00 unknown dhclient[2575]: DHCPREQUEST on eth0 to 255.255.255.255 port 67
2011-03-07T12:34:24.426799+01:00 unknown ntpd[1302]: Listening on interface #6 eth0, fe80::219:66ff:fe05:c8ed#123 Enabled
2011-03-07T12:34:31.008128+01:00 unknown dhclient[2575]: DHCPREQUEST on eth0 to 255.255.255.255 port 67
2011-03-07T12:34:35.426349+01:00 unknown ntpd[1302]: transmit: 192.168.67.255 key 42 not found


Can say that this isn't all, 'cos this is all I can "tag" in "one" console screen, unless there is another way.
"Using SecureCRT to get to the console"

[Void Main]

Just grep for dhclient around the time of the power failure.

[Basher52]

Code: Select all

2011-03-07T12:34:23.001551+01:00 unknown dhclient[2575]: DHCPREQUEST on eth0 to 255.255.255.255 port 67
2011-03-07T12:34:31.008128+01:00 unknown dhclient[2575]: DHCPREQUEST on eth0 to 255.255.255.255 port 67
2011-03-07T12:34:46.015245+01:00 unknown dhclient[2575]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 5
2011-03-07T12:34:51.005146+01:00 unknown dhclient[2575]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 9
2011-03-07T12:35:00.009168+01:00 unknown dhclient[2575]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 15
2011-03-07T12:35:15.015169+01:00 unknown dhclient[2575]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 12
2011-03-07T12:35:27.012157+01:00 unknown dhclient[2575]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 10
2011-03-07T12:35:37.010156+01:00 unknown dhclient[2575]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 10
2011-03-07T12:35:47.010364+01:00 unknown dhclient[2575]: No DHCPOFFERS received.
2011-03-07T12:35:47.010521+01:00 unknown dhclient[2575]: Trying recorded lease x.x.x.x
2011-03-07T12:36:42.004015+01:00 unknown dhclient[2634]: DHCPREQUEST on eth0 to 255.255.255.255 port 67
2011-03-07T12:36:49.007164+01:00 unknown dhclient[2634]: DHCPREQUEST on eth0 to 255.255.255.255 port 67
2011-03-07T12:37:00.011203+01:00 unknown dhclient[2634]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 5
2011-03-07T12:37:05.005127+01:00 unknown dhclient[2634]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 5
2011-03-07T12:37:10.005169+01:00 unknown dhclient[2634]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 8
2011-03-07T12:37:18.008169+01:00 unknown dhclient[2634]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 12
2011-03-07T12:37:30.012171+01:00 unknown dhclient[2634]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 18
2011-03-07T12:37:48.018152+01:00 unknown dhclient[2634]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 11
2011-03-07T12:37:59.011148+01:00 unknown dhclient[2634]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 2
2011-03-07T12:38:01.002339+01:00 unknown dhclient[2634]: No DHCPOFFERS received.
2011-03-07T12:38:01.002382+01:00 unknown dhclient[2634]: Trying recorded lease x.x.x.x
2011-03-07T12:38:09.002983+01:00 unknown dhclient[2693]: DHCPREQUEST on eth0 to 255.255.255.255 port 67
2011-03-07T12:38:14.005129+01:00 unknown dhclient[2693]: DHCPREQUEST on eth0 to 255.255.255.255 port 67
2011-03-07T12:38:28.014207+01:00 unknown dhclient[2693]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 7
2011-03-07T12:38:35.007111+01:00 unknown dhclient[2693]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 12
2011-03-07T12:38:47.012127+01:00 unknown dhclient[2693]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 21
2011-03-07T12:39:08.021167+01:00 unknown dhclient[2693]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 21
2011-03-07T12:39:29.021341+01:00 unknown dhclient[2693]: No DHCPOFFERS received.
2011-03-07T12:39:29.021504+01:00 unknown dhclient[2693]: Trying recorded lease x.x.x.x
2011-03-07T12:41:15.001476+01:00 unknown dhclient[2755]: DHCPREQUEST on eth0 to 255.255.255.255 port 67
2011-03-07T12:41:23.008174+01:00 unknown dhclient[2755]: DHCPREQUEST on eth0 to 255.255.255.255 port 67
2011-03-07T12:41:33.010196+01:00 unknown dhclient[2755]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 5
2011-03-07T12:41:38.004431+01:00 unknown dhclient[2755]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 6
2011-03-07T12:41:44.005340+01:00 unknown dhclient[2755]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 10
2011-03-07T12:41:54.006786+01:00 unknown dhclient[2755]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 11
2011-03-07T12:42:05.011159+01:00 unknown dhclient[2755]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 8
2011-03-07T12:42:13.008166+01:00 unknown dhclient[2755]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 12
2011-03-07T12:42:25.012166+01:00 unknown dhclient[2755]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 9
2011-03-07T12:42:34.009353+01:00 unknown dhclient[2755]: No DHCPOFFERS received.
2011-03-07T12:42:34.009510+01:00 unknown dhclient[2755]: Trying recorded lease x.x.x.x
2011-03-07T12:43:43.001951+01:00 unknown dhclient[2815]: DHCPREQUEST on eth0 to 255.255.255.255 port 67
2011-03-07T12:43:46.003136+01:00 unknown dhclient[2815]: DHCPREQUEST on eth0 to 255.255.255.255 port 67
2011-03-07T12:43:51.005125+01:00 unknown dhclient[2815]: DHCPREQUEST on eth0 to 255.255.255.255 port 67
2011-03-07T12:44:03.012193+01:00 unknown dhclient[2815]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 5
2011-03-07T12:44:08.005106+01:00 unknown dhclient[2815]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 13
2011-03-07T12:44:21.013174+01:00 unknown dhclient[2815]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 15
2011-03-07T12:44:36.015157+01:00 unknown dhclient[2815]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 11
2011-03-07T12:44:47.011146+01:00 unknown dhclient[2815]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 7
2011-03-07T12:44:54.007155+01:00 unknown dhclient[2815]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 10
2011-03-07T12:45:04.010392+01:00 unknown dhclient[2815]: No DHCPOFFERS received.
2011-03-07T12:45:04.010560+01:00 unknown dhclient[2815]: Trying recorded lease x.x.x.x
2011-03-07T12:45:18.483072+01:00 unknown dhclient[2873]: DHCPREQUEST on eth0 to 255.255.255.255 port 67
2011-03-07T12:45:24.005646+01:00 unknown dhclient[2873]: DHCPREQUEST on eth0 to 255.255.255.255 port 67
2011-03-07T12:45:34.010202+01:00 unknown dhclient[2873]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 5
2011-03-07T12:45:39.005107+01:00 unknown dhclient[2873]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 11
2011-03-07T12:45:50.011114+01:00 unknown dhclient[2873]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 7
2011-03-07T12:45:57.007156+01:00 unknown dhclient[2873]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 11
2011-03-07T12:46:08.011151+01:00 unknown dhclient[2873]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 21
2011-03-07T12:46:29.021146+01:00 unknown dhclient[2873]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 6
2011-03-07T12:46:35.006340+01:00 unknown dhclient[2873]: No DHCPOFFERS received.
2011-03-07T12:46:35.006491+01:00 unknown dhclient[2873]: Trying recorded lease x.x.x.x
2011-03-07T12:48:44.796379+01:00 unknown dhclient[2936]: DHCPREQUEST on eth0 to 255.255.255.255 port 67
2011-03-07T12:48:50.005529+01:00 unknown dhclient[2936]: DHCPREQUEST on eth0 to 255.255.255.255 port 67
2011-03-07T12:49:10.020202+01:00 unknown dhclient[2936]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 3
2011-03-07T12:49:13.003086+01:00 unknown dhclient[2936]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 8
2011-03-07T12:49:21.008167+01:00 unknown dhclient[2936]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 20
2011-03-07T12:49:41.020161+01:00 unknown dhclient[2936]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 9
2011-03-07T12:49:50.009145+01:00 unknown dhclient[2936]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 18
2011-03-07T12:50:08.018147+01:00 unknown dhclient[2936]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 3
2011-03-07T12:50:11.003340+01:00 unknown dhclient[2936]: No DHCPOFFERS received.
2011-03-07T12:50:11.003491+01:00 unknown dhclient[2936]: Trying recorded lease x.x.x.x
2011-03-07T12:50:56.802856+01:00 unknown dhclient[2996]: DHCPREQUEST on eth0 to 255.255.255.255 port 67
2011-03-07T12:51:02.005307+01:00 unknown dhclient[2996]: DHCPREQUEST on eth0 to 255.255.255.255 port 67
2011-03-07T12:51:08.006198+01:00 unknown dhclient[2996]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 3
2011-03-07T12:51:11.003117+01:00 unknown dhclient[2996]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 7
2011-03-07T12:51:18.007115+01:00 unknown dhclient[2996]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 9
2011-03-07T12:51:27.009114+01:00 unknown dhclient[2996]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 10
2011-03-07T12:51:37.010110+01:00 unknown dhclient[2996]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 11
2011-03-07T12:51:48.011147+01:00 unknown dhclient[2996]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 20
2011-03-07T12:52:08.020150+01:00 unknown dhclient[2996]: DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 1
...


It looks like it retries but when that happens it's all my "fault" trying to reUP the NIC as I did all the time when I didn't have no network to the "outside".
Whenever I saw the 'ifup' ended I just tried again... and so on....