ssh_tunnel statistics: stakeclerk to screamer

Time: 2014-Sep-14 12:40:06 Sun

Current tunnel state: disabled          Current tunnel condition: DOWN

loader stats

------ loader (pid: 7324 ) ------------ (v3.26 2006/04/15) ----- State: disabled DOWN
Time:                2014-Jun-22 00:00:10 Sun
client:              stakeclerk
server:              screamer
client heartbeat:    Client Heartbeat
server heartbeat:    Server Heartbeat
server heartbeat 1:  Server Heartbeat 1
server heartbeat 2:  Server Heartbeat 2
server heartbeat 3:  Server Heartbeat 3
server heartbeat 4:  Server Heartbeat 4
Sleep time:          296
loader loop counter: 0
bad port tests:      0     last: none yet
failed file updates: 0     last: none yet
tunnels killed:      3     last: 2014-Jun-22 00:00:09 Sun
emails sent:         1     last: 2014-Jun-22 00:00:09 Sun
email addresses:     stakeadmin@nashuastake.dnsalias.org
loader started:      YYYY-MMM-DD HH:MM:SS DOW
debug flags:         0x40000000

tunnel stats

------ tunnel (pid: 6340 ) ------------ (v3.32 2011-05-01) ----- State: enabled UP
Time:                2013-Apr-20 21:42:28 Sat
client:              stakeclerk
server:              screamer
client heartbeat:    Sat Apr 20 21:42:27 EDT 2013
server heartbeat:    2013-Apr-20 21:37:29 Sat
Sleep time:          296
tunnel loop counter: 236
bad port tests:      0     last: none yet
emails sent:         1     last: 2013-Apr-20 02:22:34 Sat
email addresses:     john@larsen-family.us
tunnel started:      2013-Apr-20 02:23:06 Sat
debug flags:         0x40000000

Current users, uptime, and load average

 12:40:06 up 37 days, 16:16,  0 users,  load average: 0.00, 0.00, 0.00
USER     TTY        LOGIN@   IDLE   JCPU   PCPU WHAT

Current processes

UID        PID  PPID  C STIME TTY          TIME CMD
1004      7272  5576  0 00:00 ?        00:00:00 /usr/bin/perl -w /home/StakeAdmin/ssh_tunnel/tunnels/ssh_tunnel.pl
SYSTEM    2300     1  0 Aug07 ?        00:00:16 /usr/bin/cygrunsrv
1004      1992  4832  0 12:40 ?        00:00:00 /usr/bin/procps -edf
1004      4672   896  0 Aug10 ?        00:00:17 /usr/sbin/cron -n
1004       800  2908  0 00:00 ?        00:00:00 /usr/bin/email -s ssh: stakeclerk to tunnels: logfile: Rotating logfiles.  Killing tunnel and ssh links. stakeadmin@nashuastake.dnsalias.org
1004      4428  4672  0 Aug10 ?        00:00:13 /usr/sbin/sendmail -FCronDaemon -odi -oem -oi -t
1004      9304     1  0 12:40 ?        00:00:00 /usr/bin/perl -w /home/StakeAdmin/ssh_tunnel/tunnels/ssh_tunnel.pl
1004       896   540  0 Aug07 ?        00:00:43 /usr/sbin/cron -n
1004      5824   240  0 Aug10 ?        00:00:15 /usr/bin/email -s ssh: stakeclerk to screamer: logfile: Rotating logfiles.  Killing tunnel and ssh links. stakeadmin@nashuastake.dnsalias.org
1004      2908  7272  0 00:00 ?        00:00:00 sh -c cat /tmp/7272.email | /usr/bin/email -s "ssh: stakeclerk to tunnels: logfile: Rotating logfiles.  Killing tunnel and ssh links." stakeadmin@nashuastake.dnsalias.org
1004      3856  9680  0 12:40 ?        00:00:00 
1004      4832     1  0 12:40 ?        00:00:00 /usr/bin/perl -w /home/StakeAdmin/ssh_tunnel/screamer/ssh_tunnel.pl
1004      3400  4672  0 Aug10 ?        00:00:20 /usr/bin/perl -w /home/StakeAdmin/ssh_tunnel/screamer/ssh_tunnel.pl
1004      9944  9740  0 12:40 ?        00:00:00 
1004       540     1  0 Aug07 ?        00:00:14 /usr/bin/cygrunsrv
SYSTEM    2336  2300  0 Aug07 ?        00:00:24 /usr/sbin/sshd -D
1004       240  3400  0 Aug10 ?        00:00:16 sh -c cat /tmp/3400.email | /usr/bin/email -s "ssh: stakeclerk to screamer: logfile: Rotating logfiles.  Killing tunnel and ssh links." stakeadmin@nashuastake.dnsalias.org
1004      5476  3400  0 Aug10 ?        00:00:00 
1004      5620  9304  0 12:40 ?        00:00:00 
1004      5560  7272  0 00:00 ?        00:00:00 
1004      9740   896  0 12:40 ?        00:00:00 /usr/sbin/cron -n
1004      9680   896  0 12:40 ?        00:00:00 /usr/sbin/cron -n
1004      5576   896  0 00:00 ?        00:00:00 /usr/sbin/cron -n

Current netstat


Active Connections

  Proto  Local Address          Foreign Address        State
  TCP    LU-505579:1842         216.49.178.217:8194    ESTABLISHED
  TCP    LU-505579:1844         216.49.178.42:https    TIME_WAIT
  TCP    LU-505579:1845         216.49.178.42:https    TIME_WAIT
  TCP    LU-505579:1846         216.49.178.42:https    TIME_WAIT
  TCP    LU-505579:1850         173-14-166-5-NewEngland.hfc.comcastbusiness.net:22022  TIME_WAIT
  TCP    LU-505579:1851         173-14-166-5-NewEngland.hfc.comcastbusiness.net:ssh  TIME_WAIT
  TCP    LU-505579:4395         stakeclerk:4442        ESTABLISHED
  TCP    LU-505579:4423         stakeclerk:8194        ESTABLISHED
  TCP    LU-505579:4442         stakeclerk:4395        ESTABLISHED
  TCP    LU-505579:8194         stakeclerk:4423        ESTABLISHED
  TCP    LU-505579:1058         localhost:1060         ESTABLISHED
  TCP    LU-505579:1060         localhost:1058         ESTABLISHED
  TCP    LU-505579:4364         localhost:4366         ESTABLISHED
  TCP    LU-505579:4366         localhost:4364         ESTABLISHED
  TCP    LU-505579:4389         localhost:4390         ESTABLISHED
  TCP    LU-505579:4390         localhost:4389         ESTABLISHED

crontab file

# DO NOT EDIT THIS FILE - edit the master and reinstall.
# (/tmp/crontab.g8gIVhvRVM installed on Mon May 27 13:42:40 2013)
# (Cron version V5.0 -- $Id: crontab.c,v 1.12 2004/01/23 18:56:42 vixie Exp $)
#MAILTO=john@larsen-family.us
MAILTO=stakeadmin@nashuastake.dnsalias.org

#* * * * * echo "`date`: testing ssmtp"; echo `date` > /home/StakeAdmin/crontest.txt

# Run the backups
02 5 * * * /home/StakeAdmin/backup/backup.cron
#20 17 * * * /home/StakeAdmin/backup/backup.cron

# Keep the ssh tunnels up and running
0,10,20,30,40,50 * * * * /home/StakeAdmin/ssh_tunnel/screamer/ssh_tunnel.pl
0,10,20,30,40,50 * * * * /home/StakeAdmin/ssh_tunnel/tunnels/ssh_tunnel.pl

# Kill the sophos client firewall if it is running
00,10,20,32,40,50 * * * * /home/StakeAdmin/bin/kill_scf.pl

# Restart the sshd server in case it shutdown
2 0 * * *  /c/WINDOWS/system32/net start sshd

loader.conf file

# Filename:  loader.conf
# Description:  This is the configuration file for the loader portion of the 
# ssh_tunnel program.  The contents of this file never change.  This insures
# that the loader will always operate.  It is important not to change the 
# formatting of this file because it is read by the ssh_tunnel and processed 
# using perl which is expecting things to be in certain locations.
#
# loader.conf has two sections:
# 1. Configuration information such as the names of the ssh and sshd
#    hosts, the working directories on each host, and other data as needed.
# 2. The ssh host configuration for the loader program is in this file.
#    That configuration should never change.  It needs to be at the end
#    of the file because ssh uses everything between "Host" entries as
#    configuration.  There is only one Host section in this file.
#
########################################################################
# The following section contains host information 
# SSH_CLIENT      stakeclerk
# SSH_CLIENT_DIR  /home/StakeAdmin/ssh_tunnel/screamer
# SSH_SERVER      screamer
# SSH_SERVER_DIR  /home/tunnels/ssh_tunnel/stakeclerk
#
########################################################################
# The following section is the ssh config file for the loader program.
# IMPORTANT!  The path on the client MUST have the SSH_SERVER name in
# it.  The script uses this name is search strings and it MUST be there.
Host loader
HostName larsen-family.us
Port = 22
UserKnownHostsFile = /home/StakeAdmin/ssh_tunnel/screamer/known_hosts
User = tunnels
IdentityFile = /home/StakeAdmin/ssh_tunnel/screamer/id_rsa.stakeclerk

tunnel.conf file

# Filename:  tunnel.conf
#
# Description:  This is the configuration file for the tunnel portion of the 
# ssh_tunnel program.  The contents of this file can be changed during program execution.
# It is important not to change the formatting of the file because it is read by the
# tunnel program and processed using awk which is expecting things to be in certain
# locations.
#
# tunnel.conf has three sections:
# 1. Configuration information such as email addresses and thresholds.
# 2. The ssh host configuration for the tunnel.  This consists of two
#    host definitions, tunnel and heartbeat.  The tunnel is the permanent
#    connection and defines port forwarding.  The heartbeat uses one of 
#    the forwarded ports to write and copy heartbeat files between the
#    ssh client and the ssh server.  Changing heartbeats indicate that the
#    tunnel is functioning.
# 3. The webpage configuration section as described below.  This has the
#    ssh host configuration for updating a webpage on a webserver.
#
################################################################################
# The following section contains configuration information
#
# The tunnel is either "enabled" or "disabled" based on the value given
# below.  If disabled, then no processes are running on either the
# client or the server.  A cron job on the client runs ssh_tunnel.pl periodically
# to check if tunnel.conf has changed on the server.  If a change is detected
# then the new tunnel.conf file is transfered over.  If the tunnel state
# becomes "enabled" then the tunnel is activated.
# TUNNEL_STATE disabled
#
# The email addresses below receive diagnostic messages.  Separate
# multiple addresses with commas and no white space.  The word "none"
# turns off email sending and is the default.  The same email address
# is used by cron, loader, tunnel, and pulse.
# EMAIL_ADDRESS     stakeadmin@nashuastake.dnsalias.org
#
# The threshold defined below is how many port failures are required
# before an email is sent.  Set this to "none" to turn this off.  If
# the ssh_server's ssh port isn't accessible then the loader kills 
# the tunnel.  This periodic email serves as a reminder that the tunnel
# is down.
# EMAIL_THRESHOLD   50
#
# The loader, tunnel, and pulse programs all have the same sleep value.
# The sleep time can be changed here.  It should be in the range of
# 60 to 3600 seconds.  Shorter sleep times increase system loading.
# The sleep time must be less than half the crontab time for ssh_tunnel.pl.
# SLEEP_TIME        296
#
#
################################################################################
# The following section is the ssh config file for the tunnel program.
# IMPORTANT!  The path on the client MUST have the SSH_SERVER name in
# it.  The script uses this name is search strings and it MUST be there.
#
# Important info about port numbers used in the "ssh_tunnel" and "heartbeat"
# sections below.  The "heartbeat" Port number must be the same as the last
# two port numbers in the "ssh_tunnel" section.  In this example 50022 is
# used.  The port number used must be unused by anything else on the two
# machines.  If you have multiple tunnels connecting to a single ssh_server
# be sure to use different port numbers.  
#
# Another requirement is that the ssh_server must be configured to
# allow remote port forwarding.  This is normally off by default in the 
# ssh_server's sshd_config file.  Set "GatewayPorts yes" in sshd_config.
#
Host tunnel
HostName larsen-family.us
Port = 22
UserKnownHostsFile = /home/StakeAdmin/ssh_tunnel/screamer/known_hosts
User = tunnels
IdentityFile = /home/StakeAdmin/ssh_tunnel/screamer/id_rsa.stakeclerk
Compression = yes
RemoteForward = 33422 fhc-beast:22
RemoteForward = 33907 localhost:5907
RemoteForward = 33905 server:5905
RemoteForward = 33902 client2:5902
RemoteForward = 33903 client3:5903
RemoteForward = 33904 client4:5904
RemoteForward = 33022 localhost:22
LocalForward = 33022 localhost:22

################################################################################
Host heartbeat
HostName localhost
Port = 33022
UserKnownHostsFile = /home/StakeAdmin/ssh_tunnel/screamer/known_hosts
User = tunnels
IdentityFile = /home/StakeAdmin/ssh_tunnel/screamer/id_rsa.stakeclerk

################################################################################
Host pulse
HostName localhost
Port = 33022
UserKnownHostsFile = /home/tunnels/ssh_tunnel/stakeclerk/known_hosts
User = StakeAdmin
IdentityFile = /home/tunnels/ssh_tunnel/stakeclerk/id_rsa.stakeclerk

################################################################################
# Note: This section must be last in tunnel.conf.
# A webpage will be copied to the directory set by WEBSERVER_DIR below.  The
# default value "none" turns this feature off.  Change "none" to the directory
# path where the webpage should be copied.  The "webpage" host information 
# below must also be changed to valid values to make this work.
# WEBSERVER_DIR     /home/tunnels/ssh_tunnel_html
#
# The filename of the webpage copied to the webserver defaults to
# SSH_CLIENT_to_SSH_SERVER.html.  To choose a different name replace the
# word "default" on the line below with the desired name.
# WEBPAGE_FILENAME  default
#
# A copy of the webpage can be put in the directory define by WEBPAGE_LOCAL_DIR.
# Change "none" to a valid directory to enable this feature.
# WEBPAGE_LOCAL_DIR  /w/html/ssh_tunnel
#
# The webpage update rate defaults to once per sleep time. Change the value below
# to select a different rate.  The update rate is the number of times through the
# loader while loop before updating the webpage.  This value is ignored when events
# occur such as the tunnel going down or during startup.  The webpage is updated
# for all non normal runtime events.
# WEBPAGE_UPDATE_RATE   1
#
Host webpage
HostName larsen-family.us
Port = 22
UserKnownHostsFile = /home/StakeAdmin/ssh_tunnel/screamer/known_hosts
User = tunnels
IdentityFile = /home/StakeAdmin/ssh_tunnel/screamer/id_rsa.stakeclerk