PARD: Utilities
Analog is a program to analyse the logfiles from your web server. It tells
you which pages are most popular, which countries people are visiting from,
which sites they tried to follow broken links from, etc.
Appindex is a perl script designed to retrieve information from freshmeat's
application index. It searches for a program (perl regexp accepted),
retrieves available info on that program, then optionally launches a browser
to view the homepage.
chpp is a general purpose preprocessor. It was designed originally for the
purpose of preprocessing HTML code but can be used successfully in other
fields of application as well. Highlights are, beside powerful language
constructs, CGI-scripting support and an SQL database interface.
curl is a tiny tool for getting a URL from a remote server. It supports the
HTTP, FTP, DICT, HTTPS and Gopher protocols as well as http-post, ftp
upload, passwords, portnumbers and proxies. It's the perfect tool for
automatic scripts that need the job done.
The ht://Dig system is a complete world wide web indexing and searching
system for a small domain or intranet. This system is not meant to
replace the need for powerful internet-wide search systems like Lycos,
Infoseek, Webcrawler and AltaVista. Instead it is meant to cover the search
needs for a single company, campus, or even a particular sub-section of a
web site.
Kticker is a news ticker widget that downloads news headlines from selected
sites and displays them on the screen periodically.
Linbot is the amazing Site Management Tool for webmasters. Linbot is a free
clone of Linkbot
and plans to incorporate many of Linkbot's features as well as enhancements
of its own.
Linbot allows webmasters to:
- View The Structure Of A Site
- Track Down Broken Links
- Find
Potentially Outdated Web Pages
- List Links Pointing To External Sites
-
View Portfolio Of Inline Images
- Do All This Periodically And Without User
Attention
Pavuk is an UNIX program used to mirror contents of WWW documents or files.
It transfers documents from HTTP, FTP, Gopher and HTTPS (SSL) servers.
This project started out when I needed a tool so that people could update
their web sites remote but without the need to enable insecure ftp and
telnet access. The tool would simple enable you to treat your web site as if
it were on your local hard disk but instead of a local file manager you
would use your web browser. Building it as a flexible remote file manager
seemed to be a good idea so it doesn't have to be used only in the purpose
of managing web sites. Piett's Remote File Manager (PRFM) rely on the
webserver's HTTP authentication and SSL for security.
urlmon makes a connection to a web site and records the last_modified time
for that url. Upon subsequent calls, it will check the url again, this time
comparing the information to the previously recorded times. Since the
last_modified data is not required to be given by HTTP (it's optional) and
is non-existent for ftp, urlmon will then take an MD5 checksum. Filtering is
possible, so that URLs whose content is always changing (due to server-side
parsing or some equivalent, as often used in rotating adverstisements) can
accurately be monitored.
It's real utility is evident when running it periodically (from cron, for
example) in batch mode, so as to keep tabs on many different web pages,
reporting on those that have recently changed.
It can monitor muliple URLs in parallel. It also has user settable proxy
server ability, and user settable timeout lengths. Finally, it can monitor
password protected www sites.
w3mir is a all purpose HTTP copying and mirroring tool. The main focus of
w3mir is to create and maintain a browsable copy of one, or several, remote
WWW site(s). Used to the max w3mir can retrive the contents of several
related sites and leave the mirror browseable via a local web server, or
from a filesystem, such as directly from a CDROM.
w3mir's goal is to be able to make useful mirrors of any reasonable WWW
site. It specifically preserves link integrity within the mirrored docuents
as well as the integrity of links outside the mirror, following redirects as
needed. If you want it to, w3mir has a powerful multi scope
mechanism enabling the user to make mirrors of several related sites and
have links between them refer to the mirrored documents rather than the
original site.
w3mir has several features directed at getting mirrors for CDROM burning and
handling of some not too often seen problems when mirroring.
w3mir supports HTML4, and has partial support for CSS, Java, ActiveX and
Adobe Acrobat (PDF) files. And it works on Win32 machines.
The Webalizer is a fast, free web server analysis program that produces HTML
output for viewing with a web browser. Produces detailed yearly, monthly,
daily and hourly statistics on URL's, sites, browsers and referrers visiting
your web server. Developed for Linux, but compiles on just about every *nix
platform from AIX to XENIX.
GNU Wget is a network utility to retrieve files from the World Wide Web
using HTTP and FTP, the two most widely used Internet protocols. It works
non-interactively, thus enabling work in the background, after having logged
off.
Wget has many features, such as recursive retrieval of Web and FTP sites,
regetting files from FTP and HTTP/1.1 servers, proxy support, norobots
support, native language support, personal and site-wide startup files and
more.
© 1999 by Stefan Hornburg
<racke@linuxia.de>
Last modified 03. June 1999
