See Also: Home Links Personal Site Blogroll  FriendFeed CV

Project Idea: Webmaster Toolkit

Command-line utility that provides a set of tool-kit like features commonly used in a webmastery role, should benefit folks who aren't familiar with intricacies of task (ease-of-use) as well as streamline tedious, repetitive tasks for well seasoned operators

Basically provide an abstraction layer over existing standard *nix o/s utilities (e.g. SED, WGET, PS, GROUPS etc) and add-ons (e.g. CPAN modules, Lib-XML, htmltidy etc) that has a consistent and uniting interface for all actions. Also store data and config in XML and report to XML formats for inter-op w other systems using XSLT for transformation.

More "most-things-to-all-people" than "all-things-to-all-people"

General features:

  • cron and interactive c/l portions
  • Perl based (+ CPAN modules)
  • open-source source-forge hosted
  • web fetch (w proxy, HTTPS, authentication support)
  • try to make (*nix) platform independent
  • API (.pl)
  • updates to Blogger API blogs (.pl)
  • XML-RPC/SOAP (.pl)
  • config file to determine which 3rd-party tools to integrate with
  • reporting to RSS/XML
  • inventory/infrastructure component reports

interactive features:

  • User reporting (groups, shares, disk usage)
  • HTML parsing (.pl)
  • FTP/SCP
  • read-only mode vs writeable admin mode
  • HTTP / SOAP header viewing
  • content tidying (htmltidy)
  • .htaccess / .htpasswd / .htgroup generator
  • DNS / nslookup query
  • LDAP / AD queries
  • web interaction replays (WWW-Mechanize or HTTP-Recorder)
  • unicode/entity/encoding conversion
  • link checking (W3C tools)
  • screen scraping (.pl)
  • XML parsing, querying, editing (.pl/libXML/XPath)
  • web server mngt
  • web server config
  • SQL (o/s, My-SQL, Post-Gres etc) database queries, mngt
  • file size/type/count reporting (find, locate, egrep)
  • file splitting, DOS-*NIX-MAC conversions
  • content-archiving (tar, gzip)
  • file search and content search/replace/archive (find, sed)
  • content TARing and migration between platforms (tar)
  • content dependency checking
  • spell-checking (iSpell)
  • template management

cronable features

  • system performance monitoring
  • email reports, status, traps
  • snapshot web usage reporting (~serverstatus)
  • snapshot log reporting
  • Browser usage reports
  • disk space monitoring
  • service pinging (e.g. httpd)

Similar projects:


See Also: Web Hosting | Web Development | Project Ideas | Notes Index