FSFnet Internet Archive

specs

• definitely should be able to specify URL
• should it also do some keyword searching on various web engines?
• needs to return on periodic basis
• captures: i think whole directory structure but not offsite external links;
  • external links can be spidered to see if relevant
  • problem even with local directory structure -- free webhosting sites can often include links to other servers in the domain with the system's logo, ads, etc. ... ?

programming lnaguages

• perl
• python
• ???

samples to look at

• are there any sample programs (open source) preexisting we can adapt?

copyright & other legal considerations

• the code, if we adapt, should come from open source
• the code, if we adapt or write, should be released open source
• the archive itself presents its own copyright issues. s.107 and proposed revisions to s.108 provide a lot of cover for a "dark archive" -- one that just captures but does not distribute. we'll need policies etc.
• COPPA is a concern if minor-sourced content is authored
• other significant issues?