downloadinf data from the web

Hi,

I wrote a code to download the data from the web when they are nicely listed as folders:

for example: <ftp://sidads.colorado.edu/pub/DATASETS/AMSRE/ADAP/L2_Land/>

but dont know what to do when the contents are like this:

http://oas.gsfc.nasa.gov/floodmap/index.html

I need to go box by box and download data from 1 t365 days. Please help me if you have any hint,

Thanks