[ale] Bash/Python Question

[Omar Chanouha]

Hey all,

   I am creating an information gatherer for a school project. I have
a python file called gatherer that executes a bunch of python
downloader files. I also have a python file that parses the downloaded
information and places it into a database. Every day I want to execute
the following:

#!/bin/bash
gatherer.py
parser.py

Unfortunately, the gatherer only initializes a bunch of downloader
scripts. Therefore it exits just after the downloaders are
initialized, not after they are finished. This means that the parser
begins executing when the files are being downloaded, which of course
leads to the parser seeing a bunch of empty files.

Does anyone have a better solution than executing the parser at a
constant time after the downloader?

The gatherer looks something like:

for file in list:
 download.py file

I need the gatherer to work this way because I want the files to
download in parallel in order to speed up the process.

Thanks,

Omar