python-m01.remote-0.5.1-1.lbn19.noarch

This package offers a remote processor. This remote processor is implemented as a simple object using the mongodb as storage. The processor can execute pre defined jobs in another thread. It is also possible to run jobs at specific time using the different scheduler items.

The RemoteProcessor uses two different processor. One processes jobs and the other pickes items from the scheduler and is adding jobs. This separation is useful if you implement a distributed concept. This means one or more application can schedule job items based on the given scheduler items. And another application is processing jobs and doesn't know about how to scheduling next items.

Since we use this remote scheduler for low CPU intensive jobs, we offer multi processing. This is done by running more then one worker in the main worker thread. If you use subprocess for your job processing, you will get a real multiprocessing processor which isn't limited to the current python process.

You can configure the amount of threads which a job worker can start in the remote processor. See jobWorkerArguments/maxThreads. By default this number uses the amount of CPU installed on your machine.

The implementation uses a mongodb as a storage for it's component. This means jobs, job factories and scheduler items get stored in the mongodb using the ORM concept given from m01.mongo.

See p01.remote for a ZODB based remote processor implementation but take care the p01.remote implementation doesn't provide the worker and scheduler processor separation. At least not yet.