Parallelize

[Hanse00]

As many parts of the program as possible should be written for parallelization, allowing them to be run at scale.

This parallelization should also be modular, allowing for use of different methods (Threads locally, Task Queue on GAE for example).

[Hanse00]

Some points that are ripe for parallelizing:

• Running the whole process for each user provided
• Loading each page from Lectio (Each week is one page)
• Writing each individual event to the calendar

Potential pitfalls:

• An event can show up twice, as it can span multiple weeks - In that case we may have duplicate events. Need to find a strategy for deduplicating that isn't blocking.