3. Implementation of asynchronous parallel iterative algorithms

Scientists who had studied asynchronous parallel methods theoretically were obviously very interested in the idea of being able to experiment with these methods at full scale. However, when these studies were launched, multi-processor machines were virtually non-existent.

The first experiments were therefore carried out by simulating parallel executions on single-processor machines. The first simulations were carried out in 1967 by J.L. Rosenfeld at the IBM Watson Center. Further simulations of asynchronous parallel executions were carried...