Parallel requests versus batch size

Parallel requests are separate conversations the model handles at the same time.