0
1
with Tags:
parallelism
X
X
All posts
Cloning Fan-In
Suppose you have a set of numbers S over which you define a function f.
Further suppose you partition S into S 1 and S 2 .
I’d like to know what function g is such that g({f(S 1 ),f(S 2 )}) = f(S).
As much to the point I’d like to understand which functions f even have a corresponding function
g that meets the condition.
Whoa! Was that pretentious enough for you?
Let me start... [More]
|
Two Kinds Of Pipes
It's been a while since I last posted here. And that's been more a matter of being incredibly busy than anything. Some of you will have seen me "on stage" - there having been several conferences and user groups recently. Some of you were with me at the zChampions meeting and some of you I'm actively working on customer situations with.
(By the way one of the rules of zChampions isn't... [More]
|
I Said "Parallelise Not "Paralyse" Part 4 - Implementation
Now with free map , this is the concluding part of a four part series on batch parallelisation, with especial focus on cloning.
In previous parts I discussed:
Motivation
Classification
Issues
This part wraps up with thoughts on implementation. I'm going to break it down into:
Analysis
Making Changes
Monitoring
While there probably are... [More]
|
I Said "Parallelise" Not "Paralyse" Part 3 - Issues
Part 1 and Part 2 were, in my opinion a little abstract. But I think they needed to be:
They set the scene for why parallelising your batch can be important.
They gave some vocabulary and semantics to help structure our thoughts.
Now we need to go a little deeper.
Let's start with how to think about the problem of making a job or set of jobs more parallel.
Hetereogeneous... [More]
|
I Said "Parallelise" Not "Paralyse" Part 2 - Classification
I hope you don't get the idea I'm overly into rigour, talking about Classification. But I think it has to be done - to provide terminology for this series of posts.
This is the second of four posts on Batch Parallelism, following on from
Motivation .
If I think about how parallelism works in batch it broadly falls into two camps:
Heterogeneous
Homogeneous
( If you look these... [More]
|
I Said "Parallelise" Not "Paralyse" Part 1 - Motivation
I have enormous trouble pronouncing "parallelise" right - and not saying "paralyse". It's true, and I bet many of you have the same trouble (sober or not). It's on a par with "red lorry yellow lorry" or "the Leith Police dismisseth us".
But it's a word I think we're going to have to get used to pronouncing right. And this post will explain why.
This... [More]
|
Batch Capacity Planning, Part 2 - Memory
I can't believe it's been almost a week since I wrote Batch Capacity Planning, Part 1 - CPU . Where did the time go? Re-reading it I'm struck by the overwhelming theme of Batch's unpredictability and lumpiness. This is true of memory, as well, but to a much lesser degree. Why to a lesser degree? Well, in most systems I look at the memory usage is mostly fairly constant and dominated by big... [More]
|
