Questions tagged [distributed-computing]
49 questions
31
votes
9 answers
Is there any way to distribute x264 encoding jobs across multiple computers (to increase the encoding speed)?
Does anyone know of a current, active solution to encoding x264 videos across many computers (via the network) to increase encoding FPS?
Brownie points for cross-platform and open source, but just so you all know, I usually use Windows.
Programs…
Breakthrough
- 34,847
5
votes
4 answers
Distributed, decentralized data sharing and backup
Consider the following scenario: you have a team of a few people scattered around the globe that needs to work on the same data. Each member of the team has a copy of the data he needs. When someone make changes to some of the data, he needs to have…
CAFxX
- 210
4
votes
1 answer
Distributed vs clustered vs networked file system
What is the differrence between a distributed file system, clustered file system and a network file system ?
Bandicoot
4
votes
2 answers
How do distributed filesystems differ from cluster filesystems?
How do distributed filesystems differ from cluster filesystems?
Is it just the wording that I am getting tripped up on? Are there any significant differences between the two.
Kaitlyn Mcmordie
- 769
- 1
- 7
- 20
3
votes
1 answer
Force most compilation to a remote host with distcc
The distcc FAQ states that there is currently no scheme for balancing or prioritizing hosts. They recommend to simply list the fastest host on top or the list.
The situation here is that the remote host is a lot more powerful than the host where…
Ярослав Рахматуллин
- 11,633
3
votes
0 answers
Manage processes on an distributed windows computer system
I want to manage the startup / re-start and shutdown of a multi module software system running on a set of windows machines.
For example:
[some machines booted, some still doing so]
run the whole system using a startup-process or a network command…
beutelfuchs
- 31
3
votes
2 answers
Distributed Compiling on Windows
I read about distcc for distributed compiling on Linux systems. Since I have to compile a big project quite often, I was wondering if there are methods on Windows on how to distribute that onto several machines. I found this website but it seems…
Michael S.
- 4,217
2
votes
0 answers
how to keep a distributed software up to date on Linux machines
I have my own distributed software running on few RasPi (20+) in different geographical locations, but every time i change something in my app, i have to update the excuteble in all Pi's manually, what are your suggestions to automate this process?
InsaneBot
- 131
2
votes
1 answer
Donate disk and CPU capacity to a third party?
Due to an impasse with one of our providers, we have come to have a non-trivial amount of CPU, and disk capacity that will stand unused for a number of months.
How can I find services that will, preferably over-utilize unused capacity?
c0dem4gnetic
- 125
- 5
2
votes
2 answers
DFS for a several small clusters over WAN
My friends and I all have TBs on our system(s). None of us have any full backups which are geographically distributed however, because at that amount of data, solutions such as Dropbox, S3, et al. are cost-prohibitive for us. However, each of us has…
user16511
2
votes
1 answer
How to put idle CPU processing power to good use?
I just got a new computer that has far more processing power than I need 90% of the time that I'm using it. To what ought I to devote that power?
I know of SETI @ Home and Protein Folding. What others are there? Favourites? Recommendations?
2
votes
1 answer
What are "multikernel computers"?
Which does the term 'modern multikernel computers' refer to? Distributed systems or multi-core computers?
I saw it in a one-line question, so no context to help! Google didn't help neither.
p00ya
- 131
1
vote
1 answer
Delete logs after consumption: logstash
I have logstash watching a directory on the host. Every time it sees a log that matches the path I specified in the logstash config it starts to import the data into my elasticsearch cluster. Does logstash have a way to delete the log after it is…
k to the z
- 133
1
vote
1 answer
How does distributed computing work?
I heard a 3D modeller say that when he renders a scene he uses multiple machines to do it because simply the hardware is not powerful enough and he is using the collective computational power of more than one machine. I know theoretically that it is…
Aelgawad
- 179
1
vote
4 answers
Problems when loop over a series of ssh-ed commands
I have a series of server machines which I want to run the same command on. Each command takes hours and (even though I am running the commands using nohup and setting them to run in the background) I have to wait for each to finish before the next…
JMzance
- 124