Questions tagged [parallel-processing]
Running multiple commands (or even computers) in parallel for more efficiency.
114 questions
0
votes
0
answers
60
views
Are xarg + cp vulnerabler to race conditions?
I'm experimenting with Docker images having 20-70 GiB in a single layer (yes, the software/compiler is so fat). To improve the download and decompression efficiency of Docker, I'm splitting this fat ...
0
votes
1
answer
209
views
Hardware multithreading results in concurrency, not paralllellism - why is this true?
This is from an old exam in my computer technology course:
True or False? Hardware multithreading results in concurrency and not in parallellism.
According to the answer key, the answer is "...
1
vote
1
answer
1k
views
Bash: execute in parallel some processes but wait the slowest
Hello I'm writing a bash script where I have to restore around 8+ big sets of ip with ipset-restore command.
Actually my shell script basically has a list like
ipset-restore < list1.txt
ipset-...
0
votes
1
answer
194
views
What differences are between ""multiprocessor" and "parallel processors"?
I was wondering what differences are between ""multiprocessor" and "parallel processors", in general?
I saw them in Stallings' Computer Organization and Architecture (see the ...
1
vote
1
answer
2k
views
How to run the powershell script simultaneously on multiple computers
I am trying to run the PowerShell script, which I have, on multiple computers simultaneously. Currently, I'm using PowerShell version 5.
I want to know is it possible to run it without background ...
1
vote
1
answer
395
views
Why do SIMD CPU extensions exist?
As I understand the problem there are problems that can be heavily parallelized, e.g. rendering, video decoding. Since CPUs are not excelling in such tasks GPU were created. They use different ...
3
votes
2
answers
1k
views
Why does a Python script using PyTorch only use 6 out of 12 cores?
I run Whisper on an Intel-Mac with an Intel Core i7-CPU (Whisper doesn't seem to support AMD Radeon GPUs at the moment, hence I use CPU). When I run Whisper on this computer when it otherwise mostly ...
1
vote
0
answers
224
views
Powershell: script won't run in parallel [closed]
I have the following script. It will run without a problem when it is not in parallel. But when I add -Parallel it throws all kinds of errors. The primary error seems to relate to Cannot index into a ...
1
vote
1
answer
351
views
get parallel ssh output in order but use parallelism
With parellel-ssh -i -h hosts.ini "uptime" I can get the uptime from all hosts in hosts.ini. But they appear in order of the batches and first answers. I would like to have the result ...
0
votes
1
answer
93
views
Parallel processing implementation
I received an very old program in my company that need to be refactored. The code is a bunch of SQL instructions that are orchestred by a program written as shell commands with the objective of doing ...
1
vote
0
answers
475
views
Connecting two desktops by an infiniband interconnect
I am a scientist working in a high performance computing project(the computational programming aspect) and I have no idea of networking or networking hardware required to answer my question. A ...
1
vote
1
answer
271
views
How can I stop Ubuntu 20.04 from restricting my cpu space?
After installation of Ubuntu 20.04 everything was working well. However, after installing and using some applications (Matlab and Matlab/Dynare) Ubuntu seems to limit my cpu usage. I use openMP and a ...
1
vote
1
answer
3k
views
Can any program be run on multiple cores? Will the CPU decide that? Or can only certain programs run on multiple cores?
So I'm a little confused about the multicore CPUs - the impression I was initially under and what I thought I heard before was that some programs can't be run across multiple cores - those in which ...
0
votes
1
answer
2k
views
Parallel processing and order of execution with recursive loop
If i run a script that processes a path recursively using parallel processing to execute a command on the whole tree if items, am I guaranteed that the commands I use will be executed on all items in ...
0
votes
1
answer
838
views
PowerShell: Script throwing up in parallel
When run in -Parallel, the following script does not pass the $basePath variable declared before the start of the parallel block. Instead, it is a null value. This is not a problem when the script is ...