Questions tagged [parallelization]
Questions on parallel computing in Mathematica.
972 questions
2
votes
0
answers
52
views
How can I reduce RAM usage when using ParallelMap with large data?
I’m using ParallelMap on a very large dataset (millions of elements), but it quickly consumes all available RAM.
For example:
...
- 1,417
1
vote
0
answers
53
views
Parallelization on a cluster
I have the unique chance to run several tasks on a cluster with many cores and RAM. The problem is that it seems that my Mathematica code is not using all the power of 64 cores with 1024gb RAM that I ...
- 21
2
votes
0
answers
88
views
0
votes
0
answers
59
views
Configuring parallel kernels
I have Windows 11 and a CPU with 16 cores/32 threads. In Mathematica 14.2, I turn on "Local" and "Localhost" kernels in preferences, such that I have 32 subkernels.
Does it make ...
- 6,063
2
votes
1
answer
101
views
Do functions from a .m file loaded with Get automatically become available on all parallel kernels?
For a package, we use ParallelNeeds to make its functions available on all kernels for ParallelMap. For a ...
- 1,417
5
votes
3
answers
366
views
How does one parallelize WindingPolygon?
Consider this toy model: a list 100,000 simple point sets, and we Map WindingPolygon over it:
...
- 2,072
1
vote
0
answers
97
views
Timeout for subkernels using SLURM
I had previously been using a cluster with SLURM to run parallel computations with ParallelTable. However, it has randomly stopped working and I now receive the error:
...
- 413
0
votes
0
answers
59
views
Unexplained $Aborted in ParallelTable
I am trying to run the code:
ParallelTable[
FMwrapper[small[[i]]],
{i,20},
Method->"CoarsestGrained",
DistributedContexts->Full
]
...
0
votes
0
answers
67
views
Modify list defined globally in module when using ParallelMap
I have the following problem:
In order to use ParallelMap to apply a certain procedure/test to a list Range[0, nval - 1], I ...
- 75
6
votes
1
answer
326
views
How to release memory from parallel kernels?
I'm doing image processing in parallel kernels:
(I'm sorry, but it is impossible to construct a MWE for this, so I am including this code to indicate what I am doing)
...
- 7,554
4
votes
1
answer
166
views
ForeignFunctionLoad and parallel evaluation
Context and Goal: I have a program (written in Fortran, I think we can set it up to use the ForeignFunctionLoad C types) that I would like to run in parallel. The ...
- 872
11
votes
6
answers
496
views
How to stop Map or ParallelMap on first error and get the input that caused it?
I want to run a function using Map or ParallelMap over a large list of inputs, but I would like the evaluation to stop as soon ...
- 1,417
2
votes
0
answers
74
views
Why do plots exported from inside ParallelDo[] have red error overlay but no error?
I am processing some data and exporting the results as plots. It runs faster if I use a ParallelDo loop but then most of the plots get a red error overlay when exported. The plots do not get the ...
- 2,695
1
vote
0
answers
62
views
RegionPlot, parallel evaluations, and interpolations
Consider the following serial and parallelized computation of some regions:
...
- 6,063
6
votes
3
answers
450
views
Speeding up multiplication of matrix arrays by parallelization?
EDITED QUESTION:
I edit my question to be as clear as possible, as I find the problem quite confusing and severe, and the previous answers unfortunately not helpful.
I define two arrays of matrices ...
