189 questions
120
votes
6
answers
105k
views
In Apache Kafka why can't there be more consumer instances than partitions?
I'm learning about Kafka, reading the introduction section here
https://kafka.apache.org/documentation.html#introduction
specifically the portion about Consumers. In the second to last paragraph in ...
- 8,018
69
votes
5
answers
75k
views
The lock supplied is invalid. Either the lock expired, or the message has already been removed from the queue
I'm using a Microsoft Azure Service Bus queue to process calculations and my program runs fine for a few hours but then I start to get this exception for every message that I process from then on. I ...
- 1,269
23
votes
1
answer
8k
views
Distributed tensorflow: the difference between In-graph replication and Between-graph replication
I got confused about the two concepts: In-graph replication and Between-graph replication when reading the Replicated training in tensorflow's official How-to.
It's said in above link that
In-...
- 1,247
53
votes
15
answers
42k
views
alternative to memcached that can persist to disk
I am currently using memcached with my java app, and overall it's working great.
The features of memcached that are most important to me are:
it's fast, since reads and writes are in-memory and don't ...
- 747
59
votes
3
answers
73k
views
Web Services vs EJB vs RMI, advantages and disadvantages?
My web server would be overloaded quickly if all the work were done there. I'm going to stand up a second server behind it, to process data.
What's the advantage of EJB over RMI, or vice versa?
...
43
votes
10
answers
51k
views
Best way to aggregate multiple log files from several servers [closed]
I need a simple way to monitor multiple text log files distributed over a number of HP-UX servers. They are a mix of text and XML log files from several distributed legacy systems. Currently we just ...
- 2,156
11
votes
7
answers
5k
views
How to correlate log events in distributed Vertx system
while doing logs in the multiple module of vertx, it is a basic requirement that we should be able to correlate all the logs for a single request.
as vertx being asynchronous what will be the best ...
- 1,146
12
votes
1
answer
11k
views
how to run tensorflow distributed mnist example
I am new to distributed tensorflow. I found this distributed mnist test in here:
https://github.com/tensorflow/tensorflow/blob/master/tensorflow/tools/dist_test/python/mnist_replica.py
But I don't ...
- 529
12
votes
2
answers
8k
views
Why is multi-paxos called multi-paxos?
Why multi-paxos is called multi-paxos? I can't see how it is "multi".
- 295
85
votes
2
answers
24k
views
Where does IPFS store all the data? [closed]
I've been trying to implement and understand the working of IPFS and have a few things that aren't clear.
Things I've tried:
Implemented IPFS on my system and stored files on it. Even if I delete the ...
- 1,001
77
votes
7
answers
57k
views
.net service bus recommendations? [closed]
We are in need of a distributed architecture messaging system/service bus with the capability of Publish/Subscribe. Does anyone have any reccomendations for a framework that we can use for .net ...
- 34.1k
28
votes
5
answers
4k
views
Can Haskell functions be serialized?
The best way to do it would be to get the representation of the function (if it can be recovered somehow). Binary serialization is preferred for efficiency reasons.
I think there is a way to do it in ...
- 1,877
28
votes
7
answers
8k
views
Anatomy of a Distributed System in PHP
I've a problem which is giving me some hard time trying to figure it out the ideal solution and, to better explain it, I'm going to expose my scenario here.
I've a server that will receive orders
...
- 155k
27
votes
3
answers
9k
views
How does asynchronous training work in distributed Tensorflow?
I've read Distributed Tensorflow Doc, and it mentions that in asynchronous training,
each replica of the graph has an independent training loop that executes without coordination.
From what I ...
- 1,070
26
votes
8
answers
44k
views
In C#, if 2 processes are reading and writing to the same file, what is the best way to avoid process locking exceptions?
With the following file reading code:
using (FileStream fileStream = new FileStream(fileName, FileMode.Open, FileAccess.Read, FileShare.None))
{
using (TextReader tr = new StreamReader(fileStream)...
- 10.8k