1,720 questions
0
votes
1
answer
98
views
Parallelize asynchronous API calls in Python
I’m building a data ingestion pipeline in Python that collects data from a third-party REST API.
The API allows a maximum of 100 requests per minute, and I need to fetch data for tens of thousands of ...
- 214
1
vote
1
answer
110
views
Why are my asyncio HTTP requests not overlapping as expected for I/O?
I'm trying to make a bunch of HTTP GET requests to different endpoints of the same API. My understanding is that asyncio helps me manage concurrent I/O operations efficiently, meaning when one network ...
- 1
2
votes
0
answers
136
views
Memory leak in aioboto3 (aiohttp) after upgrading to Python 3.13
I’m seeing a steady memory increase in my ECS containers after upgrading Python and dependency versions.
The memory growth stops when I stop incoming gRPC requests, but it never drops back down ...
- 671
2
votes
1
answer
89
views
Fetch data concurrently within for loop using asnycio
I would like to optimize my current function called process_coordinates.
import asyncio
from aiohttp import ClientSession
from tqdm.asyncio import tqdm
import pandas as pd
from streetlevel import ...
- 121
4
votes
3
answers
397
views
How to limit asyncio HTTP requests to N per second while processing results immediately?
How can I throttle API requests in Python’s asyncio so that no more than 5 requests are sent per second, while still processing results as soon as they arrive?
I’m working with an asynchronous HTTP ...
user31226765
0
votes
0
answers
85
views
How can I trigger CVE-2024-30251 (aiohttp multipart/form-data DoS) with a minimal POC script? [Need a simple concrete example]
I am trying to reproduce CVE-2024-30251, a denial-of-service vulnerability in aiohttp (Python async web framework) that affects versions prior to 3.9.4. According to the advisories, this vulnerability ...
1
vote
0
answers
66
views
Polling + Webhook behind NGINX, slow updates on production
Setup:
Telegram bot built with aiogram (Python 3.10)
Main bot works via long polling
Additional bots (inviters) connect to the main bot
Inviters generate invite links to private channels and accept ...
- 11
-1
votes
1
answer
132
views
Python orchestration - Download and extract files concurrently using asyncio
I am using Python 3.12.3 + asyncio + aiohttp
Situation: I have multiple 7z files split into 1 Gib parts
Goal: download file_N parts AND (at the same time) extract already downloaded file_N-1 parts
...
0
votes
2
answers
399
views
Call async code inside sync code inside async code
I've found myself in a tricky situation which I can't seem to find my way out of:
I've written an application which uses asyncio (and, in particular, aiohttp).
In part of this application, I need to ...
- 888
0
votes
0
answers
182
views
aiohttp ClientConnectionError SSL shutdown timed out when closing Microsoft Graph connection
I’m using Python 3.11.11 and aiohttp 3.11.18 to talk to Microsoft Graph (endpoints like /sendMail and /delta). Every request completes successfully (I get 200 or 202), but as soon as aiohttp tries to ...
0
votes
1
answer
80
views
aiohttp what does timeout "ceil_threshold" do
What exactly does ceil_threshold in aiohttp's timeout parameters do, and when does it take effect? I tried setting it to a value smaller than connect and sock_read, but it didn’t seem to change ...
- 125
0
votes
0
answers
94
views
Bitunix API returns "Signature Error" (code 10007) when placing an order using aiohttp client in Python
I'm trying to integrate with the Bitunix API (https://openapidoc.bitunix.com/doc/common/introduction.html) using Python and aiohttp. I implemented authentication and signature generation as per the ...
- 474
0
votes
0
answers
27
views
python server / JS client: socketio regular disconnects
In trying to reproduce errors from a larger project I have created a server using python's aiohttp and the following python-socketio (v5.12.0) namespace:
class MyNamespace(AsyncNamespace):
...
0
votes
2
answers
73
views
How to make dynamic path that will be represented as list in aiohttp server?
Let's say that I have an example code:
from aiohttp import web
async def example(r):
a = r.match_info.get('a')
b = r.match_info.get('b')
c = r.match_info.get('c')
return web.Response(...
- 9,864
0
votes
0
answers
84
views
Bria API Slow Response Time (~40-60s per Image) When Processing 300+ Images Asynchronously in Python https://bria.ai/
I’m currently integrating the Bria API to remove backgrounds from video frames (images) in bulk using asynchronous Python code.
The setup works fine for a small number of images, but when I send more ...
