polo/baseldosdados
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Tune DuckDB connection settings for better S3 query performance

Browse Source 
Add http_keep_alive, http_retries, preserve_insertion_order to _init_db().
Bump memory_limit from 4GB to 6GB to match available server RAM.
This commit is contained in:
rafapolo
2026-05-17 11:24:16 +02:00
parent d539736afc
commit 6bac1c2e34
1 changed files with 4 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
auth.py
View File

@@ -23,7 +23,10 @@ def _init_db():
SET s3_url_style='path'; SET s3_url_style='path';
SET enable_object_cache=true; SET enable_object_cache=true;
SET threads=4; SET threads=4;
SET memory_limit='4GB'; SET memory_limit='6GB';
SET preserve_insertion_order=false;
SET http_keep_alive=true;
SET http_retries=3;
""") """)
_con.execute("ATTACH '/app/data/basedosdados.duckdb' AS basedosdados (READ_ONLY)") _con.execute("ATTACH '/app/data/basedosdados.duckdb' AS basedosdados (READ_ONLY)")