Problem: A Patroni-managed PostgreSQL cluster (PostgreSQL 15.8, Patroni 2.1.4) was reporting sustained high memory consumption on a host with ~275 GB of physical RAM and only ~8% free. The environment had HugePages enabled at the OS level. Patroni configuration showed shared_buffers=68GB, work_mem=20MB, max_parallel_workers_per_gather=4 and max_connections=2000. Observed behavior included consistently ~90% system memory utilization across a […]
Case Studies Data Management and Analytics Database 16 Mar 2026 Debezium MySQL CDC: handling tables with spaces in their namesProblem: A MySQL table named with embedded spaces (schema-qualified as “dbo.Customer Order Items”) could not be used in the Debezium connector’s message.key.columns setting. The connector configuration contained the entry “message.key.columns”: “dbo.Customer Order Items:id” and the connector validation rejected it with an invalid-format error referencing the expected pattern for message.key.columns. Attempts to escape characters in the […]
Case Studies Data Management and Analytics Data Analytics 3 Mar 2026 Resolving Partitioned Table Update Delays and Space Retention in PostgreSQLProblem: An application UPDATE statement against a partitioned PostgreSQL table (UPDATE tab1 SET sys_update_date = $1, agg_status = $2, output_filename = $3, merge_type = $4 WHERE period_key = $5 and record_id = $6) experienced consistent slowdowns in a nightly early‑morning window. The customer reported that partition file sizes showed normal small footprints for partitions p1–p12, […]
Case Studies Data Management and Analytics Database 25 Feb 2026 Resolving Redis timeouts caused by Redisson MapCache eviction and Lua blockingProblem: Applications using Redisson MapCache began throwing RedisResponseTimeoutException errors (client timeout = 3000 ms) during eviction activity. Errors were raised while executing EVALSHA with context pointing to org.redisson.eviction.MapCacheEvictionTask; application threads were reporting “Unable to evict elements” outputs correlated with redisson-timer-* threads. Environment details: a Redis Cluster (client traffic on shard port 7000) served multiple integration […]
Case Studies Data Management and Analytics Database 25 Feb 2026 Implementing Process-Group-Level RBAC in Apache NiFiProblem: A production team requested guidance to implement multi-tenancy and fine-grained RBAC in Apache NiFi so different users/groups would have isolated view and edit rights at the Process Group level. Requested capabilities included: allowing certain users to view and edit only a specific Process Group (no access to other canvas areas), defining Read‑Only vs Read/Write […]
Case Studies Data Management and Analytics Data Analytics 30 Jan 2026 PostgreSQL Predicate Pushdown OptimizationProblem: The customer reported degraded performance in a PostgreSQL query joining multiple views and tables, including V_PARTY_RELATIONSHIP. Although the outer query applied a highly selective filter (C.FIRST_PARTY_KEY = '<party_key>'), the PostgreSQL optimizer did not push this predicate into the view. As a result, the view was fully evaluated, leading to increased CPU usage, higher I/O, […]
Database 16 Jan 2026 Resolving Timezone Drift in Debezium CDC PipelinesProblem: A customer reported a critical production issue related to incorrect timestamp values in a data pipeline built using Debezium CDC. Timestamps originating from an MSSQL source system were appearing +05:30 hours ahead of the expected values in the downstream system. The issue affected multiple tables containing timestamp columns based on MSSQL date and time data types that do not […]
Case Studies 30 Dec 2025 Apache Airflow & Kubernetes: Job Creation Failures Caused by Stuck Deletions and FinalizersProblem: The client experienced repeated failures in two Apache Airflow DAGs responsible for launching Kubernetes Jobs. Each DAG followed a delete-and-recreate pattern using a fixed Kubernetes Job name. Although the Airflow task responsible for deleting the Job reported success, the subsequent Job creation consistently failed with a Kubernetes conflict error indicating that the Job already […]
Data Analytics 15 Dec 2025 OpenZFS: Repeated Kernel Warning Stack Traces Caused by Temporary Memory Pressure Under High LoadProblem: The client reported recurring kernel messages appearing in the system logs while running OpenZFS on a virtualized Linux server. Using dmesg -T, the customer observed approximately five identical stack traces per second, raising concerns about potential impact on production stability and data integrity. The log messages consistently referenced memory allocation paths within ZFS and […]
Storage