Case Studies

Problem: The client is experiencing failures during the copy/export process, resulting in Cassandra crashes and errors related to memory exhaustion. These failures occur due to incorrectly formatted date fields and memory-intensive processes involved in copy/export operations. Solution: Identification of Date Formatting Issue: The expert identified that the failures were caused by incorrectly formatted date fields […]

Problem: The problem is that commit logs in the production Cassandra cluster are accumulating excessively without being deleted, leading to a full filesystem and subsequent database crashes. Process: FreeIPA-Replication-Troubleshooting We have tried to reproduce the setup by performing the following actions. Installing FreeIPA Server on CentOS 7 server. Which had the default version of FreeIPA […]

Problem: There are two problems with Prometheus monitoring setup: the retention setting isn’t functioning correctly, leading to excessive data storage, and the Prometheus database is frequently getting corrupted, despite varying levels of workload and resource allocation across different environments. Process: Case Details: Environment 1: Approximately 23GB of data is generated in Prometheus across a 3-hour […]

Problem: During a migration from Kafka Streams 2.5.0 to 3.3.1, a client encounters a “Producer Fenced Exception” while processing aggregation tasks using a Processor in Kafka Streams. The issue occurs when attempting to update a State Store changelog topic, initiated by operations reading data from upstream and processing it with a punctuator. Process: Questions: Should […]

Problem: The client encountered an error in the apiservice v1beta1.custom.metrics.k8s.io, with the status showing “False” and a message indicating that the service/prometheus-adapter in a specific namespace is not listening on port 6443. The client provided details, including the helm chart files used for deployment, seeking a resolution as the issue persisted across AWS and Azure […]

Problem: The client seeks guidance on determining the appropriate value for the “index.mapping.total_fields.limit” parameter in Elasticsearch version 7.15.2. Process: Initial Query and Analysis: The client sought advice on determining the appropriate value for the index.mapping.total_fields.limit Elasticsearch parameter based on their data characteristics. Script Execution: An expert provided scripts (both in Bash and Python) to analyze […]

Problem: OpenSearch version 1.3.6 RCM OpenSearch DR(COB) High availability setup is not working in the Production environment and lower environment. For Production, the client has a 4-node cluster, out of which 50% availability cluster setup is configured. The client expects that when one node goes down, the other will take over as master. High Availability […]

Problem: Triggering DAGs from Dag_factory for the initial load was not successful. The Dag_factory indicates success, but Collectors did not trigger. As a workaround, when the client triggers the DAG directly from the SQL collector, the drivers come up and are running. Solution: In a series of meetings, the team addressed Airflow issues encompassing the […]

Problem: The key challenge emerged when the university aimed to implement Kerberos Single Sign-On (SSO) for FreeIPA and configure Keycloak to seamlessly connect with FreeIPA. Two significant updates revealed obstacles: an inability to access a third-party application for Kerberos installation and the absence of a topology or visual representation of the configuration. Additionally, the university […]