Case Studies

Problem: The client faced an issue with Apache Cassandra where an error occurred while building indexes. The error message was: Unexpected error while building indexes: Could not find type for id: 12297. The client had also partially configured dual data centers, which added complexity to the problem. Process: Initial Identification: The expert determined that the […]

Problem: The client is using kube-prometheus-stack version 44.2.1 as their monitoring solution, and Twistlock scans have identified vulnerabilities in various packages including github.com/docker/distribution (CVE-2023-2253), golang.org/x/net (CVE-2022-41723), github.com/emicklei/go-restful/v3, and Go language with CVEs such as CVE-2021-29923, CVE-2021-38297, CVE-2021-39293, CVE-2021-41771, CVE-2021-41772, CVE-2021-44716, CVE-2022-23772, CVE-2022-23773, CVE-2022-23806, CVE-2022-24675, CVE-2022-24921, CVE-2022-27664, CVE-2022-28131, CVE-2022-28327, CVE-2022-2879, CVE-2022-2880, CVE-2022-30580, CVE-2022-30630, CVE-2022-30631, CVE-2022-30632, CVE-2022-30633, […]

Problem: The client requested a solution to automate the update process for the Helm/Kubernetes compatibility matrix. It’s crucial to address this issue because relying on manual updates causes delays in the adoption of Helm and results in the use of outdated Helm versions. The lack of automation results in incomplete release notes and repeated postponements, […]

Problem: The client wanted to allow admins to reset user passwords without forcing the next login change. Process: The expert confirmed that FreeIPA didn’t respect the set attribute with –setattr=krbPasswordExpiration from the command line. It changed the password but the expiry date automatically adjusted to the value from global_policy `ipa pwpolicy-show`. The expert tried to […]

Problem: The client was experiencing issues with their Wiki.js application running on an AWS EC2 instance, utilizing PostgreSQL as the database and Docker for deployment. After a system crash, attempts to restart the application via the Docker Compose file resulted in errors. The client requested assistance in investigating the problem, stating that while the application […]

Problem: Our customer, using Opensearch (1 node) with SSL in their production environment, faced challenges while implementing a new node to ensure high availability. When individually pointing our application (Actone) to the new node, indexing and searching worked as expected. However, integrating both nodes simultaneously resulted in a – javax.net.ssl.SSLHandshakeException: Received fatal alert: certificate_unknown error […]

Problem: The client wanted to understand the logic behind the creation of SSTable (sorted string table) folders in Cassandra when data is written to a database table within a keyspace. Specifically, the question was about why each table has two directories in certain scenarios and how this logic affects the ability to achieve data backups […]

Problem: During a diagnostic call, it was observed that nodetool compactionstats was displaying 3,493 pending tasks related to the skyrt_prod1.event_state table. Despite new tasks being initiated and processed, these existing pending tasks remained uncleared, with no tasks currently in progress. This issue raised concerns about potential underlying problems with Cassandra’s compaction process. Solution: The accumulation […]

Problem: The client faced Spark issues during job submissions through Airflow. Out of 15 max DAGs that got triggered, there were always 3-4 dags getting triggered in the Initial state and never moving to the running state. A few DAGs also got stuck in the ContainerCreate state and never came up and ran. Process: Step […]