Data Analytics

Problem: The client experienced issues setting up a second node for high availability in their OpenSearch cluster. While the first node worked properly, the second node encountered SSL handshake errors when both nodes were used simultaneously. Process: The expert reviewed the client’s YML configurations and SSL certificate setups. They provided detailed feedback on correcting SSL […]

Problem: The client reported an issue and requested support to address potential vulnerabilities. A security issue was identified in an Apache Airflow instance, version 2.5.0, involving the absence of an account lockout mechanism. Solution: Our expert identified two key measures to enhance Airflow security and responded to the client’s request with the following recommendations: Implementing […]

Problem: Our customer, using Opensearch (1 node) with SSL in their production environment, faced challenges while implementing a new node to ensure high availability. When individually pointing our application (Actone) to the new node, indexing and searching worked as expected. However, integrating both nodes simultaneously resulted in a – javax.net.ssl.SSLHandshakeException: Received fatal alert: certificate_unknown error […]

Problem: The client faced Spark issues during job submissions through Airflow. Out of 15 max DAGs that got triggered, there were always 3-4 dags getting triggered in the Initial state and never moving to the running state. A few DAGs also got stuck in the ContainerCreate state and never came up and ran. Process: Step […]

Problem: The client seeks guidance on passing multiple configuration files to Prometheus Adapter (P8s) version v0.11.1 without encountering size limitations or performance issues. They aim to aggregate custom metrics efficiently across microservices in Kubernetes. Process: The experts discussed various aspects of configuring Prometheus Adapter, addressing concerns such as size limitations with config maps and optimizing […]

Problem: The client, operating a Kafka Streams application version 3.3.1, encountered significant issues with managing changelog topics. Despite configuring the application for automatic record cleanup, the changelog topics exhibited unchecked growth. This accumulation of records risked deteriorating system performance and stability, potentially impacting the application’s reliability. Process: Initial Assessment: Issue Reporting: The client highlighted problems […]

Problem: The client reported several security vulnerabilities in Airflow version 2.5.0, including weak password policies such as allowing passwords with less than 8 characters, lack of password expiration, and absence of enforced password changes during the first login. These weaknesses compromise overall system security and user account integrity. Solution: To address these issues, the expert […]

Problem: The client reported a critical issue with Solr 6.6.5, where Solr cores were becoming corrupt when new data was pushed through the Data Import Handler (DIH). This issue led to significant data loss and functionality impact, as existing indexed data became inaccessible, resulting in zero search results despite having content in Solr. Process: Step […]

Problem: Airflow login failed with an “Invalid login” prompt for the user “admin” in production. The environment details are as follows: Helm version 1.9.0 and Airflow Image version 2.6.3. The expected outcome was a successful login. Solution: Identify the Issue: The problem was related to login issues with the Airflow UI using the “admin” user. […]