Skip to main content

Simple way to manage your observability stack with NexClipper

Jinwoong Kim

NexClipper

I had joined NexClipper development team in April last year and have been developing NexClipper service since September. I'd like to talk about NexClipper,which has been going through the 0.5 release version.

What is Observability?

The term "Observability" derives from a study of control theory, first introduced in 1960 in the paper "On the General Theory of Control Systems" written by Rudolf E. Kálmán. Generally, observability refers to measuring whether the internal state of a system can be inferred from external signals and characteristics. To put it a little easier, it's a state where we can monitor the output of the system to make sure that the system we operate is learning stably and when a problem occurs, to determine when something went wrong or for what reason. When you apply it to IT, it means that you record and observe everything such as logs, events, and metrics generated by your cloud infrastructure and applications.

Cloud Native Observabilty and Limitation

Business in a cloud-native environment is built as a quick prototype with no delay in decision-making when adding new features, and delivered to users through various monitoring and metering features. With A/B testing, you will get a very quick assessment of whether it is better or worse than the previous feature. If the new version is better, you should keep the new deployment version intact, and if it gets worse, you need to remove the feature or restore the original in a short time.

It also requires a lot of managed Kubernetes solutions to move to a Kubernetes based cloud native application. It's evolving with the solutions, but still needs preparation for operations. Whether a commercial monitoring solution exists or not, the introduction of Prometheus open source is indispensable for Kubernetes-based operations. And you need an expert for deployment and operation (global views, authentication, long-term data storage, multi-tenancy, and so on) that are not supported in open source.

Mission of NexClipper

We want to solve these problems.

  • It takes a lot of time and effort to deploy and operate an open-source stack.
    • Prometheus, PromQL, Grafana dashboard, Configuration, Alert-Rule, etc.
  • Long-term archiving of metric data is not easy.
    • By default, if each 3 Byte metric are stored 100,000 per second, about 500 GB of storage will be used within 30 days. Long-term archiving is not easy when operating Prometheus in the form of a local instance or a general pod, and the more monitored you have, the more data you store.
  • Data source duplication may occur.
    • Prometheus is difficult to manage in terms of data sources when it is installed and operated in multiple clusters. And when you configure a dashboard such as Grafana, it is not easy to distinguish when querying multiple clusters for the same metric. This makes it hard to consolidate and view data when Prometheus is installed for each cluster.
  • The configuration for scaling and high availability is complex.
  • There are some shortcomings in terms of group management and user authentication management (security).
  • Prometheus cannot collect raw logs and events.
  • Application-based request tracing is not supported itself.
  • Anomaly Detection requires a separate data analysis capability.

Managed Observability Platform At Anywhere.

The primary goal of NexClipper is to make it easy to set up and use the Observability platform in your own cloud environment, putting the highest priority on ensuring observability in any environment.

nexclipper

Value of Nexclipper

Make Observability Simple & Easy

NexClipper allows you to easily build a complex Observability open-source stack within your private cluster. In the Kubernetes open-source ecosystem, all open sources that need to be recorded, such as logs and events, including Prometheus, the most widely used metric-based monitoring solution in the environment, are easy to provision and operate with expert-like experience.

Managed Prometheus

Nexclipper is based on an open source ecosystem, making them highly scalable, and allowing users to remove the limitation of vendor lock-in. It supports most existing public cloud environments, including AWS, based on dependency removal. Not only is it Self-build Kubernetes, but it also supports managed Kubernetes from a variety of CSPs.

Cost effective

NexClipper automates repetitive tasks to avoid human errors and reduces costs through reduced learning curves. You can work with UI-based dashboards with everything you need, including repetitive dashboard configurations, AlertRule, and Managed Service Discovery settings, and human errors can be reduced by utilizing the test feature.

Observe all of your data in single endpoint

By managing individual clusters and storing them in the Global-View cluster at the same time, it is possible to manage data for analysis. You can also monitor your existing deployed monitoring systems. In the event of a failure of the individual cluster monitoring stack itself, it can be monitored safely even if the notification is not delivered.

Components of NexClipper

NexClipper is developing on the following open-source base to add new convenience features while maintaining existing open-source solutions while leveraging the cloud native-based observability ecosystem, including Prometheus. For more information, please refer to the homepage.

NexClipper

  • Metrics Pipeline for interoperability and Enterprise Prometheus

ExporterHub

  • A Curated List of Prometheus Exporters for the Best practice

Webstork

  • Web tunnel for Cloud-native application remote monitoring

Klevr

  • Hyper-connected Cloud-native delivery solution for SaaS

ProvBee

  • Provisioning All the platforms for Cloud-native

MetricArk

  • Prometheus based status(State/Event/Metric) Composite API

Conclusion

NexClipper is "Managed Prometheus service for enterprise customers" that composed of open-sources and cloud native solution. NexClipper enables easy deployment of the Observability stack, including Prometheus that supports the many capabilities needed in enterprise environments. In the next posting, we will describe the features and benefits of NexClipper.

Getting Started

Get Started quickly and easily with NexClipper

freetrial ><

Introduction of NexClipper

Nexcloud is a container-based cloud technology company. For full-scale global business, we are currently establishing a U.S. corporation, and we are bringing in competent people. For more information on the Job Description, please see the link below.

We're Hiring

Please give us various feedback on all of our technologies and products, including blog contents, and if you have any questions or need any technical meetings, please contact us at support@nexclipper.io and we will reply to you as soon as soon as possible.