One Large Cluster Caught: Surroundings Well being Scorecard


What We’ve Lined

All through the One Large Cluster Caught collection we’ve explored impactful greatest practices to achieve management of your Cloudera Knowledge platform (CDP) surroundings and considerably enhance its well being and efficiency. We’ve shared code, dashboards, and instruments that can assist you in your well being enchancment journey. We’d like to supply one final device.

The Environmental Well being Scorecard

We observe surroundings well being on the macro stage with a dashboard that mirrors our weblog collection methodology with a number of additions. We set quarterly OKR (Aims and Key Outcomes) targets to enhance our rating.

At decrease ranges of grain our measurements are data-driven and automatic, however on the macro stage we choose to use some subjectivity (in fact our weightings will differ from yours as we’re on a distinct journey). Our information and analytics leaders meet month-to-month to guage our well being enchancment and log subjective measures. Some could name that anecdotal proof however we worth the pairing of our data-driven evaluation with our observable actuality. 

Platform Well being 

All of it begins with platform well being which we selected to measure in 3 dimensions: {hardware} efficiency, providers efficiency, and optimum configuration/tuning. We offered dozens of how-to manuals to acquire visibility and tune your surroundings

Is it shocking that we weighted platform well being solely an 8 on a 100 level scale? Our mannequin considers the length and useful resource dedication required to finish 80% of the journey, and since our platform optimization took just a few assets a number of months, we weighted it low. In case you’ve obtained a multiyear platform journey forward of you, you’ll weigh it extra closely.

NOTE: The Optimally configured quantity is only a rely of tunings we accomplished, and the odds are subjective evaluations.

Visibility and Transparency

Weighted a 20?! Yup. It’s that vital to us as we’ve got written. We selected separate measures for our personal jobs and our customers’ jobs. With 100% monitoring, alerting (notifications to DevOps), and notifications (to our prospects), why didn’t we earn a 20? As a result of we weren’t as proactive in resolving points as our OKR targets indicated we must be.

Knowledge Democratization 

Though we didn’t weblog about information democratization, we discover it an vital measure of environmental well being. Each different measurement is meaningless if crucial information parts are unavailable to choice makers. By the way, this measure is within the reverse seat of the see-saw because the others: ungoverned information democratization is the one best reason behind all the issues we’re making an attempt to influence. Take into consideration that.

Knowledge Course of Well being

Though we didn’t commit a weblog to this well being measure, we offered quite a few directions to restore issues you discover. The objectives we selected within the dashboard are vital to us, however select these which are vital to you. The person scores are counts however the total well being rating shouldn’t be a sum, it’s subjective. It is a multiyear journey.

Knowledge Asset Standardization

This measure will get our highest weighting at 25 out of 100. The well being of the surroundings is most depending on the belief that customers have within the information. The larger your information observability, and the larger the amount that’s accessed by way of enterprise commonplace dashboards and governance-certified sources of reality, the larger the chance for belief. The belief develops by means of an understanding of the information as maintained by means of metadata in your Knowledge Catalog: classification, lineage, forex, and enterprise context . You possibly can see that we did nice on report standardization however we’ve got longer to go to certify our enriched datasets and information marts, and to repipe our customers’ belongings. One other multiyear journey.

Knowledge High quality & Knowledge Governance Extensibility

Like information standardization this goes to the guts of trusted information. We’ve 37 whole well being factors measuring information trustworthiness. Which will appear counterintuitive when utilized to an environmental “well being” measure, however that’s how we see it. You might even see these and different measures otherwise.   

Better of Luck!

We smile on the chance that we would have enabled you to be extra environment friendly or succesful (or each!). Go to our Group Web page, our blogs, and Knowledge and IT Leaders web page for a lot extra.

Latest articles

Related articles

Leave a reply

Please enter your comment!
Please enter your name here